Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 916428 Details for
Bug 1117388
Can't plug vnic to running vm or add vnic
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log
vdsm.log (text/x-log), 9.16 MB, created by
Michael Burman
on 2014-07-08 14:46:24 UTC
(
hide
)
Description:
vdsm log
Filename:
MIME Type:
Creator:
Michael Burman
Created:
2014-07-08 14:46:24 UTC
Size:
9.16 MB
patch
obsolete
>Dummy-6860::DEBUG::2014-07-08 16:01:03,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:03,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185307 s, 55.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:05,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:05,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186497 s, 54.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:01:07,656::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:01:07,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a3d0663-f606-4b36-87fd-7b9bcbd6ceed`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:01:07,658::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:01:07,673::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:07,673::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a3d0663-f606-4b36-87fd-7b9bcbd6ceed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:07,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a3d0663-f606-4b36-87fd-7b9bcbd6ceed`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:01:07,674::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:07,674::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:07,674::task::993::Storage.TaskManager.Task::(_decref) Task=`3a3d0663-f606-4b36-87fd-7b9bcbd6ceed`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:01:07,687::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:01:07,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`638217eb-c261-40fd-baa9-ccc8a38d1921`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:01:07,688::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:01:07,689::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6d27ad64-72ac-43f0-abf3-b40a5a174e29`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:01:07,689::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:01:07,690::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:01:07,690::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6d27ad64-72ac-43f0-abf3-b40a5a174e29`::Granted request >Thread-6940::DEBUG::2014-07-08 16:01:07,691::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`638217eb-c261-40fd-baa9-ccc8a38d1921`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:01:07,691::task::993::Storage.TaskManager.Task::(_decref) Task=`638217eb-c261-40fd-baa9-ccc8a38d1921`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:01:07,711::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:07,711::task::1191::Storage.TaskManager.Task::(prepare) Task=`638217eb-c261-40fd-baa9-ccc8a38d1921`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:07,711::task::595::Storage.TaskManager.Task::(_updateState) Task=`638217eb-c261-40fd-baa9-ccc8a38d1921`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:01:07,712::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:01:07,712::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:01:07,712::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:01:07,713::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:01:07,713::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:01:07,713::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:01:07,713::task::993::Storage.TaskManager.Task::(_decref) Task=`638217eb-c261-40fd-baa9-ccc8a38d1921`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:01:08,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:08,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0943643 s, 10.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:01:08,621::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:01:08,625::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:08,627::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:01:08,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:08,628::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:08,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:08,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:08,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:08,629::__init__::225::IOProcess::(_processLogs) (272090) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:01:08,629::__init__::225::IOProcess::(_processLogs) (272090) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:01:08,630::__init__::225::IOProcess::(_processLogs) (272090) Building response >Thread-18::DEBUG::2014-07-08 16:01:08,630::__init__::225::IOProcess::(_processLogs) (272090) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:08,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:08,630::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:01:08,631::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:08,632::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:01:08,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:08,632::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:08,632::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:08,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:08,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:08,633::__init__::225::IOProcess::(_processLogs) (272091) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:01:08,633::__init__::225::IOProcess::(_processLogs) (272091) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:01:08,634::__init__::225::IOProcess::(_processLogs) (272091) Building response >Thread-18::DEBUG::2014-07-08 16:01:08,634::__init__::225::IOProcess::(_processLogs) (272091) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:08,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:08,634::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:01:08,642::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:01:08,644::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:08,646::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:08,647::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:08,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:08,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:08,652::__init__::225::IOProcess::(_processLogs) (272092) Finding callback 'glob'... >Thread-6939::DEBUG::2014-07-08 16:01:08,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c91303b-0fb9-44a6-a204-92cdf1484aa4`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:01:08,653::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob' >Thread-6939::INFO::2014-07-08 16:01:08,654::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::DEBUG::2014-07-08 16:01:08,655::__init__::225::IOProcess::(_processLogs) (272092) Building response >Thread-6939::INFO::2014-07-08 16:01:08,656::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437474', 'lastCheck': '10.0', 'valid': True}} >Thread-18::DEBUG::2014-07-08 16:01:08,657::__init__::225::IOProcess::(_processLogs) (272092) Queuing response >Thread-6939::DEBUG::2014-07-08 16:01:08,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c91303b-0fb9-44a6-a204-92cdf1484aa4`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437474', 'lastCheck': '10.0', 'valid': True}} >Thread-18::DEBUG::2014-07-08 16:01:08,658::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6939::DEBUG::2014-07-08 16:01:08,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c91303b-0fb9-44a6-a204-92cdf1484aa4`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:01:08,660::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-6939::DEBUG::2014-07-08 16:01:08,660::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:08,661::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:08,663::task::993::Storage.TaskManager.Task::(_decref) Task=`2c91303b-0fb9-44a6-a204-92cdf1484aa4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:01:08,664::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:08,665::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:01:08,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:08,672::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:08,679::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:08,689::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:08,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:08,704::__init__::225::IOProcess::(_processLogs) (272093) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:01:08,712::__init__::225::IOProcess::(_processLogs) (272093) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:01:08,719::__init__::225::IOProcess::(_processLogs) (272093) Building response >Thread-18::DEBUG::2014-07-08 16:01:08,726::__init__::225::IOProcess::(_processLogs) (272093) Queuing response >Thread-37::DEBUG::2014-07-08 16:01:08,730::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:01:08,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:08,739::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:01:08,746::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:08,748::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:01:08,750::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:08,752::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:08,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:08,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:08,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:08,759::__init__::225::IOProcess::(_processLogs) (272094) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:01:08,762::__init__::225::IOProcess::(_processLogs) (272094) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:01:08,765::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|(272094) Building response >Thread-18::DEBUG::2014-07-08 16:01:08,767::__init__::225::IOProcess::(_processLogs) (272094) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:08,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:08,772::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:01:08,777::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:01:08,782::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:08,786::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:01:08,789::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:08,791::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:08,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:08,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:08,799::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:08,802::__init__::225::IOProcess::(_processLogs) (272095) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:01:08,804::__init__::225::IOProcess::(_processLogs) (272095) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:01:08,806::__init__::225::IOProcess::(_processLogs) (272095) Building response >Thread-18::DEBUG::2014-07-08 16:01:08,807::__init__::225::IOProcess::(_processLogs) (272095) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:08,808::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:08,809::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:01:08,812::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:01:08,817::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:08,820::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:01:08,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:08,823::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:08,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:08,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:08,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:08,839::__init__::225::IOProcess::(_processLogs) (272096) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:08,840::__init__::225::IOProcess::(_processLogs) (272096) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:08,842::__init__::225::IOProcess::(_processLogs) (272096) Building response >Thread-18::DEBUG::2014-07-08 16:01:08,843::__init__::225::IOProcess::(_processLogs) (272096) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:08,844::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:08,846::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:08,850::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:08,852::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:01:08,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:08,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:08,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:08,857::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:08,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:08,860::__init__::225::IOProcess::(_processLogs) (272097) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:01:08,862::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|(272097) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:01:08,863::__init__::225::IOProcess::(_processLogs) (272097) Building response >Thread-18::DEBUG::2014-07-08 16:01:08,864::__init__::225::IOProcess::(_processLogs) (272097) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:08,866::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:08,867::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:01:08,870::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:01:08,871::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:01:08,871::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:01:08,873::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:08,874::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:08,876::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:08,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:08,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:08,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:08,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:08,883::__init__::225::IOProcess::(_processLogs) (272098) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:08,884::__init__::225::IOProcess::(_processLogs) (272098) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:08,886::__init__::225::IOProcess::(_processLogs) (272098) Building response >Thread-18::DEBUG::2014-07-08 16:01:08,887::__init__::225::IOProcess::(_processLogs) (272098) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:08,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:08,890::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:01:08,896::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:01:09,058::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0105991 s, 43.6 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:01:09,063::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:09,065::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:09,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:09,067::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:09,069::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:09,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:09,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:09,073::__init__::225::IOProcess::(_processLogs) (272099) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:09,074::__init__::225::IOProcess::(_processLogs) (272099) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:09,075::__init__::225::IOProcess::(_processLogs) (272099) Building response >Thread-18::DEBUG::2014-07-08 16:01:09,077::__init__::225::IOProcess::(_processLogs) (272099) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:09,078::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:09,080::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:01:09,089::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:09,091::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:01:09,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:09,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:09,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:09,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:09,099::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:09,100::__init__::225::IOProcess::(_processLogs) (272100) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:09,101::__init__::225::IOProcess::(_processLogs) (272100) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:09,103::__init__::225::IOProcess::(_processLogs) (272100) Building response >Thread-18::DEBUG::2014-07-08 16:01:09,105::__init__::225::IOProcess::(_processLogs) (272100) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:09,107::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:09,108::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:09,114::__init__::225::IOProcess::(_processLogs) (272092) Got request for method 'glob'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:09,116::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:01:09,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:09,120::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:09,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:09,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:09,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:09,127::__init__::225::IOProcess::(_processLogs) (272101) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:09,129::__init__::225::IOProcess::(_processLogs) (272101) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:09,131::__init__::225::IOProcess::(_processLogs) (272101) Building response >Thread-18::DEBUG::2014-07-08 16:01:09,132::__init__::225::IOProcess::(_processLogs) (272101) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:09,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:09,135::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:09,140::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:09,142::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:01:09,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:09,144::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:09,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:09,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:09,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:09,150::__init__::225::IOProcess::(_processLogs) (272102) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:09,151::__init__::225::IOProcess::(_processLogs) (272102) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:09,152::__init__::225::IOProcess::(_processLogs) (272102) Building response >Thread-18::DEBUG::2014-07-08 16:01:09,153::__init__::225::IOProcess::(_processLogs) (272102) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:09,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:09,155::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:01:10,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:10,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0433821 s, 23.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:12,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:12,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254034 s, 40.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:14,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:15,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174719 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:17,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:17,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176761 s, 57.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:01:17,726::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6731c235] >Thread-6939::DEBUG::2014-07-08 16:01:17,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`da865af6-2e11-4f69-b112-c05038ef6918`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:01:17,728::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:01:17,743::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:17,743::task::1191::Storage.TaskManager.Task::(prepare) Task=`da865af6-2e11-4f69-b112-c05038ef6918`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:17,744::task::595::Storage.TaskManager.Task::(_updateState) Task=`da865af6-2e11-4f69-b112-c05038ef6918`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:01:17,744::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:17,744::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:17,744::task::993::Storage.TaskManager.Task::(_decref) Task=`da865af6-2e11-4f69-b112-c05038ef6918`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:01:17,756::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6731c235] >Thread-6940::DEBUG::2014-07-08 16:01:17,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`54b0fcc8-9215-4361-af5b-e5964bb7cf40`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:01:17,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:01:17,759::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f95cd406-ad07-46ee-b8bf-f3e8fbdfa431`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:01:17,759::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:01:17,759::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:01:17,760::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f95cd406-ad07-46ee-b8bf-f3e8fbdfa431`::Granted request >Thread-6940::DEBUG::2014-07-08 16:01:17,760::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`54b0fcc8-9215-4361-af5b-e5964bb7cf40`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:01:17,761::task::993::Storage.TaskManager.Task::(_decref) Task=`54b0fcc8-9215-4361-af5b-e5964bb7cf40`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:01:17,780::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:17,780::task::1191::Storage.TaskManager.Task::(prepare) Task=`54b0fcc8-9215-4361-af5b-e5964bb7cf40`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:17,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`54b0fcc8-9215-4361-af5b-e5964bb7cf40`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:01:17,781::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:01:17,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:01:17,782::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:01:17,782::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:01:17,782::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:01:17,782::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:01:17,783::task::993::Storage.TaskManager.Task::(_decref) Task=`54b0fcc8-9215-4361-af5b-e5964bb7cf40`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:01:19,161::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:19,162::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:19,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:19,162::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:19,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:19,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:19,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:19,163::__init__::225::IOProcess::(_processLogs) (272103) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:19,163::__init__::225::IOProcess::(_processLogs) (272103) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:19,164::__init__::225::IOProcess::(_processLogs) (272103) Building response >Thread-18::DEBUG::2014-07-08 16:01:19,164::__init__::225::IOProcess::(_processLogs) (272103) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:19,164::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:19,164::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:01:19,166::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:01:19,316::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000466527 s, 990 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:01:19,321::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:19,321::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:19,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:19,322::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:19,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:19,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:19,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:19,327::__init__::225::IOProcess::(_processLogs) (272104) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:19,330::__init__::225::IOProcess::(_processLogs) (272104) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:19,332::__init__::225::IOProcess::(_processLogs) (272104) Building response >Thread-18::DEBUG::2014-07-08 16:01:19,334::__init__::225::IOProcess::(_processLogs) (272104) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:19,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:19,339::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:01:19,348::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:19,350::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:01:19,351::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:19,353::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:19,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:19,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:19,358::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:19,359::__init__::225::IOProcess::(_processLogs) (272105) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:19,361::__init__::225::IOProcess::(_processLogs) (272105) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:19,362::__init__::225::IOProcess::(_processLogs) (272105) Building response >Thread-18::DEBUG::2014-07-08 16:01:19,363::__init__::225::IOProcess::(_processLogs) (272105) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:19,365::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:19,366::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:19,371::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:19,373::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:01:19,374::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:19,375::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:19,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:19,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:19,379::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:19,380::__init__::225::IOProcess::(_processLogs) (272106) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:19,381::__init__::225::IOProcess::(_processLogs) (272106) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:19,383::__init__::225::IOProcess::(_processLogs) (272106) Building response >Thread-18::DEBUG::2014-07-08 16:01:19,384::__init__::225::IOProcess::(_processLogs) (272106) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:19,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:19,387::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:19,391::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:19,392::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:01:19,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:19,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:19,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:19,397::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:19,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:19,400::__init__::225::IOProcess::(_processLogs) (272107) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:19,401::__init__::225::IOProcess::(_processLogs) (272107) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:19,402::__init__::225::IOProcess::(_processLogs) (272107) Building response >Thread-18::DEBUG::2014-07-08 16:01:19,403::__init__::225::IOProcess::(_processLogs) (272107) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:19,405::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:19,406::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:01:19,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:19,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175834 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:21,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:22,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173917 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:01:23,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eb0db7d-a3ea-42fb-bfc9-108f6f5e5c7a`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:01:23,966::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:01:23,967::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466527', 'lastCheck': '4.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:01:23,967::task::1191::Storage.TaskManager.Task::(prepare) Task=`1eb0db7d-a3ea-42fb-bfc9-108f6f5e5c7a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466527', 'lastCheck': '4.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:01:23,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eb0db7d-a3ea-42fb-bfc9-108f6f5e5c7a`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:01:23,968::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:23,968::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:23,968::task::993::Storage.TaskManager.Task::(_decref) Task=`1eb0db7d-a3ea-42fb-bfc9-108f6f5e5c7a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:01:24,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:24,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174403 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:26,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:26,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176487 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:01:27,796::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:01:27,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`b660f391-daf4-43d3-8d19-46227ece3afe`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:01:27,798::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:01:27,813::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:27,814::task::1191::Storage.TaskManager.Task::(prepare) Task=`b660f391-daf4-43d3-8d19-46227ece3afe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:27,814::task::595::Storage.TaskManager.Task::(_updateState) Task=`b660f391-daf4-43d3-8d19-46227ece3afe`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:01:27,814::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:27,815::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:27,815::task::993::Storage.TaskManager.Task::(_decref) Task=`b660f391-daf4-43d3-8d19-46227ece3afe`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:01:27,826::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:01:27,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a8d0aee-04a2-4770-a8d0-a72932e1534d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:01:27,828::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:01:27,828::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a9f404b8-dd5b-4587-b997-66543db98a6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:01:27,829::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:01:27,829::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:01:27,829::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a9f404b8-dd5b-4587-b997-66543db98a6c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:01:27,830::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6a8d0aee-04a2-4770-a8d0-a72932e1534d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:01:27,830::task::993::Storage.TaskManager.Task::(_decref) Task=`6a8d0aee-04a2-4770-a8d0-a72932e1534d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:01:27,849::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:27,850::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a8d0aee-04a2-4770-a8d0-a72932e1534d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:27,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a8d0aee-04a2-4770-a8d0-a72932e1534d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:01:27,850::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:01:27,851::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:01:27,851::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:01:27,851::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:01:27,852::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:01:27,852::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:01:27,852::task::993::Storage.TaskManager.Task::(_decref) Task=`6a8d0aee-04a2-4770-a8d0-a72932e1534d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:01:28,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:28,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177261 s, 57.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:01:29,415::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:29,416::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:29,416::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:29,417::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:29,417::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:29,417::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:29,417::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:29,418::__init__::225::IOProcess::(_processLogs) (272108) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:29,418::__init__::225::IOProcess::(_processLogs) (272108) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:29,418::__init__::225::IOProcess::(_processLogs) (272108) Building response >Thread-18::DEBUG::2014-07-08 16:01:29,418::__init__::225::IOProcess::(_processLogs) (272108) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:29,419::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:29,419::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:01:29,421::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:01:29,594::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000465131 s, 993 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:01:29,601::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:29,602::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:29,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:29,604::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:29,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:29,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:29,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:29,610::__init__::225::IOProcess::(_processLogs) (272109) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:29,612::__init__::225::IOProcess::(_processLogs) (272109) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:29,613::__init__::225::IOProcess::(_processLogs) (272109) Building response >Thread-18::DEBUG::2014-07-08 16:01:29,615::__init__::225::IOProcess::(_processLogs) (272109) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:29,616::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:29,617::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:01:29,626::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:29,627::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:01:29,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:29,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:29,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:29,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:29,634::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:29,635::__init__::225::IOProcess::(_processLogs) (272110) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:29,637::__init__::225::IOProcess::(_processLogs) (272110) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:29,638::__init__::225::IOProcess::(_processLogs) (272110) Building response >Thread-18::DEBUG::2014-07-08 16:01:29,640::__init__::225::IOProcess::(_processLogs) (272110) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:29,642::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:01:29,644::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:29,649::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:29,651::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:01:29,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:29,654::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:29,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:29,657::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:29,659::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:29,660::__init__::225::IOProcess::(_processLogs) (272111) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:29,662::__init__::225::IOProcess::(_processLogs) (272111) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:29,663::__init__::225::IOProcess::(_processLogs) (272111) Building response >Thread-18::DEBUG::2014-07-08 16:01:29,665::__init__::225::IOProcess::(_processLogs) (272111) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:29,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:29,668::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:29,673::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:29,675::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:01:29,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:29,678::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:29,679::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:29,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:29,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:29,683::__init__::225::IOProcess::(_processLogs) (272112) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:29,684::__init__::225::IOProcess::(_processLogs) (272112) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:29,686::__init__::225::IOProcess::(_processLogs) (272112) Building response >Thread-18::DEBUG::2014-07-08 16:01:29,687::__init__::225::IOProcess::(_processLogs) (272112) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:29,689::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:29,690::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:01:30,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:31,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178398 s, 57.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:33,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:33,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179851 s, 56.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:35,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:35,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173115 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:37,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:01:37,967::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:01:37,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`507c8fc8-0f4c-45bd-a44e-e4ada67e09ec`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:01:37,976::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:01:38,064::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:01:38,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355815 s, 28.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:01:38,066::task::1191::Storage.TaskManager.Task::(prepare) Task=`507c8fc8-0f4c-45bd-a44e-e4ada67e09ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:38,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`507c8fc8-0f4c-45bd-a44e-e4ada67e09ec`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:01:38,068::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:38,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:38,070::task::993::Storage.TaskManager.Task::(_decref) Task=`507c8fc8-0f4c-45bd-a44e-e4ada67e09ec`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:01:38,085::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:01:38,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`8980f041-a81e-4875-8d69-a40a809a45b4`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:01:38,088::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:01:38,092::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`27f29210-82a5-428d-ac1b-947b9a144b45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:01:38,093::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:01:38,095::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:01:38,096::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`27f29210-82a5-428d-ac1b-947b9a144b45`::Granted request >Thread-6940::DEBUG::2014-07-08 16:01:38,098::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8980f041-a81e-4875-8d69-a40a809a45b4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:01:38,099::task::993::Storage.TaskManager.Task::(_decref) Task=`8980f041-a81e-4875-8d69-a40a809a45b4`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:01:38,128::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:38,128::task::1191::Storage.TaskManager.Task::(prepare) Task=`8980f041-a81e-4875-8d69-a40a809a45b4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:38,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`8980f041-a81e-4875-8d69-a40a809a45b4`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:01:38,129::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:01:38,129::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:01:38,129::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:01:38,130::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:01:38,130::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:01:38,130::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:01:38,130::task::993::Storage.TaskManager.Task::(_decref) Task=`8980f041-a81e-4875-8d69-a40a809a45b4`::ref 0 aborting False >Thread-6939::DEBUG::2014-07-08 16:01:39,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`a706153d-27a6-4cd3-9641-1c35b98b9243`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:01:39,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:01:39,117::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465131', 'lastCheck': '9.4', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:01:39,118::task::1191::Storage.TaskManager.Task::(prepare) Task=`a706153d-27a6-4cd3-9641-1c35b98b9243`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465131', 'lastCheck': '9.4', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:01:39,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`a706153d-27a6-4cd3-9641-1c35b98b9243`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:01:39,118::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:39,118::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:39,118::task::993::Storage.TaskManager.Task::(_decref) Task=`a706153d-27a6-4cd3-9641-1c35b98b9243`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:01:39,696::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:39,697::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:39,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:39,697::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:39,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:39,698::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:39,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:39,698::__init__::225::IOProcess::(_processLogs) (272113) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:39,699::__init__::225::IOProcess::(_processLogs) (272113) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:39,699::__init__::225::IOProcess::(_processLogs) (272113) Building response >Thread-18::DEBUG::2014-07-08 16:01:39,699::__init__::225::IOProcess::(_processLogs) (272113) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:39,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:39,700::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:01:39,701::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:01:39,850::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000495023 s, 933 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:01:39,856::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:39,858::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:39,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:39,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:39,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:39,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:39,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:39,866::__init__::225::IOProcess::(_processLogs) DEBUG|(272114) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:39,867::__init__::225::IOProcess::(_processLogs) (272114) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:39,868::__init__::225::IOProcess::(_processLogs) (272114) Building response >Thread-18::DEBUG::2014-07-08 16:01:39,869::__init__::225::IOProcess::(_processLogs) (272114) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:39,871::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:39,872::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:01:39,881::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:39,882::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:01:39,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:39,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:39,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:39,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:39,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:39,890::__init__::225::IOProcess::(_processLogs) (272115) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:39,892::__init__::225::IOProcess::(_processLogs) (272115) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:39,893::__init__::225::IOProcess::(_processLogs) (272115) Building response >Thread-18::DEBUG::2014-07-08 16:01:39,895::__init__::225::IOProcess::(_processLogs) (272115) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:39,896::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:39,897::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:39,902::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:01:39,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:39,906::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:39,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:39,908::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:39,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:39,911::__init__::225::IOProcess::(_processLogs) (272116) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:39,913::__init__::225::IOProcess::(_processLogs) (272116) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:39,914::__init__::225::IOProcess::(_processLogs) (272116) Building response >Thread-18::DEBUG::2014-07-08 16:01:39,916::__init__::225::IOProcess::(_processLogs) (272116) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:39,917::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:39,919::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:39,924::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:39,926::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:01:39,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:39,929::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:39,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:39,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:39,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:39,935::__init__::225::IOProcess::(_processLogs) (272117) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:39,937::__init__::225::IOProcess::(_processLogs) (272117) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:39,938::__init__::225::IOProcess::(_processLogs) (272117) Building response >Thread-18::DEBUG::2014-07-08 16:01:39,939::__init__::225::IOProcess::(_processLogs) (272117) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:39,941::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:39,942::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:01:40,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:40,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174333 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:42,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:42,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173819 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:44,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:44,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172995 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:46,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:47,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480789 s, 21.3 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:01:48,143::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:01:48,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`94231c07-4d44-4536-8878-a8bc73908f02`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:01:48,145::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:01:48,160::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:48,160::task::1191::Storage.TaskManager.Task::(prepare) Task=`94231c07-4d44-4536-8878-a8bc73908f02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:48,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`94231c07-4d44-4536-8878-a8bc73908f02`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:01:48,161::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:48,161::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:48,161::task::993::Storage.TaskManager.Task::(_decref) Task=`94231c07-4d44-4536-8878-a8bc73908f02`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:01:48,173::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:01:48,173::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d6c99b8-2f88-48ca-aaa9-bbcffd248cae`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:01:48,174::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:01:48,175::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`99ff109e-38d0-41c9-b953-85264f0b129d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:01:48,175::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:01:48,176::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:01:48,176::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`99ff109e-38d0-41c9-b953-85264f0b129d`::Granted request >Thread-6940::DEBUG::2014-07-08 16:01:48,176::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9d6c99b8-2f88-48ca-aaa9-bbcffd248cae`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:01:48,177::task::993::Storage.TaskManager.Task::(_decref) Task=`9d6c99b8-2f88-48ca-aaa9-bbcffd248cae`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:01:48,196::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:48,196::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d6c99b8-2f88-48ca-aaa9-bbcffd248cae`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579836416', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:48,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d6c99b8-2f88-48ca-aaa9-bbcffd248cae`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:01:48,197::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:01:48,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:01:48,197::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:01:48,198::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:01:48,198::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:01:48,198::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:01:48,198::task::993::Storage.TaskManager.Task::(_decref) Task=`9d6c99b8-2f88-48ca-aaa9-bbcffd248cae`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:01:49,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:49,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017666 s, 58.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:01:49,948::__init__::225::IOProcess::(_processLogs) (272117) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:49,949::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:49,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:49,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:49,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:49,950::__init__::225::IOProcess::(_processLogs) (272117) Got request for method 'access'DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:49,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:49,950::__init__::225::IOProcess::(_processLogs) (272118) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:49,951::__init__::225::IOProcess::(_processLogs) (272118) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:49,951::__init__::225::IOProcess::(_processLogs) (272118) Building response >Thread-18::DEBUG::2014-07-08 16:01:49,951::__init__::225::IOProcess::(_processLogs) (272118) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:49,951::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:49,952::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:01:49,953::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:01:50,111::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000610677 s, 757 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:01:50,118::__init__::225::IOProcess::(_processLogs) (272117) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:50,119::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:01:50,121::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:50,123::__init__::225::IOProcess::(_processLogs) (272117) Got request for method 'access'DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:50,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:50,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:50,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:50,131::__init__::225::IOProcess::(_processLogs) (272119) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:01:50,132::__init__::225::IOProcess::(_processLogs) (272119) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:01:50,133::__init__::225::IOProcess::(_processLogs) (272119) Building response >Thread-18::DEBUG::2014-07-08 16:01:50,135::__init__::225::IOProcess::(_processLogs) (272119) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:50,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:50,137::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:01:50,149::__init__::225::IOProcess::(_processLogs) (272117) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:50,150::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:01:50,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:50,153::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:50,154::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:50,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:50,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:50,158::__init__::225::IOProcess::(_processLogs) (272120) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:50,159::__init__::225::IOProcess::(_processLogs) (272120) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:50,161::__init__::225::IOProcess::(_processLogs) (272120) Building response >Thread-18::DEBUG::2014-07-08 16:01:50,162::__init__::225::IOProcess::(_processLogs) (272120) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:50,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:50,164::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:50,169::__init__::225::IOProcess::(_processLogs) (272117) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:50,170::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:01:50,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:50,173::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:50,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:50,175::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:50,176::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:50,178::__init__::225::IOProcess::(_processLogs) (272121) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:50,179::__init__::225::IOProcess::(_processLogs) (272121) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:50,181::__init__::225::IOProcess::(_processLogs) (272121) Building response >Thread-18::DEBUG::2014-07-08 16:01:50,182::__init__::225::IOProcess::(_processLogs) (272121) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:50,183::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:50,184::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:01:50,189::__init__::225::IOProcess::(_processLogs) (272117) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:01:50,190::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:01:50,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:01:50,192::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:01:50,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:01:50,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:01:50,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:01:50,198::__init__::225::IOProcess::(_processLogs) (272122) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:01:50,199::__init__::225::IOProcess::(_processLogs) (272122) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:01:50,200::__init__::225::IOProcess::(_processLogs) (272122) Building response >Thread-18::DEBUG::2014-07-08 16:01:50,202::__init__::225::IOProcess::(_processLogs) (272122) Queuing response >Thread-18::DEBUG::2014-07-08 16:01:50,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:01:50,205::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:01:51,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:51,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017566 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:01:53,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:54,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174498 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:01:54,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`710706de-15a2-448e-b543-dede7c662b9c`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:01:54,278::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:01:54,279::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610677', 'lastCheck': '4.1', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:01:54,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`710706de-15a2-448e-b543-dede7c662b9c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610677', 'lastCheck': '4.1', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:01:54,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`710706de-15a2-448e-b543-dede7c662b9c`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:01:54,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:54,280::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:54,280::task::993::Storage.TaskManager.Task::(_decref) Task=`710706de-15a2-448e-b543-dede7c662b9c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:01:56,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:56,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176733 s, 57.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:01:58,211::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:01:58,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8a4b375-9689-43f7-bfe5-ff508db66ae9`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:01:58,212::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:01:58,227::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:58,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`a8a4b375-9689-43f7-bfe5-ff508db66ae9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:01:58,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8a4b375-9689-43f7-bfe5-ff508db66ae9`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:01:58,228::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:01:58,228::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:01:58,229::task::993::Storage.TaskManager.Task::(_decref) Task=`a8a4b375-9689-43f7-bfe5-ff508db66ae9`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:01:58,240::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:01:58,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`27c511cf-fec5-4213-ab03-32ab2ba62854`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:01:58,241::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:01:58,242::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2a108987-807f-43ed-a540-425fc1317da2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:01:58,243::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:01:58,243::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:01:58,243::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2a108987-807f-43ed-a540-425fc1317da2`::Granted request >Thread-6940::DEBUG::2014-07-08 16:01:58,244::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`27c511cf-fec5-4213-ab03-32ab2ba62854`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:01:58,244::task::993::Storage.TaskManager.Task::(_decref) Task=`27c511cf-fec5-4213-ab03-32ab2ba62854`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:01:58,263::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:58,264::task::1191::Storage.TaskManager.Task::(prepare) Task=`27c511cf-fec5-4213-ab03-32ab2ba62854`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:01:58,264::task::595::Storage.TaskManager.Task::(_updateState) Task=`27c511cf-fec5-4213-ab03-32ab2ba62854`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:01:58,264::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:01:58,265::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:01:58,265::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:01:58,266::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:01:58,266::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:01:58,266::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:01:58,266::task::993::Storage.TaskManager.Task::(_decref) Task=`27c511cf-fec5-4213-ab03-32ab2ba62854`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:01:58,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:01:58,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017673 s, 57.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:00,211::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:00,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:00,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:00,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:00,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:00,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:00,213::__init__::225::IOProcess::(_processLogs) (272123) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:00,213::__init__::225::IOProcess::(_processLogs) (272123) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:00,213::__init__::225::IOProcess::(_processLogs) (272123) Building response >Thread-18::DEBUG::2014-07-08 16:02:00,214::__init__::225::IOProcess::(_processLogs) (272123) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:00,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:00,214::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:02:00,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:02:00,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00501392 s, 92.1 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:00,370::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:00,371::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:00,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:00,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:00,376::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:00,378::__init__::225::IOProcess::(_processLogs) (272124) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:00,379::__init__::225::IOProcess::(_processLogs) (272124) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:00,380::__init__::225::IOProcess::(_processLogs) (272124) Building response >Thread-18::DEBUG::2014-07-08 16:02:00,382::__init__::225::IOProcess::(_processLogs) (272124) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:00,383::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:00,385::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:02:00,394::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:02:00,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:00,397::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:00,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:00,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:00,401::__init__::225::IOProcess::(_processLogs) (272125) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:00,402::__init__::225::IOProcess::(_processLogs) (272125) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:00,405::__init__::225::IOProcess::(_processLogs) (272125) Building response >Thread-18::DEBUG::2014-07-08 16:02:00,409::__init__::225::IOProcess::(_processLogs) (272125) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:00,413::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:00,416::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:00,420::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:02:00,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:00,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:00,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:00,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:00,428::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:00,435::__init__::225::IOProcess::(_processLogs) (272126) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:00,437::__init__::225::IOProcess::(_processLogs) (272126) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:00,439::__init__::225::IOProcess::(_processLogs) (272126) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:00,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:00,442::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:00,447::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:02:00,449::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:00,450::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:00,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:00,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:00,455::__init__::225::IOProcess::(_processLogs) (272127) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:00,457::__init__::225::IOProcess::(_processLogs) (272127) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:00,458::__init__::225::IOProcess::(_processLogs) (272127) Building response >Thread-18::DEBUG::2014-07-08 16:02:00,460::__init__::225::IOProcess::(_processLogs) (272127) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:00,461::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:00,462::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:02:00,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:00,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01768 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:02,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:03,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180365 s, 56.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:05,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:05,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0217469 s, 47.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:07,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:07,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171263 s, 59.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:02:08,278::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:02:08,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1c7280c-e4a3-4c60-97a0-5bf3c93c2479`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:08,280::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:02:08,295::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:08,295::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1c7280c-e4a3-4c60-97a0-5bf3c93c2479`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:08,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1c7280c-e4a3-4c60-97a0-5bf3c93c2479`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:08,296::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:08,296::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:08,296::task::993::Storage.TaskManager.Task::(_decref) Task=`a1c7280c-e4a3-4c60-97a0-5bf3c93c2479`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:02:08,308::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:02:08,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`deadd4ad-3b83-459a-8eb7-e29632afda0f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:02:08,310::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:02:08,310::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d8718d48-e6e8-4645-adb4-327153f7388b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:02:08,311::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:02:08,311::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:02:08,311::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d8718d48-e6e8-4645-adb4-327153f7388b`::Granted request >Thread-6940::DEBUG::2014-07-08 16:02:08,312::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`deadd4ad-3b83-459a-8eb7-e29632afda0f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:02:08,313::task::993::Storage.TaskManager.Task::(_decref) Task=`deadd4ad-3b83-459a-8eb7-e29632afda0f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:02:08,332::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:08,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`deadd4ad-3b83-459a-8eb7-e29632afda0f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:08,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`deadd4ad-3b83-459a-8eb7-e29632afda0f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:02:08,333::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:02:08,333::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:02:08,333::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:02:08,334::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:02:08,334::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:02:08,334::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:02:08,334::task::993::Storage.TaskManager.Task::(_decref) Task=`deadd4ad-3b83-459a-8eb7-e29632afda0f`::ref 0 aborting False >Thread-6939::DEBUG::2014-07-08 16:02:09,462::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ad9db5e-e74f-40f9-8bd9-869c1006d3de`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:09,463::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:02:09,463::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00501392', 'lastCheck': '9.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:02:09,463::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ad9db5e-e74f-40f9-8bd9-869c1006d3de`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00501392', 'lastCheck': '9.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:02:09,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ad9db5e-e74f-40f9-8bd9-869c1006d3de`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:09,464::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:09,464::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:09,464::task::993::Storage.TaskManager.Task::(_decref) Task=`9ad9db5e-e74f-40f9-8bd9-869c1006d3de`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:02:09,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:09,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174507 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:10,469::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:10,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:10,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:10,470::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:10,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:10,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:10,471::__init__::225::IOProcess::(_processLogs) (272128) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:10,471::__init__::225::IOProcess::(_processLogs) (272128) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:10,471::__init__::225::IOProcess::(_processLogs) (272128) Building response >Thread-18::DEBUG::2014-07-08 16:02:10,471::__init__::225::IOProcess::(_processLogs) (272128) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:10,472::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:10,472::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:02:10,473::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:02:10,625::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000498374 s, 927 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:10,628::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:02:10,629::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:10,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:10,630::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:10,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:10,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:10,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:10,631::__init__::225::IOProcess::(_processLogs) (272129) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:10,632::__init__::225::IOProcess::(_processLogs) (272129) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:10,632::__init__::225::IOProcess::(_processLogs) (272129) Building response >Thread-18::DEBUG::2014-07-08 16:02:10,633::__init__::225::IOProcess::(_processLogs) (272129) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:10,633::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:10,633::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:02:10,638::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:02:10,638::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:02:10,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:10,639::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:10,640::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:10,640::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:10,641::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:10,641::__init__::225::IOProcess::(_processLogs) (272130) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:10,641::__init__::225::IOProcess::(_processLogs) (272130) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:10,642::__init__::225::IOProcess::(_processLogs) (272130) Building response >Thread-18::DEBUG::2014-07-08 16:02:10,642::__init__::225::IOProcess::(_processLogs) (272130) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:10,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:10,643::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:10,653::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:02:10,653::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:02:10,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:10,654::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:10,654::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:10,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:10,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:10,655::__init__::225::IOProcess::(_processLogs) (272131) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:10,655::__init__::225::IOProcess::(_processLogs) (272131) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:10,655::__init__::225::IOProcess::(_processLogs) (272131) Building response >Thread-18::DEBUG::2014-07-08 16:02:10,656::__init__::225::IOProcess::(_processLogs) (272131) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:10,656::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:10,656::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:10,658::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:02:10,659::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:02:10,659::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:10,659::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:10,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:10,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:10,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:10,661::__init__::225::IOProcess::(_processLogs) (272132) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:10,661::__init__::225::IOProcess::(_processLogs) (272132) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:10,662::__init__::225::IOProcess::(_processLogs) (272132) Building response >Thread-18::DEBUG::2014-07-08 16:02:10,662::__init__::225::IOProcess::(_processLogs) (272132) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:10,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:10,663::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:02:11,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:12,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174582 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:14,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:14,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182122 s, 56.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:16,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:16,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173473 s, 59.0 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:02:18,350::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:02:18,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd9b0f1c-4a2f-4374-8a5d-b887094dbb1f`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:18,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:02:18,367::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:18,367::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd9b0f1c-4a2f-4374-8a5d-b887094dbb1f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:18,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd9b0f1c-4a2f-4374-8a5d-b887094dbb1f`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:18,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:18,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:18,368::task::993::Storage.TaskManager.Task::(_decref) Task=`fd9b0f1c-4a2f-4374-8a5d-b887094dbb1f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:02:18,380::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:02:18,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`38453b82-e693-4132-ab71-bbe48c4f17eb`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:02:18,381::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:02:18,382::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f5a9877d-a35a-4a51-9fc4-19b3feddc201`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:02:18,382::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:02:18,383::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:02:18,383::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f5a9877d-a35a-4a51-9fc4-19b3feddc201`::Granted request >Thread-6940::DEBUG::2014-07-08 16:02:18,384::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`38453b82-e693-4132-ab71-bbe48c4f17eb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:02:18,384::task::993::Storage.TaskManager.Task::(_decref) Task=`38453b82-e693-4132-ab71-bbe48c4f17eb`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:02:18,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:18,403::task::1191::Storage.TaskManager.Task::(prepare) Task=`38453b82-e693-4132-ab71-bbe48c4f17eb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:18,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`38453b82-e693-4132-ab71-bbe48c4f17eb`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:02:18,404::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:02:18,404::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:02:18,405::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:02:18,405::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:02:18,405::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:02:18,405::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:02:18,406::task::993::Storage.TaskManager.Task::(_decref) Task=`38453b82-e693-4132-ab71-bbe48c4f17eb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:02:18,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:19,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017494 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:20,718::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:02:20,723::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:20,723::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:20,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:20,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:20,724::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:20,727::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:20,727::__init__::225::IOProcess::(_processLogs) (272133) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:20,728::__init__::225::IOProcess::(_processLogs) (272133) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:20,730::__init__::225::IOProcess::(_processLogs) (272133) Building response >Thread-18::DEBUG::2014-07-08 16:02:20,733::__init__::225::IOProcess::(_processLogs) (272133) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:20,736::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:20,738::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:02:20,751::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:02:20,903::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000489156 s, 944 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:20,908::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:20,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:20,912::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:20,914::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:20,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:20,918::__init__::225::IOProcess::(_processLogs) (272134) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:20,919::__init__::225::IOProcess::(_processLogs) (272134) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:20,921::__init__::225::IOProcess::(_processLogs) (272134) Building response >Thread-18::DEBUG::2014-07-08 16:02:20,922::__init__::225::IOProcess::(_processLogs) (272134) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:20,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:20,925::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:02:20,935::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:02:20,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:20,938::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:20,940::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:20,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:20,943::__init__::225::IOProcess::(_processLogs) (272135) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:20,944::__init__::225::IOProcess::(_processLogs) (272135) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:20,946::__init__::225::IOProcess::(_processLogs) (272135) Building response >Thread-18::DEBUG::2014-07-08 16:02:20,947::__init__::225::IOProcess::(_processLogs) (272135) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:20,949::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:20,950::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:20,956::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:02:20,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:20,959::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:20,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:20,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:20,965::__init__::225::IOProcess::(_processLogs) (272136) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:20,966::__init__::225::IOProcess::(_processLogs) (272136) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:20,967::__init__::225::IOProcess::(_processLogs) (272136) Building response >Thread-18::DEBUG::2014-07-08 16:02:20,969::__init__::225::IOProcess::(_processLogs) (272136) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:20,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:20,972::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:20,978::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:02:20,979::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:20,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:20,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:20,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:20,984::__init__::225::IOProcess::(_processLogs) (272137) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:20,986::__init__::225::IOProcess::(_processLogs) (272137) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:20,987::__init__::225::IOProcess::(_processLogs) (272137) Building response >Thread-18::DEBUG::2014-07-08 16:02:20,988::__init__::225::IOProcess::(_processLogs) (272137) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:20,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:20,991::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:02:21,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:21,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174889 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:23,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:23,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018693 s, 54.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:02:24,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`55c49997-bf12-4d2b-92d5-4e214520ace7`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:24,631::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:02:24,631::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489156', 'lastCheck': '3.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:02:24,631::task::1191::Storage.TaskManager.Task::(prepare) Task=`55c49997-bf12-4d2b-92d5-4e214520ace7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489156', 'lastCheck': '3.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:02:24,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`55c49997-bf12-4d2b-92d5-4e214520ace7`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:24,632::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:24,632::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:24,632::task::993::Storage.TaskManager.Task::(_decref) Task=`55c49997-bf12-4d2b-92d5-4e214520ace7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:02:25,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:25,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423088 s, 24.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:27,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:28,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174741 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:02:28,419::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:02:28,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5368909-4e98-4101-b540-fe14d978ef58`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:28,420::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:02:28,436::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:28,437::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5368909-4e98-4101-b540-fe14d978ef58`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:28,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5368909-4e98-4101-b540-fe14d978ef58`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:28,437::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:28,437::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:28,438::task::993::Storage.TaskManager.Task::(_decref) Task=`e5368909-4e98-4101-b540-fe14d978ef58`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:02:28,449::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:02:28,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`31f34911-2354-4def-8755-8da2e1e86fae`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:02:28,450::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:02:28,451::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24b6e4d5-88f0-4b84-b31f-d80868571757`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:02:28,451::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:02:28,452::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:02:28,452::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24b6e4d5-88f0-4b84-b31f-d80868571757`::Granted request >Thread-6940::DEBUG::2014-07-08 16:02:28,453::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`31f34911-2354-4def-8755-8da2e1e86fae`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:02:28,453::task::993::Storage.TaskManager.Task::(_decref) Task=`31f34911-2354-4def-8755-8da2e1e86fae`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:02:28,473::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:28,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`31f34911-2354-4def-8755-8da2e1e86fae`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:28,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`31f34911-2354-4def-8755-8da2e1e86fae`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:02:28,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:02:28,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:02:28,475::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:02:28,475::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:02:28,475::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:02:28,476::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:02:28,476::task::993::Storage.TaskManager.Task::(_decref) Task=`31f34911-2354-4def-8755-8da2e1e86fae`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:02:30,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:30,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177708 s, 57.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:30,997::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:30,997::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:30,997::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:30,998::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:30,998::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:30,998::__init__::225::IOProcess::(_processLogs) (272138) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:30,999::__init__::225::IOProcess::(_processLogs) (272138) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:30,999::__init__::225::IOProcess::(_processLogs) (272138) Building response >Thread-18::DEBUG::2014-07-08 16:02:30,999::__init__::225::IOProcess::(_processLogs) (272138) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:30,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:31,000::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:02:31,001::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:02:31,153::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000504522 s, 916 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:31,240::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:31,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:31,252::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:31,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:31,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:31,257::__init__::225::IOProcess::(_processLogs) (272139) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:31,268::__init__::225::IOProcess::(_processLogs) (272139) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:31,271::__init__::225::IOProcess::(_processLogs) (272139) Building response >Thread-18::DEBUG::2014-07-08 16:02:31,272::__init__::225::IOProcess::(_processLogs) (272139) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:31,273::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:31,275::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:02:31,290::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:02:31,292::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:31,294::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:31,295::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:31,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:31,298::__init__::225::IOProcess::(_processLogs) (272140) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:31,300::__init__::225::IOProcess::(_processLogs) (272140) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:31,301::__init__::225::IOProcess::(_processLogs) (272140) Building response >Thread-18::DEBUG::2014-07-08 16:02:31,303::__init__::225::IOProcess::(_processLogs) (272140) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:31,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:31,305::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:31,311::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:02:31,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:31,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:31,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:31,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:31,317::__init__::225::IOProcess::(_processLogs) (272141) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:31,318::__init__::225::IOProcess::(_processLogs) (272141) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:31,319::__init__::225::IOProcess::(_processLogs) (272141) Building response >Thread-18::DEBUG::2014-07-08 16:02:31,320::__init__::225::IOProcess::(_processLogs) (272141) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:31,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:31,322::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:31,329::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:02:31,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:31,331::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:31,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:31,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:31,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:31,336::__init__::225::IOProcess::(_processLogs) (272142) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:31,337::__init__::225::IOProcess::(_processLogs) (272142) Building response >Thread-18::DEBUG::2014-07-08 16:02:31,339::__init__::225::IOProcess::(_processLogs) (272142) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:31,340::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:31,342::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:02:32,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:32,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296438 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:34,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:34,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196291 s, 52.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:36,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:37,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175498 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:02:38,489::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:02:38,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf5ab792-e07c-4c53-9faf-5fbba4420121`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:38,490::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:02:38,505::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:38,506::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf5ab792-e07c-4c53-9faf-5fbba4420121`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:38,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf5ab792-e07c-4c53-9faf-5fbba4420121`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:38,506::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:38,506::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:38,507::task::993::Storage.TaskManager.Task::(_decref) Task=`cf5ab792-e07c-4c53-9faf-5fbba4420121`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:02:38,517::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:02:38,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`1732513e-12f1-42bf-8d80-b204917ff3aa`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:02:38,519::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:02:38,520::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`28274c3a-252a-4bd0-8eab-e3bad4f594f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:02:38,520::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:02:38,520::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:02:38,521::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`28274c3a-252a-4bd0-8eab-e3bad4f594f5`::Granted request >Thread-6940::DEBUG::2014-07-08 16:02:38,521::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1732513e-12f1-42bf-8d80-b204917ff3aa`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:02:38,522::task::993::Storage.TaskManager.Task::(_decref) Task=`1732513e-12f1-42bf-8d80-b204917ff3aa`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:02:38,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:38,541::task::1191::Storage.TaskManager.Task::(prepare) Task=`1732513e-12f1-42bf-8d80-b204917ff3aa`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:38,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`1732513e-12f1-42bf-8d80-b204917ff3aa`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:02:38,541::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:02:38,542::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:02:38,542::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:02:38,542::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:02:38,543::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:02:38,543::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:02:38,543::task::993::Storage.TaskManager.Task::(_decref) Task=`1732513e-12f1-42bf-8d80-b204917ff3aa`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:02:39,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:39,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172836 s, 59.2 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:02:39,813::task::595::Storage.TaskManager.Task::(_updateState) Task=`26620297-b575-4b3e-82bc-3df9b88f05b7`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:39,813::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:02:39,814::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504522', 'lastCheck': '8.5', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:02:39,814::task::1191::Storage.TaskManager.Task::(prepare) Task=`26620297-b575-4b3e-82bc-3df9b88f05b7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504522', 'lastCheck': '8.5', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:02:39,814::task::595::Storage.TaskManager.Task::(_updateState) Task=`26620297-b575-4b3e-82bc-3df9b88f05b7`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:39,815::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:39,815::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:39,815::task::993::Storage.TaskManager.Task::(_decref) Task=`26620297-b575-4b3e-82bc-3df9b88f05b7`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:02:41,347::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:41,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:41,348::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:41,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:41,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:41,348::__init__::225::IOProcess::(_processLogs) (272143) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:41,349::__init__::225::IOProcess::(_processLogs) (272143) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:41,349::__init__::225::IOProcess::(_processLogs) (272143) Building response >Thread-18::DEBUG::2014-07-08 16:02:41,349::__init__::225::IOProcess::(_processLogs) (272143) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:41,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:41,350::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:02:41,351::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:02:41,496::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000528826 s, 874 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:41,501::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:41,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:41,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:41,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:41,503::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:41,503::__init__::225::IOProcess::(_processLogs) (272144) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:41,504::__init__::225::IOProcess::(_processLogs) (272144) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:41,507::__init__::225::IOProcess::(_processLogs) (272144) Building response >Thread-18::DEBUG::2014-07-08 16:02:41,509::__init__::225::IOProcess::(_processLogs) (272144) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:41,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:41,600::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Dummy-6860::DEBUG::2014-07-08 16:02:41,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:02:41,781::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:02:41,784::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:41,788::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:41,792::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:41,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:41,799::__init__::225::IOProcess::(_processLogs) (272145) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:41,802::__init__::225::IOProcess::(_processLogs) (272145) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:41,804::__init__::225::IOProcess::(_processLogs) (272145) Building response >Thread-18::DEBUG::2014-07-08 16:02:41,807::__init__::225::IOProcess::(_processLogs) (272145) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:41,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:41,813::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:41,823::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:02:41,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:41,829::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:41,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:41,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:41,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:41,840::__init__::225::IOProcess::(_processLogs) (272146) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:41,844::__init__::225::IOProcess::(_processLogs) (272146) Building response >Thread-18::DEBUG::2014-07-08 16:02:41,846::__init__::225::IOProcess::(_processLogs) (272146) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:41,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:41,932::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:02:41,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0732371 s, 14.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:41,943::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:02:41,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:41,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:41,952::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:41,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:41,957::__init__::225::IOProcess::(_processLogs) (272147) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:41,960::__init__::225::IOProcess::(_processLogs) (272147) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:41,962::__init__::225::IOProcess::(_processLogs) (272147) Building response >Thread-18::DEBUG::2014-07-08 16:02:41,965::__init__::225::IOProcess::(_processLogs) (272147) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:41,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:41,975::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:02:44,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:44,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172847 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:46,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:46,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171696 s, 59.6 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:02:48,556::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:02:48,557::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd23049f-f89f-4317-92db-46a1b05aef6f`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:48,558::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:02:48,573::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:48,573::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd23049f-f89f-4317-92db-46a1b05aef6f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:48,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd23049f-f89f-4317-92db-46a1b05aef6f`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:48,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:48,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:48,574::task::993::Storage.TaskManager.Task::(_decref) Task=`bd23049f-f89f-4317-92db-46a1b05aef6f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:02:48,585::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:02:48,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`35a002a6-e6d9-4492-98ff-68bff543350e`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:02:48,586::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:02:48,587::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e2c5fbea-ef64-40bd-8622-c16f3f04990d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:02:48,588::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:02:48,588::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:02:48,588::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e2c5fbea-ef64-40bd-8622-c16f3f04990d`::Granted request >Thread-6940::DEBUG::2014-07-08 16:02:48,589::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`35a002a6-e6d9-4492-98ff-68bff543350e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:02:48,589::task::993::Storage.TaskManager.Task::(_decref) Task=`35a002a6-e6d9-4492-98ff-68bff543350e`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:02:48,608::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:48,609::task::1191::Storage.TaskManager.Task::(prepare) Task=`35a002a6-e6d9-4492-98ff-68bff543350e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:48,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`35a002a6-e6d9-4492-98ff-68bff543350e`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:02:48,609::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:02:48,609::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:02:48,610::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:02:48,610::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:02:48,610::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:02:48,611::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:02:48,611::task::993::Storage.TaskManager.Task::(_decref) Task=`35a002a6-e6d9-4492-98ff-68bff543350e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:02:48,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:48,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176658 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:51,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:51,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174872 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:52,042::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:52,047::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:52,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:52,048::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:52,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:52,048::__init__::225::IOProcess::(_processLogs) (272148) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:52,052::__init__::225::IOProcess::(_processLogs) (272148) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:52,055::__init__::225::IOProcess::(_processLogs) (272148) Building response >Thread-18::DEBUG::2014-07-08 16:02:52,055::__init__::225::IOProcess::(_processLogs) (272148) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:52,056::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:52,056::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:02:52,058::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:02:52,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000646155 s, 715 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:02:52,230::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:02:52,236::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:52,242::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:52,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:52,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:52,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:52,260::__init__::225::IOProcess::(_processLogs) (272149) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:02:52,263::__init__::225::IOProcess::(_processLogs) (272149) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:02:52,267::__init__::225::IOProcess::(_processLogs) (272149) Building response >Thread-18::DEBUG::2014-07-08 16:02:52,272::__init__::225::IOProcess::(_processLogs) (272149) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:52,276::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:52,280::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:02:52,304::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:02:52,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:52,307::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:52,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:52,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:52,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:52,313::__init__::225::IOProcess::(_processLogs) (272150) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:52,314::__init__::225::IOProcess::(_processLogs) (272150) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:52,316::__init__::225::IOProcess::(_processLogs) (272150) Building response >Thread-18::DEBUG::2014-07-08 16:02:52,317::__init__::225::IOProcess::(_processLogs) (272150) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:52,319::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:52,320::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:52,324::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:02:52,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:52,328::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:52,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:52,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:52,331::__init__::225::IOProcess::(_processLogs) (272151) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:52,333::__init__::225::IOProcess::(_processLogs) (272151) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:52,334::__init__::225::IOProcess::(_processLogs) (272151) Building response >Thread-18::DEBUG::2014-07-08 16:02:52,336::__init__::225::IOProcess::(_processLogs) (272151) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:52,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:52,338::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:02:52,344::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:02:52,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:02:52,346::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:02:52,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:02:52,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:02:52,351::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:02:52,352::__init__::225::IOProcess::(_processLogs) (272152) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:02:52,354::__init__::225::IOProcess::(_processLogs) (272152) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:02:52,355::__init__::225::IOProcess::(_processLogs) (272152) Building response >Thread-18::DEBUG::2014-07-08 16:02:52,357::__init__::225::IOProcess::(_processLogs) (272152) Queuing response >Thread-18::DEBUG::2014-07-08 16:02:52,358::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:02:52,360::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:02:53,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:53,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173283 s, 59.1 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:02:55,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf6b85f2-bb39-42f6-9dc4-08046eb535af`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:55,060::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:02:55,060::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646155', 'lastCheck': '2.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:02:55,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf6b85f2-bb39-42f6-9dc4-08046eb535af`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646155', 'lastCheck': '2.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:02:55,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf6b85f2-bb39-42f6-9dc4-08046eb535af`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:55,061::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:55,061::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:55,061::task::993::Storage.TaskManager.Task::(_decref) Task=`bf6b85f2-bb39-42f6-9dc4-08046eb535af`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:02:55,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:55,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017518 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:02:57,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:02:58,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175102 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:02:58,624::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:02:58,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`660692b1-3cce-4645-ab36-ef770befd94c`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:02:58,625::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:02:58,640::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:58,641::task::1191::Storage.TaskManager.Task::(prepare) Task=`660692b1-3cce-4645-ab36-ef770befd94c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:02:58,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`660692b1-3cce-4645-ab36-ef770befd94c`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:02:58,641::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:02:58,641::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:02:58,642::task::993::Storage.TaskManager.Task::(_decref) Task=`660692b1-3cce-4645-ab36-ef770befd94c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:02:58,653::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:02:58,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`09952f3d-badf-45e4-af00-021607959663`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:02:58,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:02:58,655::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d36c8c70-b2b9-405d-82dd-d4862def1cdd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:02:58,655::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:02:58,656::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:02:58,656::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d36c8c70-b2b9-405d-82dd-d4862def1cdd`::Granted request >Thread-6940::DEBUG::2014-07-08 16:02:58,657::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`09952f3d-badf-45e4-af00-021607959663`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:02:58,657::task::993::Storage.TaskManager.Task::(_decref) Task=`09952f3d-badf-45e4-af00-021607959663`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:02:58,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:58,676::task::1191::Storage.TaskManager.Task::(prepare) Task=`09952f3d-badf-45e4-af00-021607959663`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:02:58,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`09952f3d-badf-45e4-af00-021607959663`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:02:58,677::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:02:58,677::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:02:58,678::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:02:58,678::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:02:58,678::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:02:58,678::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:02:58,679::task::993::Storage.TaskManager.Task::(_decref) Task=`09952f3d-badf-45e4-af00-021607959663`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:00,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:00,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177739 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:02,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:03:02,592::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:02,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:02,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:02,644::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:02,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:02,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:02,667::__init__::225::IOProcess::(_processLogs) (272153) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:02,676::__init__::225::IOProcess::(_processLogs) (272153) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:02,685::__init__::225::IOProcess::(_processLogs) (272153) Building response >Thread-18::DEBUG::2014-07-08 16:03:02,690::__init__::225::IOProcess::(_processLogs) (272153) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:02,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:02,704::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:03:02,739::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:03:02,900::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000415405 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:02,918::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:02,921::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:02,925::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:02,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:02,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:02,937::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:02,940::__init__::225::IOProcess::(_processLogs) (272154) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:02,944::__init__::225::IOProcess::(_processLogs) (272154) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:03,026::__init__::225::IOProcess::(_processLogs) (272154) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:03:03,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.443331 s, 2.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:03,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:03,031::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:03:03,046::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:03:03,048::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:03,050::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:03,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:03,055::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:03,057::__init__::225::IOProcess::(_processLogs) (272155) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:03,060::__init__::225::IOProcess::(_processLogs) (272155) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:03,063::__init__::225::IOProcess::(_processLogs) (272155) Building response >Thread-18::DEBUG::2014-07-08 16:03:03,065::__init__::225::IOProcess::(_processLogs) (272155) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:03,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:03,070::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:03,080::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:03:03,082::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:03,084::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:03,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:03,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:03,090::__init__::225::IOProcess::(_processLogs) (272156) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:03,092::__init__::225::IOProcess::(_processLogs) (272156) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:03,096::__init__::225::IOProcess::(_processLogs) (272156) Building response >Thread-18::DEBUG::2014-07-08 16:03:03,098::__init__::225::IOProcess::(_processLogs) (272156) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:03,100::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:03,102::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:03,110::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:03:03,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:03,114::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:03,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:03,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:03,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:03,123::__init__::225::IOProcess::(_processLogs) (272157) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:03,125::__init__::225::IOProcess::(_processLogs) (272157) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:03,127::__init__::225::IOProcess::(_processLogs) (272157) Building response >Thread-18::DEBUG::2014-07-08 16:03:03,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:03,132::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:03:05,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:05,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173448 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:07,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:07,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.088435 s, 11.6 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:03:08,692::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:03:08,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`e81086e6-68da-4e69-a8aa-63deb171c418`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:08,694::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:03:08,709::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:08,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`e81086e6-68da-4e69-a8aa-63deb171c418`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:08,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`e81086e6-68da-4e69-a8aa-63deb171c418`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:08,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:08,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:08,710::task::993::Storage.TaskManager.Task::(_decref) Task=`e81086e6-68da-4e69-a8aa-63deb171c418`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:03:08,721::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:03:08,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`d888ef5a-cc47-44ca-adff-506bfaa408ef`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:03:08,723::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:03:08,730::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`43211c79-e152-4209-9f34-990d259197b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:03:08,730::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:03:08,731::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:03:08,731::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`43211c79-e152-4209-9f34-990d259197b5`::Granted request >Thread-6940::DEBUG::2014-07-08 16:03:08,732::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d888ef5a-cc47-44ca-adff-506bfaa408ef`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:03:08,732::task::993::Storage.TaskManager.Task::(_decref) Task=`d888ef5a-cc47-44ca-adff-506bfaa408ef`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:03:08,751::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:08,751::task::1191::Storage.TaskManager.Task::(prepare) Task=`d888ef5a-cc47-44ca-adff-506bfaa408ef`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:08,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`d888ef5a-cc47-44ca-adff-506bfaa408ef`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:03:08,752::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:03:08,752::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:03:08,753::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:03:08,753::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:03:08,753::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:03:08,753::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:03:08,754::task::993::Storage.TaskManager.Task::(_decref) Task=`d888ef5a-cc47-44ca-adff-506bfaa408ef`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:09,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:10,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173945 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:03:10,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`18f948df-63c5-4820-b99e-fec2d352ac67`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:10,219::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:03:10,220::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415405', 'lastCheck': '7.1', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:03:10,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`18f948df-63c5-4820-b99e-fec2d352ac67`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415405', 'lastCheck': '7.1', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:03:10,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`18f948df-63c5-4820-b99e-fec2d352ac67`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:10,220::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:10,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:10,221::task::993::Storage.TaskManager.Task::(_decref) Task=`18f948df-63c5-4820-b99e-fec2d352ac67`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:12,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:12,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172481 s, 59.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:13,141::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:13,141::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:13,142::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:13,142::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:13,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:13,142::__init__::225::IOProcess::(_processLogs) (272158) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:13,143::__init__::225::IOProcess::(_processLogs) (272158) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:13,143::__init__::225::IOProcess::(_processLogs) (272158) Building response >Thread-18::DEBUG::2014-07-08 16:03:13,143::__init__::225::IOProcess::(_processLogs) (272158) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:13,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:13,143::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:03:13,145::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:03:13,290::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000458706 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:13,292::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:13,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:13,293::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:13,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:13,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:13,294::__init__::225::IOProcess::(_processLogs) (272159) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:13,294::__init__::225::IOProcess::(_processLogs) (272159) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:13,294::__init__::225::IOProcess::(_processLogs) (272159) Building response >Thread-18::DEBUG::2014-07-08 16:03:13,295::__init__::225::IOProcess::(_processLogs) (272159) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:13,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:13,295::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:03:13,297::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:03:13,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:13,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:13,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:13,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:13,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:13,299::__init__::225::IOProcess::(_processLogs) (272160) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:13,299::__init__::225::IOProcess::(_processLogs) (272160) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:13,299::__init__::225::IOProcess::(_processLogs) (272160) Building response >Thread-18::DEBUG::2014-07-08 16:03:13,300::__init__::225::IOProcess::(_processLogs) (272160) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:13,300::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:13,300::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:13,301::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:13,301::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:03:13,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:13,302::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:13,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:13,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:13,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:13,303::__init__::225::IOProcess::(_processLogs) (272161) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:13,303::__init__::225::IOProcess::(_processLogs) (272161) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:13,303::__init__::225::IOProcess::(_processLogs) (272161) Building response >Thread-18::DEBUG::2014-07-08 16:03:13,304::__init__::225::IOProcess::(_processLogs) (272161) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:13,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:13,304::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:13,305::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:13,305::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:03:13,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:13,306::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:13,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:13,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:13,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:13,307::__init__::225::IOProcess::(_processLogs) (272162) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:13,307::__init__::225::IOProcess::(_processLogs) (272162) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:13,307::__init__::225::IOProcess::(_processLogs) (272162) Building response >Thread-18::DEBUG::2014-07-08 16:03:13,308::__init__::225::IOProcess::(_processLogs) (272162) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:13,308::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:13,308::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:03:14,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:14,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0199355 s, 51.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:16,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:16,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175473 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:03:18,767::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:03:18,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`21b64c27-b0c2-4a52-81be-810e836f2aed`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:18,769::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:03:18,784::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:18,784::task::1191::Storage.TaskManager.Task::(prepare) Task=`21b64c27-b0c2-4a52-81be-810e836f2aed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:18,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`21b64c27-b0c2-4a52-81be-810e836f2aed`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:18,785::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:18,785::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:18,785::task::993::Storage.TaskManager.Task::(_decref) Task=`21b64c27-b0c2-4a52-81be-810e836f2aed`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:03:18,796::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:03:18,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b501230-992a-46b0-94de-4dda50994a6b`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:03:18,797::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:03:18,798::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`61056d43-4284-4318-912a-463f7bb09b4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:03:18,799::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:03:18,799::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:03:18,799::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`61056d43-4284-4318-912a-463f7bb09b4e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:03:18,800::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4b501230-992a-46b0-94de-4dda50994a6b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:03:18,800::task::993::Storage.TaskManager.Task::(_decref) Task=`4b501230-992a-46b0-94de-4dda50994a6b`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:03:18,820::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:18,820::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b501230-992a-46b0-94de-4dda50994a6b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:18,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b501230-992a-46b0-94de-4dda50994a6b`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:03:18,821::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:03:18,821::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:03:18,821::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:03:18,822::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:03:18,822::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:03:18,822::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:03:18,823::task::993::Storage.TaskManager.Task::(_decref) Task=`4b501230-992a-46b0-94de-4dda50994a6b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:18,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:19,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034132 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:21,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:21,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177753 s, 57.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:23,320::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:23,324::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:23,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:23,325::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:23,325::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:23,328::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:23,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:23,329::__init__::225::IOProcess::(_processLogs) (272163) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:23,329::__init__::225::IOProcess::(_processLogs) (272163) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:23,329::__init__::225::IOProcess::(_processLogs) (272163) Building response >Thread-18::DEBUG::2014-07-08 16:03:23,330::__init__::225::IOProcess::(_processLogs) (272163) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:23,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:23,330::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:03:23,332::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:03:23,482::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000454516 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:23,488::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:23,490::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:23,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:23,493::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:23,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:23,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:23,497::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:23,499::__init__::225::IOProcess::(_processLogs) (272164) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:23,501::__init__::225::IOProcess::(_processLogs) (272164) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:23,503::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272164) Building response >Thread-18::DEBUG::2014-07-08 16:03:23,504::__init__::225::IOProcess::(_processLogs) (272164) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:23,506::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:23,508::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:03:23,517::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:23,522::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:03:23,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:23,525::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:23,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:23,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:23,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:23,531::__init__::225::IOProcess::(_processLogs) (272165) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:23,533::__init__::225::IOProcess::(_processLogs) (272165) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:23,534::__init__::225::IOProcess::(_processLogs) (272165) Building response >Thread-18::DEBUG::2014-07-08 16:03:23,536::__init__::225::IOProcess::(_processLogs) (272165) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:23,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:23,538::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:23,544::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:23,546::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:03:23,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:23,549::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-6860::DEBUG::2014-07-08 16:03:23,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:03:23,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:23,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:23,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:23,727::__init__::225::IOProcess::(_processLogs) (272166) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:23,730::__init__::225::IOProcess::(_processLogs) (272166) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:23,734::__init__::225::IOProcess::(_processLogs) DEBUG|(272166) Building response >Thread-18::DEBUG::2014-07-08 16:03:23,736::__init__::225::IOProcess::(_processLogs) (272166) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:23,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:23,742::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:23,752::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:23,755::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:03:23,759::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:23,762::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:23,764::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:23,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:23,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:23,773::__init__::225::IOProcess::(_processLogs) (272167) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:23,776::__init__::225::IOProcess::(_processLogs) (272167) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:23,780::__init__::225::IOProcess::(_processLogs) (272167) Building response >Thread-18::DEBUG::2014-07-08 16:03:23,783::__init__::225::IOProcess::(_processLogs) DEBUG|(272167) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:23,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:23,791::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:03:23,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.086694 s, 11.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:03:25,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`78ed6f7d-5b9c-475e-b1cb-cc9a8ef1f3cf`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:25,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:03:25,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454516', 'lastCheck': '1.5', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:03:25,369::task::1191::Storage.TaskManager.Task::(prepare) Task=`78ed6f7d-5b9c-475e-b1cb-cc9a8ef1f3cf`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454516', 'lastCheck': '1.5', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:03:25,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`78ed6f7d-5b9c-475e-b1cb-cc9a8ef1f3cf`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:25,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:25,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:25,370::task::993::Storage.TaskManager.Task::(_decref) Task=`78ed6f7d-5b9c-475e-b1cb-cc9a8ef1f3cf`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:26,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:26,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175118 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:28,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:28,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0986799 s, 10.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:03:28,837::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:03:28,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`f161dbff-db09-44a7-ab0c-9e1b822ede65`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:28,838::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:03:28,854::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:28,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`f161dbff-db09-44a7-ab0c-9e1b822ede65`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:28,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`f161dbff-db09-44a7-ab0c-9e1b822ede65`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:28,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:28,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:28,856::task::993::Storage.TaskManager.Task::(_decref) Task=`f161dbff-db09-44a7-ab0c-9e1b822ede65`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:03:28,868::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:03:28,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa8d73c9-589a-4c40-8577-8a6f8e944acb`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:03:28,869::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:03:28,870::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e307379d-972d-4d34-85b6-41aa35687f3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:03:28,870::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:03:28,871::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:03:28,871::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e307379d-972d-4d34-85b6-41aa35687f3e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:03:28,872::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`aa8d73c9-589a-4c40-8577-8a6f8e944acb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:03:28,872::task::993::Storage.TaskManager.Task::(_decref) Task=`aa8d73c9-589a-4c40-8577-8a6f8e944acb`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:03:28,891::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:28,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa8d73c9-589a-4c40-8577-8a6f8e944acb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:28,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa8d73c9-589a-4c40-8577-8a6f8e944acb`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:03:28,892::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:03:28,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:03:28,893::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:03:28,893::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:03:28,894::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:03:28,894::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:03:28,894::task::993::Storage.TaskManager.Task::(_decref) Task=`aa8d73c9-589a-4c40-8577-8a6f8e944acb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:30,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:30,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178697 s, 57.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:32,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:33,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180144 s, 56.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:33,885::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:33,886::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:33,888::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:33,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:33,903::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:33,904::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:33,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:33,907::__init__::225::IOProcess::(_processLogs) (272168) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:33,908::__init__::225::IOProcess::(_processLogs) (272168) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:33,909::__init__::225::IOProcess::(_processLogs) (272168) Building response >Thread-18::DEBUG::2014-07-08 16:03:33,911::__init__::225::IOProcess::(_processLogs) (272168) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:33,912::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:33,914::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:03:33,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:03:34,078::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000565979 s, 816 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:34,087::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:34,089::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:34,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:34,092::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:34,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:34,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:34,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:34,099::__init__::225::IOProcess::(_processLogs) (272169) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:34,100::__init__::225::IOProcess::(_processLogs) (272169) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:34,102::__init__::225::IOProcess::(_processLogs) (272169) Building response >Thread-18::DEBUG::2014-07-08 16:03:34,104::__init__::225::IOProcess::(_processLogs) (272169) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:34,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:34,107::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:03:34,120::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:34,121::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:03:34,123::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:34,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:34,129::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:34,132::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:34,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:34,137::__init__::225::IOProcess::(_processLogs) (272170) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:34,139::__init__::225::IOProcess::(_processLogs) (272170) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:34,142::__init__::225::IOProcess::(_processLogs) (272170) Building response >Thread-18::DEBUG::2014-07-08 16:03:34,145::__init__::225::IOProcess::(_processLogs) (272170) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:34,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:34,151::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:34,160::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:34,163::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:03:34,166::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:34,169::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:34,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:34,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:34,176::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:34,179::__init__::225::IOProcess::(_processLogs) (272171) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:34,182::__init__::225::IOProcess::(_processLogs) (272171) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:34,185::__init__::225::IOProcess::(_processLogs) (272171) Building response >Thread-18::DEBUG::2014-07-08 16:03:34,187::__init__::225::IOProcess::(_processLogs) (272171) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:34,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:34,197::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:34,206::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:03:34,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:34,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:34,214::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:34,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:34,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:34,222::__init__::225::IOProcess::(_processLogs) (272172) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:34,224::__init__::225::IOProcess::(_processLogs) (272172) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:34,227::__init__::225::IOProcess::(_processLogs) (272172) Building response >Thread-18::DEBUG::2014-07-08 16:03:34,230::__init__::225::IOProcess::(_processLogs) (272172) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:34,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:34,236::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:03:35,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:35,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342714 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:37,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:37,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175188 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:03:38,925::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:03:38,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`acb03366-884c-4909-b976-8c3d30162d7e`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:38,928::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:03:38,944::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:38,945::task::1191::Storage.TaskManager.Task::(prepare) Task=`acb03366-884c-4909-b976-8c3d30162d7e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:38,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`acb03366-884c-4909-b976-8c3d30162d7e`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:38,945::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:38,948::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:38,949::task::993::Storage.TaskManager.Task::(_decref) Task=`acb03366-884c-4909-b976-8c3d30162d7e`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:03:38,961::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:03:38,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`500ab407-2d1b-423d-b642-6dcfc2df3005`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:03:38,962::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:03:38,963::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`83447723-567b-4cbd-869d-ed4c5560bcec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:03:38,964::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:03:38,964::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:03:38,964::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`83447723-567b-4cbd-869d-ed4c5560bcec`::Granted request >Thread-6940::DEBUG::2014-07-08 16:03:38,965::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`500ab407-2d1b-423d-b642-6dcfc2df3005`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:03:38,966::task::993::Storage.TaskManager.Task::(_decref) Task=`500ab407-2d1b-423d-b642-6dcfc2df3005`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:03:38,986::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:38,986::task::1191::Storage.TaskManager.Task::(prepare) Task=`500ab407-2d1b-423d-b642-6dcfc2df3005`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:38,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`500ab407-2d1b-423d-b642-6dcfc2df3005`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:03:38,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:03:38,987::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:03:38,988::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:03:38,988::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:03:38,988::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:03:38,988::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:03:38,989::task::993::Storage.TaskManager.Task::(_decref) Task=`500ab407-2d1b-423d-b642-6dcfc2df3005`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:39,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:40,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174674 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:03:40,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`48f7df3f-4b30-4295-b484-489eb6fa5ff4`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:40,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:03:40,685::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565979', 'lastCheck': '6.4', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:03:40,685::task::1191::Storage.TaskManager.Task::(prepare) Task=`48f7df3f-4b30-4295-b484-489eb6fa5ff4`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565979', 'lastCheck': '6.4', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:03:40,685::task::595::Storage.TaskManager.Task::(_updateState) Task=`48f7df3f-4b30-4295-b484-489eb6fa5ff4`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:40,685::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:40,686::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:40,686::task::993::Storage.TaskManager.Task::(_decref) Task=`48f7df3f-4b30-4295-b484-489eb6fa5ff4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:42,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:42,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174414 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:44,247::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:44,248::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:44,248::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:44,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:44,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:44,249::__init__::225::IOProcess::(_processLogs) (272173) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:44,249::__init__::225::IOProcess::(_processLogs) (272173) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:44,250::__init__::225::IOProcess::(_processLogs) (272173) Building response >Thread-18::DEBUG::2014-07-08 16:03:44,250::__init__::225::IOProcess::(_processLogs) (272173) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:44,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:44,250::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:03:44,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:44,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:03:44,549::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000629394 s, 734 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:44,554::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:44,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:44,557::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:44,558::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:44,559::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:44,559::__init__::225::IOProcess::(_processLogs) (272174) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:44,560::__init__::225::IOProcess::(_processLogs) (272174) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:44,563::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:44,567::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:03:44,585::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:03:44,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:44,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:44,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:44,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:44,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:44,604::__init__::225::IOProcess::(_processLogs) (272175) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:44,607::__init__::225::IOProcess::(_processLogs) (272175) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:44,611::__init__::225::IOProcess::(_processLogs) (272175) Building response >Thread-18::DEBUG::2014-07-08 16:03:44,614::__init__::225::IOProcess::(_processLogs) (272175) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:44,617::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:44,633::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:03:44,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Dummy-6860::DEBUG::2014-07-08 16:03:44,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0813828 s, 12.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:44,730::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:44,734::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:44,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:44,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:44,742::__init__::225::IOProcess::(_processLogs) (272176) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:44,744::__init__::225::IOProcess::(_processLogs) (272176) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:44,747::__init__::225::IOProcess::(_processLogs) (272176) Building response >Thread-18::DEBUG::2014-07-08 16:03:44,749::__init__::225::IOProcess::(_processLogs) (272176) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:44,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:44,754::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:44,763::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:44,768::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:03:44,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:44,772::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:44,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:44,778::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:44,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:44,782::__init__::225::IOProcess::(_processLogs) (272177) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:44,784::__init__::225::IOProcess::(_processLogs) (272177) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:44,785::__init__::225::IOProcess::(_processLogs) (272177) Building response >Thread-18::DEBUG::2014-07-08 16:03:44,788::__init__::225::IOProcess::(_processLogs) (272177) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:44,791::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:44,793::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:03:46,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:47,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174783 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:03:49,002::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:03:49,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f2d541a-d19d-47ef-8d21-3512e7ade1cc`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:49,003::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:03:49,018::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:49,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f2d541a-d19d-47ef-8d21-3512e7ade1cc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:49,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f2d541a-d19d-47ef-8d21-3512e7ade1cc`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:49,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:49,019::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:49,020::task::993::Storage.TaskManager.Task::(_decref) Task=`2f2d541a-d19d-47ef-8d21-3512e7ade1cc`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:03:49,030::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:03:49,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e7ed838-ef12-44db-8890-e55aa82230b7`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:03:49,032::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:03:49,033::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`31beaab1-a410-4ac0-9cf9-55c5c4c3bc32`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:03:49,033::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:03:49,033::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:03:49,034::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`31beaab1-a410-4ac0-9cf9-55c5c4c3bc32`::Granted request >Thread-6940::DEBUG::2014-07-08 16:03:49,034::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3e7ed838-ef12-44db-8890-e55aa82230b7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:03:49,034::task::993::Storage.TaskManager.Task::(_decref) Task=`3e7ed838-ef12-44db-8890-e55aa82230b7`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:03:49,054::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:49,054::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e7ed838-ef12-44db-8890-e55aa82230b7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:49,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e7ed838-ef12-44db-8890-e55aa82230b7`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:03:49,055::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:03:49,055::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:03:49,055::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:03:49,056::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:03:49,056::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:03:49,056::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:03:49,057::task::993::Storage.TaskManager.Task::(_decref) Task=`3e7ed838-ef12-44db-8890-e55aa82230b7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:49,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:49,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017411 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:51,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:51,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174107 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:53,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:54,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0183058 s, 55.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:54,801::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:54,802::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:54,802::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:54,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:54,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:54,802::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:54,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:54,803::__init__::225::IOProcess::(_processLogs) (272178) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:54,803::__init__::225::IOProcess::(_processLogs) (272178) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:54,803::__init__::225::IOProcess::(_processLogs) (272178) Building response >Thread-18::DEBUG::2014-07-08 16:03:54,804::__init__::225::IOProcess::(_processLogs) (272178) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:54,804::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:54,804::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:03:54,806::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:03:54,954::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000470159 s, 983 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:03:54,956::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:03:54,957::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:03:54,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:54,957::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:54,958::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:54,958::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:54,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:54,959::__init__::225::IOProcess::(_processLogs) (272179) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:03:54,959::__init__::225::IOProcess::(_processLogs) (272179) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:03:54,959::__init__::225::IOProcess::(_processLogs) (272179) Building response >Thread-18::DEBUG::2014-07-08 16:03:54,959::__init__::225::IOProcess::(_processLogs) (272179) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:54,960::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:54,960::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:03:54,962::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:03:54,963::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:03:54,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:54,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:54,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:54,964::__init__::225::IOProcess::(_processLogs) (272180) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:54,964::__init__::225::IOProcess::(_processLogs) (272180) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:54,964::__init__::225::IOProcess::(_processLogs) (272180) Building response >Thread-18::DEBUG::2014-07-08 16:03:54,964::__init__::225::IOProcess::(_processLogs) (272180) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:54,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:54,965::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:54,966::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:03:54,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:54,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:54,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:54,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:54,967::__init__::225::IOProcess::(_processLogs) (272181) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:54,967::__init__::225::IOProcess::(_processLogs) (272181) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:54,968::__init__::225::IOProcess::(_processLogs) (272181) Building response >Thread-18::DEBUG::2014-07-08 16:03:54,968::__init__::225::IOProcess::(_processLogs) (272181) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:54,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:54,968::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:03:54,970::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:03:54,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:03:54,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:03:54,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:03:54,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:03:54,971::__init__::225::IOProcess::(_processLogs) (272182) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:03:54,971::__init__::225::IOProcess::(_processLogs) (272182) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:03:54,971::__init__::225::IOProcess::(_processLogs) (272182) Building response >Thread-18::DEBUG::2014-07-08 16:03:54,972::__init__::225::IOProcess::(_processLogs) (272182) Queuing response >Thread-18::DEBUG::2014-07-08 16:03:54,972::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:03:54,972::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6939::DEBUG::2014-07-08 16:03:55,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`826d66d4-67fa-4327-a114-cb3b0c3b50a1`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:55,847::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:03:55,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470159', 'lastCheck': '0.9', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:03:55,848::task::1191::Storage.TaskManager.Task::(prepare) Task=`826d66d4-67fa-4327-a114-cb3b0c3b50a1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470159', 'lastCheck': '0.9', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:03:55,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`826d66d4-67fa-4327-a114-cb3b0c3b50a1`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:55,848::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:55,849::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:55,849::task::993::Storage.TaskManager.Task::(_decref) Task=`826d66d4-67fa-4327-a114-cb3b0c3b50a1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:03:56,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:56,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017561 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:03:58,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:03:58,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177133 s, 57.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:03:59,070::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:03:59,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc97bfdb-a450-4a2b-8487-8ffbfa276690`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:03:59,072::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:03:59,087::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:59,088::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc97bfdb-a450-4a2b-8487-8ffbfa276690`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:03:59,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc97bfdb-a450-4a2b-8487-8ffbfa276690`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:03:59,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:03:59,088::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:03:59,089::task::993::Storage.TaskManager.Task::(_decref) Task=`bc97bfdb-a450-4a2b-8487-8ffbfa276690`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:03:59,101::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:03:59,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b926389-e817-4545-9cfc-d61c73cd96f6`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:03:59,102::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:03:59,103::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`dac6121c-1367-4a1b-ac93-e504c589b896`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:03:59,103::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:03:59,104::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:03:59,104::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`dac6121c-1367-4a1b-ac93-e504c589b896`::Granted request >Thread-6940::DEBUG::2014-07-08 16:03:59,105::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6b926389-e817-4545-9cfc-d61c73cd96f6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:03:59,105::task::993::Storage.TaskManager.Task::(_decref) Task=`6b926389-e817-4545-9cfc-d61c73cd96f6`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:03:59,124::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:59,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b926389-e817-4545-9cfc-d61c73cd96f6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:03:59,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b926389-e817-4545-9cfc-d61c73cd96f6`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:03:59,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:03:59,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:03:59,125::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:03:59,126::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:03:59,126::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:03:59,126::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:03:59,126::task::993::Storage.TaskManager.Task::(_decref) Task=`6b926389-e817-4545-9cfc-d61c73cd96f6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:04:00,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:00,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176842 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:02,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:03,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178647 s, 57.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:04,975::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:04,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:04,976::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:04,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:04,977::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:04,977::__init__::225::IOProcess::(_processLogs) (272183) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:04,977::__init__::225::IOProcess::(_processLogs) (272183) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:04,977::__init__::225::IOProcess::(_processLogs) (272183) Building response >Thread-18::DEBUG::2014-07-08 16:04:04,978::__init__::225::IOProcess::(_processLogs) (272183) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:04,978::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:04,978::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:04:04,983::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:04:05,137::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000644199 s, 717 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:05,143::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:05,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:05,147::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:05,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:05,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:05,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:05,153::__init__::225::IOProcess::(_processLogs) (272184) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:05,154::__init__::225::IOProcess::(_processLogs) (272184) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:05,155::__init__::225::IOProcess::(_processLogs) (272184) Building response >Thread-18::DEBUG::2014-07-08 16:04:05,156::__init__::225::IOProcess::(_processLogs) (272184) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:05,158::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:05,160::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:04:05,174::__init__::225::IOProcess::(_processLogs) (272184) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:05,175::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:04:05,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:05,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:05,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:05,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:05,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:05,185::__init__::225::IOProcess::(_processLogs) (272185) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:05,187::__init__::225::IOProcess::(_processLogs) (272185) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:05,188::__init__::225::IOProcess::(_processLogs) (272185) Building response >Thread-18::DEBUG::2014-07-08 16:04:05,189::__init__::225::IOProcess::(_processLogs) (272185) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:05,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:05,193::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:05,197::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:05,199::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:04:05,201::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:05,202::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:05,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:05,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:05,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:05,208::__init__::225::IOProcess::(_processLogs) (272186) Finding callback 'access'... >Dummy-6860::DEBUG::2014-07-08 16:04:05,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:04:05,213::__init__::225::IOProcess::(_processLogs) (272186) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:05,369::__init__::225::IOProcess::(_processLogs) (272186) Building response >Thread-18::DEBUG::2014-07-08 16:04:05,371::__init__::225::IOProcess::(_processLogs) (272186) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:05,372::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:05,374::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:05,385::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:05,390::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:04:05,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:05,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:05,399::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:05,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:05,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:05,407::__init__::225::IOProcess::(_processLogs) (272187) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:05,410::__init__::225::IOProcess::(_processLogs) (272187) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:05,413::__init__::225::IOProcess::(_processLogs) (272187) Building response >Thread-18::DEBUG::2014-07-08 16:04:05,416::__init__::225::IOProcess::(_processLogs) (272187) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:05,419::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:05,422::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:04:05,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0668333 s, 15.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:07,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:07,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176373 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:09,140::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:04:09,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffb2f786-b798-4e74-a99b-1d00a47df784`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:09,142::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:04:09,157::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:09,157::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffb2f786-b798-4e74-a99b-1d00a47df784`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:09,157::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffb2f786-b798-4e74-a99b-1d00a47df784`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:09,158::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:04:09,158::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:09,158::task::993::Storage.TaskManager.Task::(_decref) Task=`ffb2f786-b798-4e74-a99b-1d00a47df784`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:04:09,170::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:04:09,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`d38164c6-97be-4772-b33b-0fa14f06f20c`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:04:09,171::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:04:09,172::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7126515f-09a7-4758-ab4d-1c9707392235`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:04:09,173::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:04:09,173::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:04:09,173::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7126515f-09a7-4758-ab4d-1c9707392235`::Granted request >Thread-6940::DEBUG::2014-07-08 16:04:09,174::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d38164c6-97be-4772-b33b-0fa14f06f20c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:04:09,174::task::993::Storage.TaskManager.Task::(_decref) Task=`d38164c6-97be-4772-b33b-0fa14f06f20c`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:04:09,193::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:09,194::task::1191::Storage.TaskManager.Task::(prepare) Task=`d38164c6-97be-4772-b33b-0fa14f06f20c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:09,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`d38164c6-97be-4772-b33b-0fa14f06f20c`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:04:09,194::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:04:09,195::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:04:09,195::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:04:09,195::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:04:09,196::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:04:09,196::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:04:09,196::task::993::Storage.TaskManager.Task::(_decref) Task=`d38164c6-97be-4772-b33b-0fa14f06f20c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:04:10,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:10,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367331 s, 27.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:11,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6ba03da-bb4a-44c6-9dd7-8455d0e0a18e`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:11,158::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:04:11,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644199', 'lastCheck': '5.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:04:11,159::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6ba03da-bb4a-44c6-9dd7-8455d0e0a18e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644199', 'lastCheck': '5.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:04:11,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6ba03da-bb4a-44c6-9dd7-8455d0e0a18e`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:11,160::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:04:11,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:11,160::task::993::Storage.TaskManager.Task::(_decref) Task=`b6ba03da-bb4a-44c6-9dd7-8455d0e0a18e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:04:12,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:12,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175445 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:14,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:14,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0202116 s, 50.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:15,430::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:15,431::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:15,431::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:15,431::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:15,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:15,432::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:15,432::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:15,432::__init__::225::IOProcess::(_processLogs) (272188) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:15,433::__init__::225::IOProcess::(_processLogs) (272188) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:15,433::__init__::225::IOProcess::(_processLogs) (272188) Building response >Thread-18::DEBUG::2014-07-08 16:04:15,433::__init__::225::IOProcess::(_processLogs) (272188) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:15,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:15,434::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:04:15,435::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:04:15,580::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000477703 s, 967 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:15,582::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:15,583::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:15,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:15,583::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:15,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:15,584::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:15,584::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:15,584::__init__::225::IOProcess::(_processLogs) DEBUG|(272189) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:15,585::__init__::225::IOProcess::(_processLogs) (272189) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:15,585::__init__::225::IOProcess::(_processLogs) (272189) Building response >Thread-18::DEBUG::2014-07-08 16:04:15,585::__init__::225::IOProcess::(_processLogs) (272189) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:15,585::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:15,586::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:04:15,588::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:15,588::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:04:15,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:15,589::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:15,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:15,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:15,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:15,590::__init__::225::IOProcess::(_processLogs) (272190) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:15,590::__init__::225::IOProcess::(_processLogs) (272190) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:15,590::__init__::225::IOProcess::(_processLogs) (272190) Building response >Thread-18::DEBUG::2014-07-08 16:04:15,590::__init__::225::IOProcess::(_processLogs) (272190) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:15,591::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:15,591::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:15,592::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:04:15,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:15,593::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:15,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:15,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:15,593::__init__::225::IOProcess::(_processLogs) (272191) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:15,594::__init__::225::IOProcess::(_processLogs) (272191) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:15,594::__init__::225::IOProcess::(_processLogs) (272191) Building response >Thread-18::DEBUG::2014-07-08 16:04:15,594::__init__::225::IOProcess::(_processLogs) (272191) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:15,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:15,594::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:15,596::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:04:15,596::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:15,596::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:15,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:15,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:15,597::__init__::225::IOProcess::(_processLogs) (272192) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:15,597::__init__::225::IOProcess::(_processLogs) (272192) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:15,597::__init__::225::IOProcess::(_processLogs) (272192) Building response >Thread-18::DEBUG::2014-07-08 16:04:15,598::__init__::225::IOProcess::(_processLogs) (272192) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:15,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:15,598::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:04:16,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:17,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175428 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:19,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:04:19,282::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:04:19,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`38da9f58-451e-435f-bd40-32fb7ed33a79`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:19,294::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:04:19,312::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:19,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`38da9f58-451e-435f-bd40-32fb7ed33a79`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:19,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`38da9f58-451e-435f-bd40-32fb7ed33a79`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:19,397::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Dummy-6860::DEBUG::2014-07-08 16:04:19,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297418 s, 34.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:19,399::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:19,400::task::993::Storage.TaskManager.Task::(_decref) Task=`38da9f58-451e-435f-bd40-32fb7ed33a79`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:04:19,414::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:04:19,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbdb1770-382d-4b01-a321-b40ad19e511d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:04:19,417::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:04:19,420::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ee3509e9-f97c-4c1c-ac30-ce37dad9851a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:04:19,421::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:04:19,423::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:04:19,423::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ee3509e9-f97c-4c1c-ac30-ce37dad9851a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:04:19,426::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cbdb1770-382d-4b01-a321-b40ad19e511d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:04:19,427::task::993::Storage.TaskManager.Task::(_decref) Task=`cbdb1770-382d-4b01-a321-b40ad19e511d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:04:19,459::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:19,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbdb1770-382d-4b01-a321-b40ad19e511d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:19,462::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbdb1770-382d-4b01-a321-b40ad19e511d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:04:19,462::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:04:19,463::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:04:19,464::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:04:19,465::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:04:19,466::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:04:19,466::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:04:19,468::task::993::Storage.TaskManager.Task::(_decref) Task=`cbdb1770-382d-4b01-a321-b40ad19e511d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:04:21,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:21,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176004 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:23,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:23,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193422 s, 52.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:25,618::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:25,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:25,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:25,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:25,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:25,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:25,621::__init__::225::IOProcess::(_processLogs) (272193) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:25,621::__init__::225::IOProcess::(_processLogs) (272193) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:25,621::__init__::225::IOProcess::(_processLogs) (272193) Building response >Thread-18::DEBUG::2014-07-08 16:04:25,622::__init__::225::IOProcess::(_processLogs) (272193) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:25,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:25,623::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:04:25,625::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:04:25,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00136885 s, 338 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:25,780::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:25,782::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:25,784::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:25,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:25,787::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:25,788::__init__::225::IOProcess::(_processLogs) (272194) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:25,790::__init__::225::IOProcess::(_processLogs) (272194) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:25,791::__init__::225::IOProcess::(_processLogs) (272194) Building response >Thread-18::DEBUG::2014-07-08 16:04:25,793::__init__::225::IOProcess::(_processLogs) (272194) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:25,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:25,795::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:04:25,802::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:04:25,803::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:25,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:25,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:25,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:25,805::__init__::225::IOProcess::(_processLogs) (272195) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:25,805::__init__::225::IOProcess::(_processLogs) (272195) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:25,806::__init__::225::IOProcess::(_processLogs) (272195) Building response >Thread-18::DEBUG::2014-07-08 16:04:25,806::__init__::225::IOProcess::(_processLogs) (272195) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:25,806::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:25,807::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:25,812::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:04:25,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:25,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:25,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:25,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:25,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:25,820::__init__::225::IOProcess::(_processLogs) (272196) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:25,821::__init__::225::IOProcess::(_processLogs) (272196) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:25,822::__init__::225::IOProcess::(_processLogs) (272196) Building response >Thread-18::DEBUG::2014-07-08 16:04:25,824::__init__::225::IOProcess::(_processLogs) (272196) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:25,825::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:25,827::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:25,831::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:04:25,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:25,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:25,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:25,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:25,839::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:25,840::__init__::225::IOProcess::(_processLogs) (272197) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:25,841::__init__::225::IOProcess::(_processLogs) (272197) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:25,843::__init__::225::IOProcess::(_processLogs) (272197) Building response >Thread-18::DEBUG::2014-07-08 16:04:25,844::__init__::225::IOProcess::(_processLogs) (272197) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:25,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:25,847::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:04:26,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:26,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176401 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:26,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`86195baa-5b01-4c90-9ffa-b4e8ce829b17`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:26,308::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:04:26,308::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136885', 'lastCheck': '0.5', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:04:26,308::task::1191::Storage.TaskManager.Task::(prepare) Task=`86195baa-5b01-4c90-9ffa-b4e8ce829b17`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136885', 'lastCheck': '0.5', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:04:26,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`86195baa-5b01-4c90-9ffa-b4e8ce829b17`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:26,309::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:04:26,309::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:26,309::task::993::Storage.TaskManager.Task::(_decref) Task=`86195baa-5b01-4c90-9ffa-b4e8ce829b17`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:04:28,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:28,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177381 s, 57.7 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:29,481::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:04:29,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a6d1835-d79f-42e4-8be2-042431c853c5`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:29,483::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:04:29,498::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:29,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a6d1835-d79f-42e4-8be2-042431c853c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:29,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a6d1835-d79f-42e4-8be2-042431c853c5`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:29,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:04:29,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:29,500::task::993::Storage.TaskManager.Task::(_decref) Task=`9a6d1835-d79f-42e4-8be2-042431c853c5`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:04:29,512::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:04:29,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`d67831c8-d35b-4501-8ccc-200d3e1fc78f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:04:29,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:04:29,514::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`198a7ca3-8797-41c6-8f48-2e7c23127351`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:04:29,514::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:04:29,515::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:04:29,515::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`198a7ca3-8797-41c6-8f48-2e7c23127351`::Granted request >Thread-6940::DEBUG::2014-07-08 16:04:29,516::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d67831c8-d35b-4501-8ccc-200d3e1fc78f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:04:29,516::task::993::Storage.TaskManager.Task::(_decref) Task=`d67831c8-d35b-4501-8ccc-200d3e1fc78f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:04:29,535::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:29,536::task::1191::Storage.TaskManager.Task::(prepare) Task=`d67831c8-d35b-4501-8ccc-200d3e1fc78f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:29,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`d67831c8-d35b-4501-8ccc-200d3e1fc78f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:04:29,536::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:04:29,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:04:29,537::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:04:29,537::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:04:29,538::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:04:29,538::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:04:29,538::task::993::Storage.TaskManager.Task::(_decref) Task=`d67831c8-d35b-4501-8ccc-200d3e1fc78f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:04:30,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:30,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175269 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:32,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:33,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176998 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:35,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:35,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176884 s, 57.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:35,852::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:35,853::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:35,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:35,853::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:35,854::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:35,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:35,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:35,854::__init__::225::IOProcess::(_processLogs) (272198) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:35,855::__init__::225::IOProcess::(_processLogs) (272198) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:35,855::__init__::225::IOProcess::(_processLogs) (272198) Building response >Thread-18::DEBUG::2014-07-08 16:04:35,855::__init__::225::IOProcess::(_processLogs) (272198) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:35,855::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:35,856::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:04:35,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:04:36,017::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000595312 s, 776 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:36,107::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:36,110::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:36,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:36,113::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:36,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:36,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:36,121::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:36,122::__init__::225::IOProcess::(_processLogs) (272199) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:36,125::__init__::225::IOProcess::(_processLogs) (272199) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:36,127::__init__::225::IOProcess::(_processLogs) (272199) Building response >Thread-18::DEBUG::2014-07-08 16:04:36,129::__init__::225::IOProcess::(_processLogs) (272199) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:36,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:36,133::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:04:36,150::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:36,152::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:04:36,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:36,156::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:36,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:36,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:36,162::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:36,164::__init__::225::IOProcess::(_processLogs) (272200) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:36,165::__init__::225::IOProcess::(_processLogs) (272200) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:36,167::__init__::225::IOProcess::(_processLogs) (272200) Building response >Thread-18::DEBUG::2014-07-08 16:04:36,169::__init__::225::IOProcess::(_processLogs) (272200) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:36,170::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:36,172::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:36,177::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:36,178::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:04:36,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:36,183::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:36,185::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:36,186::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:36,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:36,190::__init__::225::IOProcess::(_processLogs) (272201) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:36,192::__init__::225::IOProcess::(_processLogs) (272201) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:36,196::__init__::225::IOProcess::(_processLogs) (272201) Building response >Thread-18::DEBUG::2014-07-08 16:04:36,198::__init__::225::IOProcess::(_processLogs) (272201) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:36,200::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:36,202::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:36,209::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:36,211::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:04:36,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:36,215::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:36,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:36,219::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:36,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:36,221::__init__::225::IOProcess::(_processLogs) (272202) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:36,223::__init__::225::IOProcess::(_processLogs) (272202) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:36,224::__init__::225::IOProcess::(_processLogs) (272202) Building response >Thread-18::DEBUG::2014-07-08 16:04:36,225::__init__::225::IOProcess::(_processLogs) (272202) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:36,226::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:36,227::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:04:37,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:37,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174378 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:39,552::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:04:39,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`4af65eda-d149-45f4-8414-1252484688e2`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:39,553::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:04:39,568::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:39,569::task::1191::Storage.TaskManager.Task::(prepare) Task=`4af65eda-d149-45f4-8414-1252484688e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:39,569::task::595::Storage.TaskManager.Task::(_updateState) Task=`4af65eda-d149-45f4-8414-1252484688e2`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:39,569::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:04:39,569::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:39,570::task::993::Storage.TaskManager.Task::(_decref) Task=`4af65eda-d149-45f4-8414-1252484688e2`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:04:39,582::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:04:39,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`bacd921b-983d-41a9-8a30-a208df1fa5c1`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:04:39,583::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:04:39,584::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9e0bd66a-d4fe-4b06-948c-c209ae1899b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:04:39,584::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:04:39,585::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:04:39,585::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9e0bd66a-d4fe-4b06-948c-c209ae1899b0`::Granted request >Thread-6940::DEBUG::2014-07-08 16:04:39,590::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bacd921b-983d-41a9-8a30-a208df1fa5c1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:04:39,590::task::993::Storage.TaskManager.Task::(_decref) Task=`bacd921b-983d-41a9-8a30-a208df1fa5c1`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:04:39,609::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:39,609::task::1191::Storage.TaskManager.Task::(prepare) Task=`bacd921b-983d-41a9-8a30-a208df1fa5c1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:39,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`bacd921b-983d-41a9-8a30-a208df1fa5c1`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:04:39,610::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:04:39,610::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:04:39,611::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:04:39,611::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:04:39,611::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:04:39,611::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:04:39,612::task::993::Storage.TaskManager.Task::(_decref) Task=`bacd921b-983d-41a9-8a30-a208df1fa5c1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:04:39,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:40,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180233 s, 56.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:41,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`92aa7bd1-2fed-4345-8f64-ee14b22b54ed`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:41,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:04:41,493::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595312', 'lastCheck': '5.3', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:04:41,493::task::1191::Storage.TaskManager.Task::(prepare) Task=`92aa7bd1-2fed-4345-8f64-ee14b22b54ed`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595312', 'lastCheck': '5.3', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:04:41,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`92aa7bd1-2fed-4345-8f64-ee14b22b54ed`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:41,493::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:04:41,494::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:41,494::task::993::Storage.TaskManager.Task::(_decref) Task=`92aa7bd1-2fed-4345-8f64-ee14b22b54ed`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:04:42,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:42,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175149 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:44,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:44,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171056 s, 59.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:46,233::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:46,233::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:46,233::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:46,234::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:46,234::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:46,234::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:46,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:46,235::__init__::225::IOProcess::(_processLogs) (272203) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:46,235::__init__::225::IOProcess::(_processLogs) (272203) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:46,235::__init__::225::IOProcess::(_processLogs) (272203) Building response >Thread-18::DEBUG::2014-07-08 16:04:46,235::__init__::225::IOProcess::(_processLogs) (272203) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:46,236::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:46,236::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:04:46,237::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:04:46,392::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000557319 s, 829 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:46,487::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:46,489::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:46,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:46,490::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:46,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:46,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:46,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:46,492::__init__::225::IOProcess::(_processLogs) (272204) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:46,492::__init__::225::IOProcess::(_processLogs) (272204) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:46,493::__init__::225::IOProcess::(_processLogs) DEBUG|(272204) Building response >Thread-18::DEBUG::2014-07-08 16:04:46,493::__init__::225::IOProcess::(_processLogs) (272204) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:46,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:46,494::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:04:46,510::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:04:46,513::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:04:46,515::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:46,517::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:46,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:46,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:46,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:46,526::__init__::225::IOProcess::(_processLogs) (272205) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:46,528::__init__::225::IOProcess::(_processLogs) (272205) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:46,530::__init__::225::IOProcess::(_processLogs) (272205) Building response >Thread-18::DEBUG::2014-07-08 16:04:46,532::__init__::225::IOProcess::(_processLogs) (272205) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:46,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:46,534::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:46,540::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:04:46,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:46,545::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:46,547::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:46,549::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:46,550::__init__::225::IOProcess::(_processLogs) (272206) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:46,553::__init__::225::IOProcess::(_processLogs) (272206) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:46,555::__init__::225::IOProcess::(_processLogs) (272206) Building response >Thread-18::DEBUG::2014-07-08 16:04:46,557::__init__::225::IOProcess::(_processLogs) (272206) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:46,559::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:46,561::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:04:46,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:04:46,721::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:04:46,726::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:46,728::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:46,729::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:46,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:46,735::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:46,739::__init__::225::IOProcess::(_processLogs) (272207) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:46,742::__init__::225::IOProcess::(_processLogs) (272207) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:46,745::__init__::225::IOProcess::(_processLogs) (272207) Building response >Thread-18::DEBUG::2014-07-08 16:04:46,747::__init__::225::IOProcess::(_processLogs) (272207) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:46,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:46,754::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:04:46,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0575204 s, 17.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:49,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:49,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017352 s, 59.0 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:49,625::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:04:49,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`228054a9-d253-4138-aa36-832ede81ddd6`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:49,627::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:04:49,641::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:49,642::task::1191::Storage.TaskManager.Task::(prepare) Task=`228054a9-d253-4138-aa36-832ede81ddd6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:49,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`228054a9-d253-4138-aa36-832ede81ddd6`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:49,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:04:49,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:49,643::task::993::Storage.TaskManager.Task::(_decref) Task=`228054a9-d253-4138-aa36-832ede81ddd6`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:04:49,656::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:04:49,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b503933-980c-46a8-8334-ff823618ea9a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:04:49,657::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:04:49,658::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2e8380e9-d440-467e-8b0f-bf77496ebd0e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:04:49,658::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:04:49,659::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:04:49,659::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2e8380e9-d440-467e-8b0f-bf77496ebd0e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:04:49,660::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5b503933-980c-46a8-8334-ff823618ea9a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:04:49,660::task::993::Storage.TaskManager.Task::(_decref) Task=`5b503933-980c-46a8-8334-ff823618ea9a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:04:49,679::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:49,679::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b503933-980c-46a8-8334-ff823618ea9a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:49,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b503933-980c-46a8-8334-ff823618ea9a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:04:49,680::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:04:49,680::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:04:49,681::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:04:49,681::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:04:49,681::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:04:49,681::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:04:49,682::task::993::Storage.TaskManager.Task::(_decref) Task=`5b503933-980c-46a8-8334-ff823618ea9a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:04:51,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:51,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174277 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:53,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:53,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175107 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:04:55,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:56,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174766 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:56,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a13352e-f175-4699-adc3-dbdd29ab3d63`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:56,642::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:04:56,642::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557319', 'lastCheck': '9.9', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:04:56,643::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a13352e-f175-4699-adc3-dbdd29ab3d63`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557319', 'lastCheck': '9.9', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:04:56,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a13352e-f175-4699-adc3-dbdd29ab3d63`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:56,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:04:56,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:56,644::task::993::Storage.TaskManager.Task::(_decref) Task=`1a13352e-f175-4699-adc3-dbdd29ab3d63`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:04:56,766::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:56,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:56,767::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:56,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:56,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:56,767::__init__::225::IOProcess::(_processLogs) (272208) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:56,768::__init__::225::IOProcess::(_processLogs) (272208) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:56,768::__init__::225::IOProcess::(_processLogs) (272208) Building response >Thread-18::DEBUG::2014-07-08 16:04:56,768::__init__::225::IOProcess::(_processLogs) (272208) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:56,768::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:56,769::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:04:56,770::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:04:56,921::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000496139 s, 931 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:04:57,017::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:04:57,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:57,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:57,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:57,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:57,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:57,031::__init__::225::IOProcess::(_processLogs) (272209) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:04:57,032::__init__::225::IOProcess::(_processLogs) (272209) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:04:57,032::__init__::225::IOProcess::(_processLogs) (272209) Building response >Thread-18::DEBUG::2014-07-08 16:04:57,032::__init__::225::IOProcess::(_processLogs) (272209) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:57,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:57,033::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:04:57,046::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:04:57,047::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:57,047::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:57,047::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:57,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:57,048::__init__::225::IOProcess::(_processLogs) (272210) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:57,049::__init__::225::IOProcess::(_processLogs) (272210) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:57,049::__init__::225::IOProcess::(_processLogs) (272210) Building response >Thread-18::DEBUG::2014-07-08 16:04:57,049::__init__::225::IOProcess::(_processLogs) (272210) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:57,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:57,050::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:57,057::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:04:57,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:57,060::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:57,060::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:57,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:57,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:57,063::__init__::225::IOProcess::(_processLogs) (272211) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:57,064::__init__::225::IOProcess::(_processLogs) (272211) Building response >Thread-18::DEBUG::2014-07-08 16:04:57,066::__init__::225::IOProcess::(_processLogs) (272211) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:57,066::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:57,067::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:04:57,072::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:04:57,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:04:57,075::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:04:57,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:04:57,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:04:57,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:04:57,080::__init__::225::IOProcess::(_processLogs) (272212) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:04:57,081::__init__::225::IOProcess::(_processLogs) (272212) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:04:57,083::__init__::225::IOProcess::(_processLogs) (272212) Building response >Thread-18::DEBUG::2014-07-08 16:04:57,084::__init__::225::IOProcess::(_processLogs) (272212) Queuing response >Thread-18::DEBUG::2014-07-08 16:04:57,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:04:57,086::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:04:58,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:04:58,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176043 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:04:59,696::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:04:59,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ea9ef71-d143-44c9-b6e4-e964e02e264e`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:04:59,697::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:04:59,712::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:59,713::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ea9ef71-d143-44c9-b6e4-e964e02e264e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:04:59,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ea9ef71-d143-44c9-b6e4-e964e02e264e`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:04:59,713::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:04:59,714::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:04:59,714::task::993::Storage.TaskManager.Task::(_decref) Task=`5ea9ef71-d143-44c9-b6e4-e964e02e264e`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:04:59,725::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:04:59,726::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b302aab-1a64-4838-916f-6ebdf9c61a7a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:04:59,727::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:04:59,728::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`87a90b81-12ee-4bf3-b9a1-61c672ef37e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:04:59,728::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:04:59,728::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:04:59,729::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`87a90b81-12ee-4bf3-b9a1-61c672ef37e2`::Granted request >Thread-6940::DEBUG::2014-07-08 16:04:59,729::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5b302aab-1a64-4838-916f-6ebdf9c61a7a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:04:59,730::task::993::Storage.TaskManager.Task::(_decref) Task=`5b302aab-1a64-4838-916f-6ebdf9c61a7a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:04:59,750::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:59,751::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b302aab-1a64-4838-916f-6ebdf9c61a7a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:04:59,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b302aab-1a64-4838-916f-6ebdf9c61a7a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:04:59,753::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:04:59,754::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:04:59,755::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:04:59,755::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:04:59,755::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:04:59,755::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:04:59,756::task::993::Storage.TaskManager.Task::(_decref) Task=`5b302aab-1a64-4838-916f-6ebdf9c61a7a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:05:00,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:00,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173973 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:02,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:03,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0215541 s, 47.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:05,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:05,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343683 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:07,091::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:07,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:07,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:07,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:07,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:07,092::__init__::225::IOProcess::(_processLogs) (272213) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:07,093::__init__::225::IOProcess::(_processLogs) (272213) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:07,093::__init__::225::IOProcess::(_processLogs) (272213) Building response >Thread-18::DEBUG::2014-07-08 16:05:07,093::__init__::225::IOProcess::(_processLogs) (272213) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:07,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:07,093::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:05:07,095::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:05:07,246::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0004872 s, 948 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:07,254::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:07,259::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:07,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:07,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:07,274::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:07,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:07,376::__init__::225::IOProcess::(_processLogs) (272214) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:07,379::__init__::225::IOProcess::(_processLogs) (272214) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:07,383::__init__::225::IOProcess::(_processLogs) (272214) Building response >Dummy-6860::DEBUG::2014-07-08 16:05:07,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:05:07,393::__init__::225::IOProcess::(_processLogs) (272214) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:07,554::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:07,559::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:05:07,592::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:05:07,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:07,605::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:07,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:07,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:07,627::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:07,633::__init__::225::IOProcess::(_processLogs) (272215) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:07,640::__init__::225::IOProcess::(_processLogs) (272215) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:07,643::__init__::225::IOProcess::(_processLogs) (272215) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:07,646::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:07,648::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:05:07,659::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:05:07,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:07,663::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:07,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:07,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:07,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:07,754::__init__::225::IOProcess::(_processLogs) (272216) Finding callback 'access'... >Dummy-6860::DEBUG::2014-07-08 16:05:07,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.117264 s, 8.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:07,757::__init__::225::IOProcess::(_processLogs) (272216) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:07,761::__init__::225::IOProcess::(_processLogs) (272216) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:07,763::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:07,765::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:05:07,774::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:05:07,775::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:07,777::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:07,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:07,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:07,783::__init__::225::IOProcess::(_processLogs) (272217) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:07,785::__init__::225::IOProcess::(_processLogs) (272217) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:07,787::__init__::225::IOProcess::(_processLogs) (272217) Building response >Thread-18::DEBUG::2014-07-08 16:05:07,790::__init__::225::IOProcess::(_processLogs) (272217) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:07,792::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:07,795::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6939::DEBUG::2014-07-08 16:05:09,769::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:05:09,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`58fdac6c-88b2-449a-8214-650ddad8bda5`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:05:09,771::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:05:09,786::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:09,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`58fdac6c-88b2-449a-8214-650ddad8bda5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:09,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`58fdac6c-88b2-449a-8214-650ddad8bda5`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:05:09,787::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:05:09,787::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:05:09,787::task::993::Storage.TaskManager.Task::(_decref) Task=`58fdac6c-88b2-449a-8214-650ddad8bda5`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:05:09,798::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:05:09,799::task::595::Storage.TaskManager.Task::(_updateState) Task=`89ba335f-094d-43af-a2b6-43692df04c1d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:05:09,799::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:05:09,800::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`01e4e326-07e3-43de-b141-4eace5c7f660`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:05:09,800::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:05:09,801::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:05:09,801::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`01e4e326-07e3-43de-b141-4eace5c7f660`::Granted request >Thread-6940::DEBUG::2014-07-08 16:05:09,802::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`89ba335f-094d-43af-a2b6-43692df04c1d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:05:09,802::task::993::Storage.TaskManager.Task::(_decref) Task=`89ba335f-094d-43af-a2b6-43692df04c1d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:05:09,821::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:09,821::task::1191::Storage.TaskManager.Task::(prepare) Task=`89ba335f-094d-43af-a2b6-43692df04c1d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:09,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`89ba335f-094d-43af-a2b6-43692df04c1d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:05:09,822::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:05:09,822::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:05:09,822::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:05:09,823::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:05:09,823::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:05:09,823::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:05:09,823::task::993::Storage.TaskManager.Task::(_decref) Task=`89ba335f-094d-43af-a2b6-43692df04c1d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:05:09,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:10,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175454 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:05:11,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`44f4cce9-af03-46e4-b92b-8744e1ca2528`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:05:11,986::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:05:11,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004872', 'lastCheck': '4.2', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:05:11,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`44f4cce9-af03-46e4-b92b-8744e1ca2528`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004872', 'lastCheck': '4.2', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:05:11,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`44f4cce9-af03-46e4-b92b-8744e1ca2528`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:05:11,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:05:11,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:05:11,988::task::993::Storage.TaskManager.Task::(_decref) Task=`44f4cce9-af03-46e4-b92b-8744e1ca2528`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:05:12,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:12,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175004 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:14,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:14,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170962 s, 59.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:16,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:17,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175965 s, 58.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:17,829::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:17,834::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:17,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:17,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:17,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:17,846::__init__::225::IOProcess::(_processLogs) (272218) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:17,850::__init__::225::IOProcess::(_processLogs) (272218) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:17,851::__init__::225::IOProcess::(_processLogs) (272218) Building response >Thread-18::DEBUG::2014-07-08 16:05:17,851::__init__::225::IOProcess::(_processLogs) (272218) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:17,851::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:17,851::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:05:17,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:05:18,008::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00050033 s, 923 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:18,014::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:18,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:18,017::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:18,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:18,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:18,022::__init__::225::IOProcess::(_processLogs) (272219) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:18,024::__init__::225::IOProcess::(_processLogs) (272219) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:18,026::__init__::225::IOProcess::(_processLogs) (272219) Building response >Thread-18::DEBUG::2014-07-08 16:05:18,027::__init__::225::IOProcess::(_processLogs) (272219) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:18,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:18,030::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:05:18,039::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:05:18,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:18,053::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:18,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:18,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:18,059::__init__::225::IOProcess::(_processLogs) (272220) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:18,060::__init__::225::IOProcess::(_processLogs) (272220) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:18,062::__init__::225::IOProcess::(_processLogs) (272220) Building response >Thread-18::DEBUG::2014-07-08 16:05:18,064::__init__::225::IOProcess::(_processLogs) (272220) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:18,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:18,066::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:05:18,072::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:05:18,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:18,075::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:18,076::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:18,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:18,078::__init__::225::IOProcess::(_processLogs) (272221) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:18,080::__init__::225::IOProcess::(_processLogs) (272221) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:18,081::__init__::225::IOProcess::(_processLogs) (272221) Building response >Thread-18::DEBUG::2014-07-08 16:05:18,082::__init__::225::IOProcess::(_processLogs) (272221) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:18,084::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:18,086::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:05:18,091::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:05:18,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:18,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:18,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:18,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:18,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:18,099::__init__::225::IOProcess::(_processLogs) (272222) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:18,104::__init__::225::IOProcess::(_processLogs) (272222) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:18,108::__init__::225::IOProcess::(_processLogs) (272222) Building response >Thread-18::DEBUG::2014-07-08 16:05:18,111::__init__::225::IOProcess::(_processLogs) (272222) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:18,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:18,114::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:05:19,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:19,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176794 s, 57.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:05:19,838::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:05:19,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`83016a29-b9fb-4cfd-b31a-270e7cd5d057`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:05:19,839::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:05:19,856::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:19,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`83016a29-b9fb-4cfd-b31a-270e7cd5d057`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:19,859::task::595::Storage.TaskManager.Task::(_updateState) Task=`83016a29-b9fb-4cfd-b31a-270e7cd5d057`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:05:19,861::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:05:19,862::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:05:19,864::task::993::Storage.TaskManager.Task::(_decref) Task=`83016a29-b9fb-4cfd-b31a-270e7cd5d057`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:05:19,887::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:05:19,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`b82576d4-63e0-4316-be9d-348672ae2ddc`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:05:19,888::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:05:19,889::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`88a51a2a-9be9-44f2-9a32-328887f8ce9d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:05:19,889::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:05:19,890::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:05:19,890::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`88a51a2a-9be9-44f2-9a32-328887f8ce9d`::Granted request >Thread-6940::DEBUG::2014-07-08 16:05:19,891::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b82576d4-63e0-4316-be9d-348672ae2ddc`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:05:19,891::task::993::Storage.TaskManager.Task::(_decref) Task=`b82576d4-63e0-4316-be9d-348672ae2ddc`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:05:19,912::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:19,912::task::1191::Storage.TaskManager.Task::(prepare) Task=`b82576d4-63e0-4316-be9d-348672ae2ddc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:19,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`b82576d4-63e0-4316-be9d-348672ae2ddc`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:05:19,913::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:05:19,913::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:05:19,913::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:05:19,914::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:05:19,914::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:05:19,914::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:05:19,915::task::993::Storage.TaskManager.Task::(_decref) Task=`b82576d4-63e0-4316-be9d-348672ae2ddc`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:05:21,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:21,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178024 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:23,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:23,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174604 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:25,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:26,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338638 s, 30.2 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:05:27,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`d44db421-9594-407f-8ff4-5ac4e6621854`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:05:27,148::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:05:27,149::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050033', 'lastCheck': '9.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:05:27,149::task::1191::Storage.TaskManager.Task::(prepare) Task=`d44db421-9594-407f-8ff4-5ac4e6621854`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050033', 'lastCheck': '9.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:05:27,149::task::595::Storage.TaskManager.Task::(_updateState) Task=`d44db421-9594-407f-8ff4-5ac4e6621854`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:05:27,150::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:05:27,150::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:05:27,150::task::993::Storage.TaskManager.Task::(_decref) Task=`d44db421-9594-407f-8ff4-5ac4e6621854`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:05:28,120::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:28,120::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:28,121::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:28,121::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:28,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:28,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:28,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:28,122::__init__::225::IOProcess::(_processLogs) (272223) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:28,122::__init__::225::IOProcess::(_processLogs) (272223) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:28,122::__init__::225::IOProcess::(_processLogs) (272223) Building response >Thread-18::DEBUG::2014-07-08 16:05:28,123::__init__::225::IOProcess::(_processLogs) (272223) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:28,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:28,123::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:05:28,125::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:28,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:05:28,431::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000667665 s, 692 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:28,441::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:28,445::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:28,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:28,535::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:28,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:28,544::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:28,554::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:28,559::__init__::225::IOProcess::(_processLogs) (272224) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:28,563::__init__::225::IOProcess::(_processLogs) (272224) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:28,567::__init__::225::IOProcess::(_processLogs) (272224) Building response >Thread-18::DEBUG::2014-07-08 16:05:28,571::__init__::225::IOProcess::(_processLogs) (272224) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:28,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:28,578::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:05:28,596::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:28,603::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:05:28,606::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:28,608::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:28,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:28,616::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:28,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:28,705::__init__::225::IOProcess::(_processLogs) (272225) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:28,707::__init__::225::IOProcess::(_processLogs) (272225) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:28,708::__init__::225::IOProcess::(_processLogs) (272225) Building response >Thread-18::DEBUG::2014-07-08 16:05:28,710::__init__::225::IOProcess::(_processLogs) (272225) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:05:28,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.178365 s, 5.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:28,712::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:05:28,714::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:05:28,722::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:28,725::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:05:28,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:28,730::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:28,732::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:28,735::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:28,737::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:28,739::__init__::225::IOProcess::(_processLogs) (272226) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:28,742::__init__::225::IOProcess::(_processLogs) (272226) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:28,744::__init__::225::IOProcess::(_processLogs) (272226) Building response >Thread-18::DEBUG::2014-07-08 16:05:28,746::__init__::225::IOProcess::(_processLogs) (272226) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:28,749::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:28,751::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:05:28,759::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:28,763::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:05:28,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:28,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:28,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:28,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:28,777::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:28,779::__init__::225::IOProcess::(_processLogs) (272227) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:28,781::__init__::225::IOProcess::(_processLogs) (272227) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:28,783::__init__::225::IOProcess::(_processLogs) (272227) Building response >Thread-18::DEBUG::2014-07-08 16:05:28,786::__init__::225::IOProcess::(_processLogs) (272227) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:28,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:28,792::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6939::DEBUG::2014-07-08 16:05:29,929::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:05:29,931::task::595::Storage.TaskManager.Task::(_updateState) Task=`1828d71d-6fb5-45b7-aa5e-f7d8584ae5aa`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:05:29,931::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:05:29,947::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:29,947::task::1191::Storage.TaskManager.Task::(prepare) Task=`1828d71d-6fb5-45b7-aa5e-f7d8584ae5aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:29,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`1828d71d-6fb5-45b7-aa5e-f7d8584ae5aa`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:05:29,948::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:05:29,948::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:05:29,948::task::993::Storage.TaskManager.Task::(_decref) Task=`1828d71d-6fb5-45b7-aa5e-f7d8584ae5aa`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:05:29,961::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:05:29,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccfbbc5a-d3ff-40f9-b6b8-b17c4a30f819`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:05:29,962::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:05:29,963::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fff9e88f-49cf-4142-a494-e730de10eb22`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:05:29,964::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:05:29,964::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:05:29,964::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fff9e88f-49cf-4142-a494-e730de10eb22`::Granted request >Thread-6940::DEBUG::2014-07-08 16:05:29,965::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ccfbbc5a-d3ff-40f9-b6b8-b17c4a30f819`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:05:29,965::task::993::Storage.TaskManager.Task::(_decref) Task=`ccfbbc5a-d3ff-40f9-b6b8-b17c4a30f819`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:05:29,984::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:29,985::task::1191::Storage.TaskManager.Task::(prepare) Task=`ccfbbc5a-d3ff-40f9-b6b8-b17c4a30f819`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:29,985::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccfbbc5a-d3ff-40f9-b6b8-b17c4a30f819`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:05:29,985::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:05:29,985::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:05:29,986::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:05:29,986::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:05:29,986::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:05:29,986::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:05:29,987::task::993::Storage.TaskManager.Task::(_decref) Task=`ccfbbc5a-d3ff-40f9-b6b8-b17c4a30f819`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:05:30,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:31,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178756 s, 57.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:33,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:33,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185103 s, 55.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:35,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:35,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173797 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:37,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:38,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174484 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:38,800::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:38,801::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:38,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:38,801::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:38,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:38,802::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:38,802::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:38,802::__init__::225::IOProcess::(_processLogs) (272228) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:38,803::__init__::225::IOProcess::(_processLogs) (272228) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:38,803::__init__::225::IOProcess::(_processLogs) (272228) Building response >Thread-18::DEBUG::2014-07-08 16:05:38,803::__init__::225::IOProcess::(_processLogs) (272228) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:38,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:38,803::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:05:38,805::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:05:38,952::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0005048 s, 915 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:39,049::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:39,065::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:39,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:39,069::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:39,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:39,072::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:39,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:39,075::__init__::225::IOProcess::(_processLogs) (272229) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:39,082::__init__::225::IOProcess::(_processLogs) (272229) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:39,084::__init__::225::IOProcess::(_processLogs) (272229) Building response >Thread-18::DEBUG::2014-07-08 16:05:39,085::__init__::225::IOProcess::(_processLogs) (272229) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:39,086::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:39,088::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:05:39,098::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:39,100::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:05:39,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:39,102::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:39,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:39,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:39,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:39,108::__init__::225::IOProcess::(_processLogs) (272230) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:39,109::__init__::225::IOProcess::(_processLogs) (272230) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:39,111::__init__::225::IOProcess::(_processLogs) (272230) Building response >Thread-18::DEBUG::2014-07-08 16:05:39,113::__init__::225::IOProcess::(_processLogs) (272230) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:39,114::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:39,115::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:05:39,128::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:39,130::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:05:39,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:39,134::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:39,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:39,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:39,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:39,139::__init__::225::IOProcess::(_processLogs) (272231) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:39,140::__init__::225::IOProcess::(_processLogs) (272231) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:39,141::__init__::225::IOProcess::(_processLogs) (272231) Building response >Thread-18::DEBUG::2014-07-08 16:05:39,142::__init__::225::IOProcess::(_processLogs) (272231) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:39,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:39,145::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:05:39,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:39,151::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:05:39,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:39,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:39,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:39,158::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:39,159::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:39,160::__init__::225::IOProcess::(_processLogs) (272232) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:39,161::__init__::225::IOProcess::(_processLogs) (272232) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:39,162::__init__::225::IOProcess::(_processLogs) (272232) Building response >Thread-18::DEBUG::2014-07-08 16:05:39,164::__init__::225::IOProcess::(_processLogs) (272232) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:39,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:39,166::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6939::DEBUG::2014-07-08 16:05:40,000::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:05:40,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`27bc1f86-b3fc-467d-a05f-545ff86083c5`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:05:40,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:05:40,017::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:40,017::task::1191::Storage.TaskManager.Task::(prepare) Task=`27bc1f86-b3fc-467d-a05f-545ff86083c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:40,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`27bc1f86-b3fc-467d-a05f-545ff86083c5`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:05:40,017::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:05:40,018::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:05:40,018::task::993::Storage.TaskManager.Task::(_decref) Task=`27bc1f86-b3fc-467d-a05f-545ff86083c5`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:05:40,029::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:05:40,030::task::595::Storage.TaskManager.Task::(_updateState) Task=`8dc54ca5-7c3d-4d73-8d3e-5a11fc846da7`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:05:40,030::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:05:40,031::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d61ccbfa-aec3-49b1-819d-14cab9a1995e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:05:40,031::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:05:40,032::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:05:40,032::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d61ccbfa-aec3-49b1-819d-14cab9a1995e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:05:40,033::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8dc54ca5-7c3d-4d73-8d3e-5a11fc846da7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:05:40,033::task::993::Storage.TaskManager.Task::(_decref) Task=`8dc54ca5-7c3d-4d73-8d3e-5a11fc846da7`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:05:40,052::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:40,052::task::1191::Storage.TaskManager.Task::(prepare) Task=`8dc54ca5-7c3d-4d73-8d3e-5a11fc846da7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:40,053::task::595::Storage.TaskManager.Task::(_updateState) Task=`8dc54ca5-7c3d-4d73-8d3e-5a11fc846da7`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:05:40,053::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:05:40,053::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:05:40,053::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:05:40,054::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:05:40,054::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:05:40,054::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:05:40,055::task::993::Storage.TaskManager.Task::(_decref) Task=`8dc54ca5-7c3d-4d73-8d3e-5a11fc846da7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:05:40,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:40,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360939 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:42,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:05:42,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`f76b58ca-7c32-4572-9c6c-72910d16ab89`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:05:42,494::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:05:42,495::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005048', 'lastCheck': '3.3', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:05:42,495::task::1191::Storage.TaskManager.Task::(prepare) Task=`f76b58ca-7c32-4572-9c6c-72910d16ab89`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005048', 'lastCheck': '3.3', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:05:42,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`f76b58ca-7c32-4572-9c6c-72910d16ab89`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:05:42,496::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:05:42,498::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:05:42,499::task::993::Storage.TaskManager.Task::(_decref) Task=`f76b58ca-7c32-4572-9c6c-72910d16ab89`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:05:42,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0432837 s, 23.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:44,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:44,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017537 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:46,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:47,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176593 s, 58.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:49,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:49,172::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:49,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:49,172::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:49,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:49,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:49,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:49,173::__init__::225::IOProcess::(_processLogs) (272233) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:49,173::__init__::225::IOProcess::(_processLogs) (272233) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:49,174::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272233) Building response >Thread-18::DEBUG::2014-07-08 16:05:49,174::__init__::225::IOProcess::(_processLogs) (272233) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:49,174::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:49,174::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:05:49,176::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:49,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:05:49,336::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000599782 s, 770 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:49,571::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:49,571::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:49,572::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:49,572::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:49,573::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:49,573::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:49,576::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:49,578::__init__::225::IOProcess::(_processLogs) (272234) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:49,580::__init__::225::IOProcess::(_processLogs) (272234) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:49,583::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272234) Building response >Thread-18::DEBUG::2014-07-08 16:05:49,584::__init__::225::IOProcess::(_processLogs) (272234) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:49,586::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:49,588::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:05:49,605::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:49,609::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:05:49,611::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:49,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:49,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:49,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:49,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:49,625::__init__::225::IOProcess::(_processLogs) (272235) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:49,627::__init__::225::IOProcess::(_processLogs) (272235) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:49,630::__init__::225::IOProcess::(_processLogs) (272235) Building response >Thread-18::DEBUG::2014-07-08 16:05:49,632::__init__::225::IOProcess::(_processLogs) (272235) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:49,635::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:49,637::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:05:49,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.075663 s, 13.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:49,728::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:05:49,731::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:05:49,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:49,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:49,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:49,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:49,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:49,744::__init__::225::IOProcess::(_processLogs) (272236) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:49,746::__init__::225::IOProcess::(_processLogs) (272236) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:49,747::__init__::225::IOProcess::(_processLogs) (272236) Building response >Thread-18::DEBUG::2014-07-08 16:05:49,749::__init__::225::IOProcess::(_processLogs) (272236) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:49,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:49,753::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:05:49,760::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:05:49,762::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:49,765::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:49,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:49,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:49,771::__init__::225::IOProcess::(_processLogs) (272237) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:05:49,777::__init__::225::IOProcess::(_processLogs) (272237) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:05:49,780::__init__::225::IOProcess::(_processLogs) (272237) Building response >Thread-18::DEBUG::2014-07-08 16:05:49,782::__init__::225::IOProcess::(_processLogs) (272237) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:49,784::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:49,786::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6939::DEBUG::2014-07-08 16:05:50,069::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:05:50,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ebdfa3b-aa2a-49ac-ac1c-58246abc9d59`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:05:50,070::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:05:50,085::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:50,086::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ebdfa3b-aa2a-49ac-ac1c-58246abc9d59`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:05:50,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ebdfa3b-aa2a-49ac-ac1c-58246abc9d59`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:05:50,086::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:05:50,087::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:05:50,087::task::993::Storage.TaskManager.Task::(_decref) Task=`8ebdfa3b-aa2a-49ac-ac1c-58246abc9d59`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:05:50,098::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:05:50,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`69ea15fb-397b-4d77-806d-d51e27fb2aa1`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:05:50,100::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:05:50,100::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`770a0c00-c1a4-4390-8a02-2a8e1f758251`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:05:50,101::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:05:50,101::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:05:50,101::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`770a0c00-c1a4-4390-8a02-2a8e1f758251`::Granted request >Thread-6940::DEBUG::2014-07-08 16:05:50,102::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`69ea15fb-397b-4d77-806d-d51e27fb2aa1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:05:50,102::task::993::Storage.TaskManager.Task::(_decref) Task=`69ea15fb-397b-4d77-806d-d51e27fb2aa1`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:05:50,121::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:50,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`69ea15fb-397b-4d77-806d-d51e27fb2aa1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:05:50,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`69ea15fb-397b-4d77-806d-d51e27fb2aa1`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:05:50,122::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:05:50,122::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:05:50,123::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:05:50,123::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:05:50,123::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:05:50,124::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:05:50,124::task::993::Storage.TaskManager.Task::(_decref) Task=`69ea15fb-397b-4d77-806d-d51e27fb2aa1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:05:51,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:52,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01758 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:54,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:54,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031739 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:05:56,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:56,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177197 s, 57.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:05:57,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc4c635e-21d4-4691-b1b9-1678d5847f71`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:05:57,768::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:05:57,768::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599782', 'lastCheck': '8.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:05:57,769::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc4c635e-21d4-4691-b1b9-1678d5847f71`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599782', 'lastCheck': '8.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:05:57,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc4c635e-21d4-4691-b1b9-1678d5847f71`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:05:57,769::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:05:57,769::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:05:57,770::task::993::Storage.TaskManager.Task::(_decref) Task=`cc4c635e-21d4-4691-b1b9-1678d5847f71`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:05:58,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:05:59,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176247 s, 58.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:05:59,830::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:05:59,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:05:59,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:05:59,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:05:59,833::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:05:59,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:05:59,833::__init__::225::IOProcess::(_processLogs) (272238) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:05:59,837::__init__::225::IOProcess::(_processLogs) (272238) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:05:59,837::__init__::225::IOProcess::(_processLogs) (272238) Queuing response >Thread-18::DEBUG::2014-07-08 16:05:59,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:05:59,838::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:05:59,840::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:06:00,002::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00046122 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:06:00,008::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:06:00,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:00,012::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:00,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:00,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:00,017::__init__::225::IOProcess::(_processLogs) (272239) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:06:00,018::__init__::225::IOProcess::(_processLogs) (272239) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:06:00,019::__init__::225::IOProcess::(_processLogs) (272239) Building response >Thread-18::DEBUG::2014-07-08 16:06:00,021::__init__::225::IOProcess::(_processLogs) (272239) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:00,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:00,024::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:06:00,032::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:06:00,034::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:00,035::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:00,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:00,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:00,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:00,041::__init__::225::IOProcess::(_processLogs) (272240) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:00,042::__init__::225::IOProcess::(_processLogs) (272240) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:00,043::__init__::225::IOProcess::(_processLogs) (272240) Building response >Thread-18::DEBUG::2014-07-08 16:06:00,045::__init__::225::IOProcess::(_processLogs) (272240) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:00,046::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:00,047::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:00,053::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:06:00,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:00,068::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:00,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:00,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:00,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:00,074::__init__::225::IOProcess::(_processLogs) (272241) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:00,075::__init__::225::IOProcess::(_processLogs) (272241) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:00,077::__init__::225::IOProcess::(_processLogs) (272241) Building response >Thread-18::DEBUG::2014-07-08 16:06:00,078::__init__::225::IOProcess::(_processLogs) (272241) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:00,080::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:00,081::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:00,086::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:00,087::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:06:00,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:00,090::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:00,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:00,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:00,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:00,096::__init__::225::IOProcess::(_processLogs) (272242) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:00,097::__init__::225::IOProcess::(_processLogs) (272242) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:00,098::__init__::225::IOProcess::(_processLogs) (272242) Building response >Thread-18::DEBUG::2014-07-08 16:06:00,100::__init__::225::IOProcess::(_processLogs) (272242) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:00,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:00,103::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6939::DEBUG::2014-07-08 16:06:00,140::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:06:00,143::task::595::Storage.TaskManager.Task::(_updateState) Task=`c30e91fe-efcb-4756-a680-0a4bee71ef2f`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:06:00,144::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:06:00,163::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:00,164::task::1191::Storage.TaskManager.Task::(prepare) Task=`c30e91fe-efcb-4756-a680-0a4bee71ef2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:00,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`c30e91fe-efcb-4756-a680-0a4bee71ef2f`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:06:00,164::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:00,164::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:00,165::task::993::Storage.TaskManager.Task::(_decref) Task=`c30e91fe-efcb-4756-a680-0a4bee71ef2f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:06:00,176::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:06:00,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`6225cce2-a83f-4b9d-83e2-3ed2385a4a8f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:06:00,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:06:00,178::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6f3c2375-1cda-4c85-bb73-c59a7d694148`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:06:00,178::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:06:00,178::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:06:00,179::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6f3c2375-1cda-4c85-bb73-c59a7d694148`::Granted request >Thread-6940::DEBUG::2014-07-08 16:06:00,179::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6225cce2-a83f-4b9d-83e2-3ed2385a4a8f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:06:00,180::task::993::Storage.TaskManager.Task::(_decref) Task=`6225cce2-a83f-4b9d-83e2-3ed2385a4a8f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:06:00,198::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:06:00,199::task::1191::Storage.TaskManager.Task::(prepare) Task=`6225cce2-a83f-4b9d-83e2-3ed2385a4a8f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:06:00,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`6225cce2-a83f-4b9d-83e2-3ed2385a4a8f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:06:00,199::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:06:00,200::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:06:00,200::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:06:00,201::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:06:00,201::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:06:00,201::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:06:00,201::task::993::Storage.TaskManager.Task::(_decref) Task=`6225cce2-a83f-4b9d-83e2-3ed2385a4a8f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:06:01,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:01,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177761 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:03,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:03,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0433125 s, 23.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:05,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:06,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174146 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:08,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:08,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174554 s, 58.7 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:06:10,108::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:06:10,114::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:10,114::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:06:10,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,115::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,116::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:10,117::__init__::225::IOProcess::(_processLogs) (272243) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:06:10,117::__init__::225::IOProcess::(_processLogs) (272243) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:06:10,118::__init__::225::IOProcess::(_processLogs) (272243) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,118::__init__::225::IOProcess::(_processLogs) (272243) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,119::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:06:10,120::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:10,122::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:06:10,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,126::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:10,127::__init__::225::IOProcess::(_processLogs) (272244) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:06:10,127::__init__::225::IOProcess::(_processLogs) (272244) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:06:10,128::__init__::225::IOProcess::(_processLogs) (272244) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,128::__init__::225::IOProcess::(_processLogs) (272244) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,128::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,128::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:06:10,129::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:10,130::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:06:10,131::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,131::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,132::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,132::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:10,132::__init__::225::IOProcess::(_processLogs) (272245) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:06:10,133::__init__::225::IOProcess::(_processLogs) (272245) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:06:10,133::__init__::225::IOProcess::(_processLogs) (272245) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,133::__init__::225::IOProcess::(_processLogs) (272245) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,133::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:06:10,135::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:10,136::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:06:10,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,142::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-37::DEBUG::2014-07-08 16:06:10,148::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:06:10,148::__init__::225::IOProcess::(_processLogs) (272246) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:06:10,149::__init__::225::IOProcess::(_processLogs) (272246) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:06:10,150::__init__::225::IOProcess::(_processLogs) (272246) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,150::__init__::225::IOProcess::(_processLogs) (272246) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,150::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:06:10,152::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:10,152::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:06:10,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,153::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,153::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,153::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:10,154::__init__::225::IOProcess::(_processLogs) (272247) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:06:10,154::__init__::225::IOProcess::(_processLogs) (272247) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:06:10,154::__init__::225::IOProcess::(_processLogs) DEBUG|(272247) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,154::__init__::225::IOProcess::(_processLogs) (272247) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,155::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,155::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:06:10,156::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:06:10,157::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:10,157::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:06:10,158::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,158::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,158::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,159::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:10,159::__init__::225::IOProcess::(_processLogs) (272248) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:06:10,159::__init__::225::IOProcess::(_processLogs) (272248) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:06:10,159::__init__::225::IOProcess::(_processLogs) (272248) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,160::__init__::225::IOProcess::(_processLogs) (272248) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,160::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:06:10,161::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:06:10,162::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:10,162::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:06:10,163::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,163::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:10,164::__init__::225::IOProcess::(_processLogs) (272249) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:10,164::__init__::225::IOProcess::(_processLogs) (272249) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:10,164::__init__::225::IOProcess::(_processLogs) (272249) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,165::__init__::225::IOProcess::(_processLogs) (272249) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,165::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:10,166::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:10,166::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:06:10,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,167::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,167::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,167::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:10,168::__init__::225::IOProcess::(_processLogs) (272250) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:06:10,168::__init__::225::IOProcess::(_processLogs) (272250) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:06:10,168::__init__::225::IOProcess::(_processLogs) (272250) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,169::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:06:10,169::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:06:10,170::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:06:10,170::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:06:10,171::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:06:10,171::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,171::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,172::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:10,174::__init__::225::IOProcess::(_processLogs) (272251) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:06:10,176::__init__::225::IOProcess::(_processLogs) (272251) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:06:10,179::__init__::225::IOProcess::(_processLogs) (272251) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,268::__init__::225::IOProcess::(_processLogs) (272251) Queuing response >Thread-6939::DEBUG::2014-07-08 16:06:10,273::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:06:10,276::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6939::DEBUG::2014-07-08 16:06:10,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`d32fd208-de1d-4421-9d72-c5343c007b68`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:06:10,285::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6939::INFO::2014-07-08 16:06:10,289::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 16:06:10,309::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6939::INFO::2014-07-08 16:06:10,311::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:10,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`d32fd208-de1d-4421-9d72-c5343c007b68`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:06:10,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:06:10,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`d32fd208-de1d-4421-9d72-c5343c007b68`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-08 16:06:10,480::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000660961 s, 699 kB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:06:10,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:10,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:10,650::task::993::Storage.TaskManager.Task::(_decref) Task=`d32fd208-de1d-4421-9d72-c5343c007b68`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:06:10,661::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:10,670::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:06:10,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:06:10,704::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:06:10,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:10,720::__init__::225::IOProcess::(_processLogs) (272252) Finding callback 'statvfs'... >Thread-6940::DEBUG::2014-07-08 16:06:10,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`b83d97dc-439d-431f-9155-9dd62cda9f41`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:06:10,729::__init__::225::IOProcess::(_processLogs) (272252) Got request for method 'statvfs' >Thread-6940::INFO::2014-07-08 16:06:10,734::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:06:10,737::__init__::225::IOProcess::(_processLogs) (272252) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,745::__init__::225::IOProcess::(_processLogs) (272252) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,761::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6940::DEBUG::2014-07-08 16:06:10,760::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c2c4d6e9-6590-49df-91e2-0647bd857936`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:06:10,768::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:06:10,784::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:06:10,792::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c2c4d6e9-6590-49df-91e2-0647bd857936`::Granted request >Thread-18::DEBUG::2014-07-08 16:06:10,808::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6940::DEBUG::2014-07-08 16:06:10,810::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b83d97dc-439d-431f-9155-9dd62cda9f41`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:06:10,816::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-6940::DEBUG::2014-07-08 16:06:10,817::task::993::Storage.TaskManager.Task::(_decref) Task=`b83d97dc-439d-431f-9155-9dd62cda9f41`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:06:10,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:10,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:10,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:10,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:10,944::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 16:06:10,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.212851 s, 4.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:06:10,952::__init__::225::IOProcess::(_processLogs) (272253) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:10,962::__init__::225::IOProcess::(_processLogs) (272253) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:10,969::__init__::225::IOProcess::(_processLogs) DEBUG|(272253) Building response >Thread-18::DEBUG::2014-07-08 16:06:10,976::__init__::225::IOProcess::(_processLogs) (272253) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:10,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:10,985::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:10,998::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:11,001::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-6940::INFO::2014-07-08 16:06:11,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:06:11,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:06:11,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`b83d97dc-439d-431f-9155-9dd62cda9f41`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:06:11,016::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Queuing request... >Thread-6940::DEBUG::2014-07-08 16:06:11,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`b83d97dc-439d-431f-9155-9dd62cda9f41`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:06:11,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:06:11,025::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:06:11,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:06:11,032::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:06:11,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:06:11,047::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:06:11,047::__init__::225::IOProcess::(_processLogs) (272254) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:06:11,056::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:06:11,056::__init__::225::IOProcess::(_processLogs) (272254) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:06:11,059::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:06:11,061::__init__::225::IOProcess::(_processLogs) (272254) Building response >Thread-6940::DEBUG::2014-07-08 16:06:11,062::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:06:11,065::__init__::225::IOProcess::(_processLogs) (272254) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:11,069::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:06:11,069::task::993::Storage.TaskManager.Task::(_decref) Task=`b83d97dc-439d-431f-9155-9dd62cda9f41`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:06:11,074::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:11,088::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:11,092::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:06:11,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:11,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:11,103::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:11,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:11,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:11,111::__init__::225::IOProcess::(_processLogs) (272255) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:11,113::__init__::225::IOProcess::(_processLogs) (272255) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:11,115::__init__::225::IOProcess::(_processLogs) (272255) Building response >Thread-18::DEBUG::2014-07-08 16:06:11,117::__init__::225::IOProcess::(_processLogs) (272255) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:11,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:11,121::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6939::DEBUG::2014-07-08 16:06:12,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fcc0b22-4591-4fe8-9cab-98cc71bebcff`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:06:12,918::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:06:12,919::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660961', 'lastCheck': '1.8', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:06:12,919::task::1191::Storage.TaskManager.Task::(prepare) Task=`1fcc0b22-4591-4fe8-9cab-98cc71bebcff`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660961', 'lastCheck': '1.8', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:06:12,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fcc0b22-4591-4fe8-9cab-98cc71bebcff`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:06:12,920::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:12,920::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:12,920::task::993::Storage.TaskManager.Task::(_decref) Task=`1fcc0b22-4591-4fe8-9cab-98cc71bebcff`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:06:13,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:13,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173135 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:15,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:15,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173389 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:17,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:18,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175241 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:20,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:20,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241974 s, 42.3 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:06:21,102::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:06:21,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`81399e05-307e-499d-828c-ce22c600d799`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:06:21,104::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:06:21,119::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:21,119::task::1191::Storage.TaskManager.Task::(prepare) Task=`81399e05-307e-499d-828c-ce22c600d799`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:21,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`81399e05-307e-499d-828c-ce22c600d799`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:06:21,120::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:21,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:21,120::task::993::Storage.TaskManager.Task::(_decref) Task=`81399e05-307e-499d-828c-ce22c600d799`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:06:21,131::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:21,132::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6940::DEBUG::2014-07-08 16:06:21,133::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:06:21,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:21,136::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:06:21,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7681068-dd10-4e5f-9756-7c8108f2c4ec`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:06:21,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::INFO::2014-07-08 16:06:21,138::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:06:21,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:21,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:06:21,142::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6ec15506-245c-4485-a6a8-87c8c38df708`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:06:21,142::__init__::225::IOProcess::(_processLogs) (272256) Finding callback 'statvfs'... >Thread-6940::DEBUG::2014-07-08 16:06:21,143::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:06:21,143::__init__::225::IOProcess::(_processLogs) (272256) Got request for method 'statvfs' >Thread-6940::DEBUG::2014-07-08 16:06:21,145::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:06:21,146::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6ec15506-245c-4485-a6a8-87c8c38df708`::Granted request >Thread-18::DEBUG::2014-07-08 16:06:21,146::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|(272256) Building response >Thread-18::DEBUG::2014-07-08 16:06:21,147::__init__::225::IOProcess::(_processLogs) (272256) Queuing response >Thread-6940::DEBUG::2014-07-08 16:06:21,149::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d7681068-dd10-4e5f-9756-7c8108f2c4ec`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:06:21,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:06:21,150::task::993::Storage.TaskManager.Task::(_decref) Task=`d7681068-dd10-4e5f-9756-7c8108f2c4ec`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:06:21,150::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:06:21,160::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:06:21,315::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000601459 s, 768 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:06:21,325::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:21,328::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:06:21,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:21,333::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:21,335::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:21,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:21,338::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:21,340::__init__::225::IOProcess::(_processLogs) (272257) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:06:21,341::__init__::225::IOProcess::(_processLogs) (272257) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:06:21,343::__init__::225::IOProcess::(_processLogs) (272257) Building response >Thread-18::DEBUG::2014-07-08 16:06:21,344::__init__::225::IOProcess::(_processLogs) (272257) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:21,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::INFO::2014-07-08 16:06:21,349::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:06:21,349::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6940::DEBUG::2014-07-08 16:06:21,351::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7681068-dd10-4e5f-9756-7c8108f2c4ec`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:06:21,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7681068-dd10-4e5f-9756-7c8108f2c4ec`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:06:21,355::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:06:21,358::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:06:21,363::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:06:21,368::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:06:21,370::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:06:21,372::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:06:21,373::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:21,377::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-6940::DEBUG::2014-07-08 16:06:21,377::task::993::Storage.TaskManager.Task::(_decref) Task=`d7681068-dd10-4e5f-9756-7c8108f2c4ec`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:06:21,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:21,384::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:21,388::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:21,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:21,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:21,395::__init__::225::IOProcess::(_processLogs) (272258) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:21,397::__init__::225::IOProcess::(_processLogs) (272258) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:21,398::__init__::225::IOProcess::(_processLogs) (272258) Building response >Thread-18::DEBUG::2014-07-08 16:06:21,400::__init__::225::IOProcess::(_processLogs) (272258) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:21,402::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:06:21,404::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:21,410::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:21,411::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:06:21,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:21,414::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:21,416::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:21,418::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:21,419::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:21,421::__init__::225::IOProcess::(_processLogs) (272259) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:21,423::__init__::225::IOProcess::(_processLogs) (272259) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:21,424::__init__::225::IOProcess::(_processLogs) (272259) Building response >Thread-18::DEBUG::2014-07-08 16:06:21,426::__init__::225::IOProcess::(_processLogs) (272259) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:21,427::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:21,429::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:21,434::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:21,436::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:06:21,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:21,439::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:21,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:21,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:21,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:21,446::__init__::225::IOProcess::(_processLogs) (272260) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:21,447::__init__::225::IOProcess::(_processLogs) (272260) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:21,449::__init__::225::IOProcess::(_processLogs) (272260) Building response >Thread-18::DEBUG::2014-07-08 16:06:21,451::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|(272260) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:21,453::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:21,454::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:06:22,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:22,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174082 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:24,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:24,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175663 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:26,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:27,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.023958 s, 42.7 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:06:28,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`edb5452a-f693-4d5d-8ffe-c07fc31569b5`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:06:28,076::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:06:28,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601459', 'lastCheck': '6.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:06:28,077::task::1191::Storage.TaskManager.Task::(prepare) Task=`edb5452a-f693-4d5d-8ffe-c07fc31569b5`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601459', 'lastCheck': '6.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:06:28,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`edb5452a-f693-4d5d-8ffe-c07fc31569b5`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:06:28,078::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:28,078::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:28,078::task::993::Storage.TaskManager.Task::(_decref) Task=`edb5452a-f693-4d5d-8ffe-c07fc31569b5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:06:29,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:29,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175197 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:06:31,404::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:06:31,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`38563e25-601f-4eef-8931-055e70f8a83b`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:06:31,410::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:06:31,432::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:31,432::task::1191::Storage.TaskManager.Task::(prepare) Task=`38563e25-601f-4eef-8931-055e70f8a83b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:31,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`38563e25-601f-4eef-8931-055e70f8a83b`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:06:31,433::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:31,433::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:31,433::task::993::Storage.TaskManager.Task::(_decref) Task=`38563e25-601f-4eef-8931-055e70f8a83b`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:06:31,447::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:06:31,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c637118-35ad-441f-93da-e66c2f20ecb4`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:06:31,448::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:06:31,449::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`166c47e9-1ca2-4a6b-a22e-3b4488b59792`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:06:31,449::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:06:31,454::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:06:31,454::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`166c47e9-1ca2-4a6b-a22e-3b4488b59792`::Granted request >Thread-6940::DEBUG::2014-07-08 16:06:31,455::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c637118-35ad-441f-93da-e66c2f20ecb4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:06:31,455::task::993::Storage.TaskManager.Task::(_decref) Task=`6c637118-35ad-441f-93da-e66c2f20ecb4`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:06:31,463::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:31,464::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:06:31,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:31,466::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:31,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:31,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:31,467::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:31,467::__init__::225::IOProcess::(_processLogs) (272261) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:06:31,468::__init__::225::IOProcess::(_processLogs) (272261) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:06:31,468::__init__::225::IOProcess::(_processLogs) (272261) Building response >Thread-18::DEBUG::2014-07-08 16:06:31,468::__init__::225::IOProcess::(_processLogs) (272261) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:31,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:31,468::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:06:31,470::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6940::INFO::2014-07-08 16:06:31,619::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Dummy-6860::DEBUG::2014-07-08 16:06:31,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:06:31,628::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000462058 s, 1000 kB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:06:31,629::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c637118-35ad-441f-93da-e66c2f20ecb4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:06:31,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c637118-35ad-441f-93da-e66c2f20ecb4`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:06:31,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:06:31,790::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:06:31,792::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:31,798::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6940::DEBUG::2014-07-08 16:06:31,798::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:06:31,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:06:31,808::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:06:31,812::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:06:31,812::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:06:31,818::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:06:31,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:06:31,825::task::993::Storage.TaskManager.Task::(_decref) Task=`6c637118-35ad-441f-93da-e66c2f20ecb4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:06:31,825::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:31,832::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:31,839::__init__::225::IOProcess::(_processLogs) (272262) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:06:31,845::__init__::225::IOProcess::(_processLogs) (272262) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:06:31,851::__init__::225::IOProcess::(_processLogs) (272262) Building response >Thread-18::DEBUG::2014-07-08 16:06:31,854::__init__::225::IOProcess::(_processLogs) (272262) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:31,857::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:31,860::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:06:31,878::__init__::225::IOProcess::(_processLogs) DEBUG|DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:31,881::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:06:31,882::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:31,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:31,889::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:31,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-6860::DEBUG::2014-07-08 16:06:31,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107465 s, 9.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:06:31,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:31,979::__init__::225::IOProcess::(_processLogs) (272263) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:31,982::__init__::225::IOProcess::(_processLogs) (272263) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:31,986::__init__::225::IOProcess::(_processLogs) (272263) Building response >Thread-18::DEBUG::2014-07-08 16:06:31,989::__init__::225::IOProcess::(_processLogs) (272263) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:31,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:31,993::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:32,001::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:32,003::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:06:32,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:32,008::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:32,011::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:32,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:32,017::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:32,021::__init__::225::IOProcess::(_processLogs) (272264) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:32,024::__init__::225::IOProcess::(_processLogs) (272264) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:32,026::__init__::225::IOProcess::(_processLogs) (272264) Building response >Thread-18::DEBUG::2014-07-08 16:06:32,028::__init__::225::IOProcess::(_processLogs) (272264) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:32,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:32,034::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:32,044::__init__::225::IOProcess::(_processLogs) (272264) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:32,049::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:06:32,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:32,055::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:32,057::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:32,060::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:32,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:32,065::__init__::225::IOProcess::(_processLogs) (272265) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:32,067::__init__::225::IOProcess::(_processLogs) (272265) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:32,070::__init__::225::IOProcess::(_processLogs) (272265) Building response >Thread-18::DEBUG::2014-07-08 16:06:32,073::__init__::225::IOProcess::(_processLogs) (272265) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:32,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:32,079::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:06:34,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:34,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364202 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:36,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:36,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174697 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:38,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:39,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169978 s, 60.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:41,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:41,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175272 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:06:41,864::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:06:41,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`658b7bcd-8db5-4103-b3a2-381f35417401`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:06:41,865::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:06:41,880::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:41,881::task::1191::Storage.TaskManager.Task::(prepare) Task=`658b7bcd-8db5-4103-b3a2-381f35417401`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:41,881::task::595::Storage.TaskManager.Task::(_updateState) Task=`658b7bcd-8db5-4103-b3a2-381f35417401`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:06:41,881::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:41,882::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:41,882::task::993::Storage.TaskManager.Task::(_decref) Task=`658b7bcd-8db5-4103-b3a2-381f35417401`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:06:41,893::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:06:41,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4a54bea-71e9-4f1a-bf39-0dbfba32898d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:06:41,894::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:06:41,895::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f2e15052-2665-47c0-90ed-9d7966ca8438`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:06:41,896::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:06:41,896::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:06:41,896::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f2e15052-2665-47c0-90ed-9d7966ca8438`::Granted request >Thread-6940::DEBUG::2014-07-08 16:06:41,897::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c4a54bea-71e9-4f1a-bf39-0dbfba32898d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:06:41,897::task::993::Storage.TaskManager.Task::(_decref) Task=`c4a54bea-71e9-4f1a-bf39-0dbfba32898d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:06:41,917::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:06:41,917::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4a54bea-71e9-4f1a-bf39-0dbfba32898d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:06:41,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4a54bea-71e9-4f1a-bf39-0dbfba32898d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:06:41,918::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:06:41,918::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:06:41,918::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:06:41,919::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:06:41,919::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:06:41,919::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:06:41,919::task::993::Storage.TaskManager.Task::(_decref) Task=`c4a54bea-71e9-4f1a-bf39-0dbfba32898d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:06:42,088::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:42,089::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:06:42,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:42,089::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:42,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:42,090::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:42,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:42,090::__init__::225::IOProcess::(_processLogs) (272266) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:06:42,090::__init__::225::IOProcess::(_processLogs) (272266) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:06:42,091::__init__::225::IOProcess::(_processLogs) (272266) Building response >Thread-18::DEBUG::2014-07-08 16:06:42,091::__init__::225::IOProcess::(_processLogs) (272266) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:42,092::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:06:42,092::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:06:42,096::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:06:42,246::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000473792 s, 975 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:06:42,249::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:42,250::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:06:42,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:42,250::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:42,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:42,251::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:42,251::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:42,252::__init__::225::IOProcess::(_processLogs) (272267) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:06:42,252::__init__::225::IOProcess::(_processLogs) (272267) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:06:42,252::__init__::225::IOProcess::(_processLogs) DEBUG|(272267) Building response >Thread-18::DEBUG::2014-07-08 16:06:42,252::__init__::225::IOProcess::(_processLogs) (272267) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:42,253::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:06:42,253::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:06:42,255::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:42,256::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:06:42,256::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:42,256::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:42,256::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:42,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:42,257::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:42,257::__init__::225::IOProcess::(_processLogs) (272268) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:42,258::__init__::225::IOProcess::(_processLogs) (272268) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:42,258::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272268) Building response >Thread-18::DEBUG::2014-07-08 16:06:42,258::__init__::225::IOProcess::(_processLogs) (272268) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:42,258::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:42,259::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:42,260::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:42,260::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:06:42,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:42,261::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:42,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:42,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:42,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:42,267::__init__::225::IOProcess::(_processLogs) (272269) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:42,269::__init__::225::IOProcess::(_processLogs) (272269) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:42,270::__init__::225::IOProcess::(_processLogs) (272269) Building response >Thread-18::DEBUG::2014-07-08 16:06:42,271::__init__::225::IOProcess::(_processLogs) (272269) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:42,272::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:42,273::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:42,277::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:42,278::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:06:42,279::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:42,281::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:42,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:42,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:42,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:42,286::__init__::225::IOProcess::(_processLogs) (272270) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:42,287::__init__::225::IOProcess::(_processLogs) (272270) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:42,288::__init__::225::IOProcess::(_processLogs) (272270) Building response >Thread-18::DEBUG::2014-07-08 16:06:42,289::__init__::225::IOProcess::(_processLogs) (272270) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:42,291::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:42,292::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6939::DEBUG::2014-07-08 16:06:43,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`89b108ec-8d64-4475-acf4-b9386e8bb94f`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:06:43,245::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:06:43,245::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473792', 'lastCheck': '0.9', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:06:43,246::task::1191::Storage.TaskManager.Task::(prepare) Task=`89b108ec-8d64-4475-acf4-b9386e8bb94f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473792', 'lastCheck': '0.9', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:06:43,246::task::595::Storage.TaskManager.Task::(_updateState) Task=`89b108ec-8d64-4475-acf4-b9386e8bb94f`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:06:43,246::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:43,246::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:43,247::task::993::Storage.TaskManager.Task::(_decref) Task=`89b108ec-8d64-4475-acf4-b9386e8bb94f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:06:43,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:43,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175962 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:45,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:45,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176892 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:47,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:48,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175512 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:50,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:50,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176264 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:06:51,933::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:06:51,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb959e52-e511-4bbb-aa9f-fd8aba779ce7`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:06:51,935::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:06:51,950::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:51,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb959e52-e511-4bbb-aa9f-fd8aba779ce7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:06:51,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb959e52-e511-4bbb-aa9f-fd8aba779ce7`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:06:51,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:51,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:51,951::task::993::Storage.TaskManager.Task::(_decref) Task=`eb959e52-e511-4bbb-aa9f-fd8aba779ce7`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:06:51,962::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:06:51,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2e537b3-d30e-4bb0-93ae-79d0d7b1d644`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:06:51,963::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:06:51,964::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0e441b9f-4787-418b-a612-22fb5cc0463e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:06:51,965::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:06:51,965::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:06:51,965::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0e441b9f-4787-418b-a612-22fb5cc0463e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:06:51,966::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c2e537b3-d30e-4bb0-93ae-79d0d7b1d644`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:06:51,966::task::993::Storage.TaskManager.Task::(_decref) Task=`c2e537b3-d30e-4bb0-93ae-79d0d7b1d644`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:06:51,986::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:06:51,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`c2e537b3-d30e-4bb0-93ae-79d0d7b1d644`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:06:51,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2e537b3-d30e-4bb0-93ae-79d0d7b1d644`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:06:51,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:06:51,987::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:06:51,988::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:06:51,988::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:06:51,988::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:06:51,989::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:06:51,989::task::993::Storage.TaskManager.Task::(_decref) Task=`c2e537b3-d30e-4bb0-93ae-79d0d7b1d644`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:06:52,298::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:06:52,298::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:06:52,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:52,299::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:52,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:52,299::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:52,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:52,300::__init__::225::IOProcess::(_processLogs) (272271) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:06:52,300::__init__::225::IOProcess::(_processLogs) (272271) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:06:52,300::__init__::225::IOProcess::(_processLogs) (272271) Building response >Thread-18::DEBUG::2014-07-08 16:06:52,300::__init__::225::IOProcess::(_processLogs) (272271) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:52,301::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:52,301::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:06:52,302::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:06:52,456::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000455633 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:06:52,468::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Dummy-6860::DEBUG::2014-07-08 16:06:52,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:06:52,472::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:06:52,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:52,629::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:52,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:52,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:52,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:52,639::__init__::225::IOProcess::(_processLogs) (272272) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:06:52,643::__init__::225::IOProcess::(_processLogs) (272272) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:06:52,646::__init__::225::IOProcess::(_processLogs) (272272) Building response >Thread-18::DEBUG::2014-07-08 16:06:52,650::__init__::225::IOProcess::(_processLogs) (272272) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:52,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:52,656::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:06:52,676::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:06:52,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:52,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:52,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:52,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:52,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:52,696::__init__::225::IOProcess::(_processLogs) (272273) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:52,699::__init__::225::IOProcess::(_processLogs) (272273) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:52,782::__init__::225::IOProcess::(_processLogs) (272273) Building response >Thread-18::DEBUG::2014-07-08 16:06:52,785::__init__::225::IOProcess::(_processLogs) (272273) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:06:52,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0767567 s, 13.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:06:52,788::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:52,797::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:06:52,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:52,803::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:52,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:52,809::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:52,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:52,815::__init__::225::IOProcess::(_processLogs) (272274) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:52,818::__init__::225::IOProcess::(_processLogs) (272274) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:52,821::__init__::225::IOProcess::(_processLogs) (272274) Building response >Thread-18::DEBUG::2014-07-08 16:06:52,824::__init__::225::IOProcess::(_processLogs) (272274) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:52,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:52,830::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:06:52,839::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:06:52,842::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:06:52,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:06:52,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:06:52,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:06:52,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:06:52,855::__init__::225::IOProcess::(_processLogs) (272275) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:06:52,858::__init__::225::IOProcess::(_processLogs) (272275) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:06:52,861::__init__::225::IOProcess::(_processLogs) (272275) Queuing response >Thread-18::DEBUG::2014-07-08 16:06:52,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:06:52,865::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:06:55,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:55,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174428 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:06:57,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:57,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176739 s, 57.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:06:58,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`c169b087-dcb3-40bb-a018-bbf5a0b2d45e`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:06:58,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:06:58,492::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455633', 'lastCheck': '5.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:06:58,492::task::1191::Storage.TaskManager.Task::(prepare) Task=`c169b087-dcb3-40bb-a018-bbf5a0b2d45e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455633', 'lastCheck': '5.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:06:58,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`c169b087-dcb3-40bb-a018-bbf5a0b2d45e`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:06:58,493::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:06:58,493::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:06:58,493::task::993::Storage.TaskManager.Task::(_decref) Task=`c169b087-dcb3-40bb-a018-bbf5a0b2d45e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:06:59,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:06:59,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177973 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:01,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:07:02,024::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:07:02,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cea0e2e-e8ec-491e-bac2-c18d1554e930`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:07:02,042::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:07:02,064::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:02,071::task::1191::Storage.TaskManager.Task::(prepare) Task=`5cea0e2e-e8ec-491e-bac2-c18d1554e930`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:02,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cea0e2e-e8ec-491e-bac2-c18d1554e930`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:07:02,078::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:07:02,165::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-6860::DEBUG::2014-07-08 16:07:02,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0716011 s, 14.3 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:07:02,171::task::993::Storage.TaskManager.Task::(_decref) Task=`5cea0e2e-e8ec-491e-bac2-c18d1554e930`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:07:02,276::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:07:02,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbd79180-2c70-402d-abe0-3eb181d970ff`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:07:02,286::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:07:02,290::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`33af0acd-f84f-4a9f-a468-ccb0b259cb0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:07:02,292::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:07:02,294::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:07:02,296::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`33af0acd-f84f-4a9f-a468-ccb0b259cb0b`::Granted request >Thread-6940::DEBUG::2014-07-08 16:07:02,299::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bbd79180-2c70-402d-abe0-3eb181d970ff`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:07:02,304::task::993::Storage.TaskManager.Task::(_decref) Task=`bbd79180-2c70-402d-abe0-3eb181d970ff`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:07:02,338::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:02,339::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbd79180-2c70-402d-abe0-3eb181d970ff`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:02,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbd79180-2c70-402d-abe0-3eb181d970ff`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:07:02,340::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:07:02,340::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:07:02,340::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:07:02,341::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:07:02,341::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:07:02,341::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:07:02,342::task::993::Storage.TaskManager.Task::(_decref) Task=`bbd79180-2c70-402d-abe0-3eb181d970ff`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:07:02,878::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:02,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:02,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:02,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:02,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:02,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:02,879::__init__::225::IOProcess::(_processLogs) (272276) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:02,880::__init__::225::IOProcess::(_processLogs) (272276) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:02,880::__init__::225::IOProcess::(_processLogs) (272276) Building response >Thread-18::DEBUG::2014-07-08 16:07:02,880::__init__::225::IOProcess::(_processLogs) (272276) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:02,880::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:07:02,881::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:07:02,882::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:07:03,027::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000477702 s, 967 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:07:03,030::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:03,030::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:03,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:03,031::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:03,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:03,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:03,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:03,032::__init__::225::IOProcess::(_processLogs) (272277) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:03,032::__init__::225::IOProcess::(_processLogs) (272277) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:03,032::__init__::225::IOProcess::(_processLogs) (272277) Building response >Thread-18::DEBUG::2014-07-08 16:07:03,033::__init__::225::IOProcess::(_processLogs) (272277) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:03,033::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:03,033::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:07:03,035::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:03,036::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:07:03,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:03,036::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:03,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:03,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:03,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:03,037::__init__::225::IOProcess::(_processLogs) (272278) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:03,038::__init__::225::IOProcess::(_processLogs) (272278) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:03,038::__init__::225::IOProcess::(_processLogs) (272278) Building response >Thread-18::DEBUG::2014-07-08 16:07:03,038::__init__::225::IOProcess::(_processLogs) (272278) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:03,038::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:03,039::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:03,040::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:03,040::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:07:03,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:03,041::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:03,041::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:03,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:03,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:03,042::__init__::225::IOProcess::(_processLogs) (272279) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:03,042::__init__::225::IOProcess::(_processLogs) (272279) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:03,042::__init__::225::IOProcess::(_processLogs) (272279) Building response >Thread-18::DEBUG::2014-07-08 16:07:03,043::__init__::225::IOProcess::(_processLogs) (272279) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:03,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:03,043::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:03,044::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:03,044::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:07:03,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:03,045::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:03,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:03,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:03,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:03,046::__init__::225::IOProcess::(_processLogs) (272280) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:03,046::__init__::225::IOProcess::(_processLogs) (272280) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:03,047::__init__::225::IOProcess::(_processLogs) (272280) Building response >Thread-18::DEBUG::2014-07-08 16:07:03,047::__init__::225::IOProcess::(_processLogs) (272280) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:03,047::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:03,047::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:07:04,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:04,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313442 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:06,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:06,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175278 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:08,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:09,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174423 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:11,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:11,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176065 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:07:12,355::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:07:12,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ccf9ece-cf9f-4af1-a149-b7cc6b311542`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:07:12,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:07:12,372::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:12,372::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ccf9ece-cf9f-4af1-a149-b7cc6b311542`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:12,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ccf9ece-cf9f-4af1-a149-b7cc6b311542`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:07:12,373::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:07:12,373::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:07:12,373::task::993::Storage.TaskManager.Task::(_decref) Task=`4ccf9ece-cf9f-4af1-a149-b7cc6b311542`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:07:12,386::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:07:12,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`51acb04f-dbca-47fb-b656-9fcd668d3a2f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:07:12,387::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:07:12,388::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`60c8e3ef-0ef6-41f7-a6f6-3d6d3c758f1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:07:12,389::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:07:12,389::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:07:12,389::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`60c8e3ef-0ef6-41f7-a6f6-3d6d3c758f1c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:07:12,390::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`51acb04f-dbca-47fb-b656-9fcd668d3a2f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:07:12,390::task::993::Storage.TaskManager.Task::(_decref) Task=`51acb04f-dbca-47fb-b656-9fcd668d3a2f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:07:12,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:12,410::task::1191::Storage.TaskManager.Task::(prepare) Task=`51acb04f-dbca-47fb-b656-9fcd668d3a2f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:12,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`51acb04f-dbca-47fb-b656-9fcd668d3a2f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:07:12,411::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:07:12,411::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:07:12,411::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:07:12,412::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:07:12,412::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:07:12,412::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:07:12,413::task::993::Storage.TaskManager.Task::(_decref) Task=`51acb04f-dbca-47fb-b656-9fcd668d3a2f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:07:13,051::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:13,051::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:13,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:13,052::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:13,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:13,052::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:13,053::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:13,053::__init__::225::IOProcess::(_processLogs) (272281) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:13,053::__init__::225::IOProcess::(_processLogs) (272281) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:13,053::__init__::225::IOProcess::(_processLogs) (272281) Building response >Thread-18::DEBUG::2014-07-08 16:07:13,053::__init__::225::IOProcess::(_processLogs) (272281) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:13,054::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:13,054::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:07:13,056::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:07:13,207::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000481333 s, 960 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:07:13,212::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:13,214::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:13,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:13,216::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:13,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:13,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:13,220::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:13,221::__init__::225::IOProcess::(_processLogs) (272282) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:13,223::__init__::225::IOProcess::(_processLogs) (272282) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:13,224::__init__::225::IOProcess::(_processLogs) (272282) Building response >Thread-18::DEBUG::2014-07-08 16:07:13,226::__init__::225::IOProcess::(_processLogs) (272282) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:13,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:13,228::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:07:13,237::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:13,238::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:07:13,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:13,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:13,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:13,244::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:13,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:13,246::__init__::225::IOProcess::(_processLogs) (272283) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:13,248::__init__::225::IOProcess::(_processLogs) (272283) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:13,249::__init__::225::IOProcess::(_processLogs) (272283) Building response >Thread-18::DEBUG::2014-07-08 16:07:13,251::__init__::225::IOProcess::(_processLogs) (272283) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:13,252::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:13,253::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:13,259::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:13,260::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:07:13,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:13,262::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:13,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:13,265::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:13,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:13,268::__init__::225::IOProcess::(_processLogs) (272284) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:13,269::__init__::225::IOProcess::(_processLogs) (272284) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:13,271::__init__::225::IOProcess::(_processLogs) (272284) Building response >Thread-18::DEBUG::2014-07-08 16:07:13,272::__init__::225::IOProcess::(_processLogs) (272284) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:13,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:13,275::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:13,280::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:07:13,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:13,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:13,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:13,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:13,286::__init__::225::IOProcess::(_processLogs) (272285) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:13,288::__init__::225::IOProcess::(_processLogs) (272285) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:13,289::__init__::225::IOProcess::(_processLogs) (272285) Building response >Thread-18::DEBUG::2014-07-08 16:07:13,290::__init__::225::IOProcess::(_processLogs) (272285) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:13,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:13,293::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:07:13,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:13,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175537 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:07:13,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fa89b03-7169-4134-bc75-43417c167ab3`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:07:13,696::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:07:13,698::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481333', 'lastCheck': '0.4', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:07:13,699::task::1191::Storage.TaskManager.Task::(prepare) Task=`6fa89b03-7169-4134-bc75-43417c167ab3`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481333', 'lastCheck': '0.4', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:07:13,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fa89b03-7169-4134-bc75-43417c167ab3`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:07:13,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:07:13,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:07:13,702::task::993::Storage.TaskManager.Task::(_decref) Task=`6fa89b03-7169-4134-bc75-43417c167ab3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:07:15,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:15,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017559 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:18,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:18,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173543 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:20,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:20,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428038 s, 23.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:07:22,427::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:07:22,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`b70d82ac-079e-43bf-98bc-61dafcd6db62`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:07:22,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:07:22,443::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:22,444::task::1191::Storage.TaskManager.Task::(prepare) Task=`b70d82ac-079e-43bf-98bc-61dafcd6db62`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:22,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`b70d82ac-079e-43bf-98bc-61dafcd6db62`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:07:22,444::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:07:22,444::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:07:22,445::task::993::Storage.TaskManager.Task::(_decref) Task=`b70d82ac-079e-43bf-98bc-61dafcd6db62`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:07:22,456::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:07:22,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3e9fefd-bd33-4543-881e-56b65e202897`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:07:22,457::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:07:22,458::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9313fe9a-64f1-4520-af9f-848dec49cf5c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:07:22,458::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:07:22,459::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:07:22,459::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9313fe9a-64f1-4520-af9f-848dec49cf5c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:07:22,460::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a3e9fefd-bd33-4543-881e-56b65e202897`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:07:22,460::task::993::Storage.TaskManager.Task::(_decref) Task=`a3e9fefd-bd33-4543-881e-56b65e202897`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:07:22,479::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:22,480::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3e9fefd-bd33-4543-881e-56b65e202897`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:22,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3e9fefd-bd33-4543-881e-56b65e202897`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:07:22,480::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:07:22,480::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:07:22,481::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:07:22,481::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:07:22,481::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:07:22,482::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:07:22,482::task::993::Storage.TaskManager.Task::(_decref) Task=`a3e9fefd-bd33-4543-881e-56b65e202897`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:07:22,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:22,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182558 s, 56.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:07:23,299::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:23,299::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:23,300::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:23,300::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:23,300::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:23,300::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:23,301::__init__::225::IOProcess::(_processLogs) (272286) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:23,301::__init__::225::IOProcess::(_processLogs) (272286) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:23,301::__init__::225::IOProcess::(_processLogs) (272286) Building response >Thread-18::DEBUG::2014-07-08 16:07:23,301::__init__::225::IOProcess::(_processLogs) (272286) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:23,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:23,302::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:07:23,304::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:07:23,455::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000518209 s, 892 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:07:23,461::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:23,462::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:23,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:23,466::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:23,468::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:23,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:23,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:23,473::__init__::225::IOProcess::(_processLogs) (272287) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:23,474::__init__::225::IOProcess::(_processLogs) (272287) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:23,476::__init__::225::IOProcess::(_processLogs) (272287) Building response >Thread-18::DEBUG::2014-07-08 16:07:23,477::__init__::225::IOProcess::(_processLogs) (272287) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:23,478::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:23,480::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:07:23,492::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:23,494::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:07:23,497::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:23,498::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:23,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:23,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:23,501::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:23,502::__init__::225::IOProcess::(_processLogs) (272288) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:23,504::__init__::225::IOProcess::(_processLogs) (272288) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:23,505::__init__::225::IOProcess::(_processLogs) (272288) Building response >Thread-18::DEBUG::2014-07-08 16:07:23,506::__init__::225::IOProcess::(_processLogs) (272288) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:23,507::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:23,508::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:23,513::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:23,515::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:07:23,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:23,518::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:23,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:23,521::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:23,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:23,524::__init__::225::IOProcess::(_processLogs) (272289) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:23,525::__init__::225::IOProcess::(_processLogs) (272289) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:23,527::__init__::225::IOProcess::(_processLogs) (272289) Building response >Thread-18::DEBUG::2014-07-08 16:07:23,528::__init__::225::IOProcess::(_processLogs) (272289) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:23,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:23,531::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:23,535::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:23,537::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:07:23,539::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:23,540::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:23,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:23,543::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:23,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:23,546::__init__::225::IOProcess::(_processLogs) (272290) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:23,547::__init__::225::IOProcess::(_processLogs) (272290) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:23,548::__init__::225::IOProcess::(_processLogs) (272290) Building response >Thread-18::DEBUG::2014-07-08 16:07:23,550::__init__::225::IOProcess::(_processLogs) (272290) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:23,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:23,553::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:07:24,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:25,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173858 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:27,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:27,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175998 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:07:28,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`bce2aad0-eb05-48d1-92be-799974c19fe8`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:07:28,888::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:07:28,888::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518209', 'lastCheck': '5.3', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:07:28,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`bce2aad0-eb05-48d1-92be-799974c19fe8`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518209', 'lastCheck': '5.3', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:07:28,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`bce2aad0-eb05-48d1-92be-799974c19fe8`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:07:28,889::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:07:28,889::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:07:28,889::task::993::Storage.TaskManager.Task::(_decref) Task=`bce2aad0-eb05-48d1-92be-799974c19fe8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:07:29,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:29,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175244 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:31,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:32,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017532 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:07:32,499::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:07:32,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5cfa194-ebd2-444f-950f-6d0133fbb821`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:07:32,500::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:07:32,517::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:32,517::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5cfa194-ebd2-444f-950f-6d0133fbb821`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:32,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5cfa194-ebd2-444f-950f-6d0133fbb821`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:07:32,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:07:32,518::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:07:32,519::task::993::Storage.TaskManager.Task::(_decref) Task=`b5cfa194-ebd2-444f-950f-6d0133fbb821`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:07:32,530::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:07:32,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d8da798-1ea4-4f28-83ee-7b30868562f2`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:07:32,531::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:07:32,532::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bc155606-df4f-46a7-8dae-5b4cca2d678f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:07:32,533::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:07:32,533::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:07:32,533::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bc155606-df4f-46a7-8dae-5b4cca2d678f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:07:32,534::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d8da798-1ea4-4f28-83ee-7b30868562f2`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:07:32,535::task::993::Storage.TaskManager.Task::(_decref) Task=`8d8da798-1ea4-4f28-83ee-7b30868562f2`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:07:32,554::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:32,554::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d8da798-1ea4-4f28-83ee-7b30868562f2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:32,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d8da798-1ea4-4f28-83ee-7b30868562f2`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:07:32,555::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:07:32,555::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:07:32,556::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:07:32,556::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:07:32,556::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:07:32,557::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:07:32,557::task::993::Storage.TaskManager.Task::(_decref) Task=`8d8da798-1ea4-4f28-83ee-7b30868562f2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:07:33,561::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:33,562::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:33,564::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:33,565::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:33,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:33,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:33,570::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:33,571::__init__::225::IOProcess::(_processLogs) (272291) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:33,573::__init__::225::IOProcess::(_processLogs) (272291) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:33,574::__init__::225::IOProcess::(_processLogs) (272291) Building response >Thread-18::DEBUG::2014-07-08 16:07:33,575::__init__::225::IOProcess::(_processLogs) (272291) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:33,576::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:33,578::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:07:33,584::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:07:33,733::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000462338 s, 999 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:07:33,741::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:33,745::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:33,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:33,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:33,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:33,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:33,758::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:33,760::__init__::225::IOProcess::(_processLogs) (272292) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:33,764::__init__::225::IOProcess::(_processLogs) (272292) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:33,767::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272292) Building response >Thread-18::DEBUG::2014-07-08 16:07:33,770::__init__::225::IOProcess::(_processLogs) (272292) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:33,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:33,777::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:07:33,793::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:33,796::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:07:33,799::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:33,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:33,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:33,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:33,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:33,813::__init__::225::IOProcess::(_processLogs) (272293) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:33,816::__init__::225::IOProcess::(_processLogs) (272293) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:33,819::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272293) Building response >Thread-18::DEBUG::2014-07-08 16:07:33,822::__init__::225::IOProcess::(_processLogs) (272293) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:33,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:33,827::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:33,839::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:33,842::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:07:33,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:33,848::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:33,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:33,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:33,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:33,860::__init__::225::IOProcess::(_processLogs) (272294) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:33,863::__init__::225::IOProcess::(_processLogs) (272294) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:33,866::__init__::225::IOProcess::(_processLogs) (272294) Building response >Thread-18::DEBUG::2014-07-08 16:07:33,869::__init__::225::IOProcess::(_processLogs) (272294) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:33,871::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:07:33,874::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:33,890::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:33,892::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:07:33,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:33,898::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:33,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:33,903::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:33,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:33,910::__init__::225::IOProcess::(_processLogs) (272295) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:33,914::__init__::225::IOProcess::(_processLogs) (272295) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:33,917::__init__::225::IOProcess::(_processLogs) (272295) Building response >Thread-18::DEBUG::2014-07-08 16:07:33,920::__init__::225::IOProcess::(_processLogs) (272295) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:33,923::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:33,926::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:07:34,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:34,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0745129 s, 13.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:36,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:36,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174861 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:38,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:39,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017337 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:41,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:41,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174143 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:07:42,571::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:07:42,572::task::595::Storage.TaskManager.Task::(_updateState) Task=`151d30db-033b-4a7e-8582-2e80ac14b10b`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:07:42,572::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:07:42,587::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:42,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`151d30db-033b-4a7e-8582-2e80ac14b10b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:42,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`151d30db-033b-4a7e-8582-2e80ac14b10b`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:07:42,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:07:42,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:07:42,589::task::993::Storage.TaskManager.Task::(_decref) Task=`151d30db-033b-4a7e-8582-2e80ac14b10b`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:07:42,600::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:07:42,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`053d9a4e-771c-4b19-aa3c-19eb7090ff74`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:07:42,601::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:07:42,602::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7483a6f5-53e3-4f2d-846c-f5d98e591311`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:07:42,602::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:07:42,603::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:07:42,603::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7483a6f5-53e3-4f2d-846c-f5d98e591311`::Granted request >Thread-6940::DEBUG::2014-07-08 16:07:42,604::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`053d9a4e-771c-4b19-aa3c-19eb7090ff74`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:07:42,604::task::993::Storage.TaskManager.Task::(_decref) Task=`053d9a4e-771c-4b19-aa3c-19eb7090ff74`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:07:42,623::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:42,624::task::1191::Storage.TaskManager.Task::(prepare) Task=`053d9a4e-771c-4b19-aa3c-19eb7090ff74`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:42,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`053d9a4e-771c-4b19-aa3c-19eb7090ff74`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:07:42,624::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:07:42,624::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:07:42,625::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:07:42,625::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:07:42,625::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:07:42,626::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:07:42,626::task::993::Storage.TaskManager.Task::(_decref) Task=`053d9a4e-771c-4b19-aa3c-19eb7090ff74`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:07:43,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:43,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175029 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:07:43,937::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:43,937::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:43,937::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:43,938::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:43,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:43,938::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:43,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:43,939::__init__::225::IOProcess::(_processLogs) (272296) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:43,939::__init__::225::IOProcess::(_processLogs) (272296) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:43,939::__init__::225::IOProcess::(_processLogs) (272296) Building response >Thread-18::DEBUG::2014-07-08 16:07:43,939::__init__::225::IOProcess::(_processLogs) (272296) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:43,940::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:43,940::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:07:43,942::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:07:44,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000433004 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:07:44,094::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:44,096::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6939::DEBUG::2014-07-08 16:07:44,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`05f8450d-5d0d-4657-b0db-ecbbd819be5f`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:07:44,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6939::INFO::2014-07-08 16:07:44,099::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::DEBUG::2014-07-08 16:07:44,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6939::INFO::2014-07-08 16:07:44,101::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462338', 'lastCheck': '10.2', 'valid': True}} >Thread-18::DEBUG::2014-07-08 16:07:44,102::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-6939::DEBUG::2014-07-08 16:07:44,103::task::1191::Storage.TaskManager.Task::(prepare) Task=`05f8450d-5d0d-4657-b0db-ecbbd819be5f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462338', 'lastCheck': '10.2', 'valid': True}} >Thread-18::DEBUG::2014-07-08 16:07:44,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6939::DEBUG::2014-07-08 16:07:44,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`05f8450d-5d0d-4657-b0db-ecbbd819be5f`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:07:44,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6939::DEBUG::2014-07-08 16:07:44,105::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:07:44,107::__init__::225::IOProcess::(_processLogs) (272297) Finding callback 'statvfs'... >Thread-6939::DEBUG::2014-07-08 16:07:44,107::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:07:44,108::__init__::225::IOProcess::(_processLogs) (272297) Got request for method 'statvfs' >Thread-6939::DEBUG::2014-07-08 16:07:44,108::task::993::Storage.TaskManager.Task::(_decref) Task=`05f8450d-5d0d-4657-b0db-ecbbd819be5f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:07:44,109::__init__::225::IOProcess::(_processLogs) (272297) Building response >Thread-18::DEBUG::2014-07-08 16:07:44,111::__init__::225::IOProcess::(_processLogs) (272297) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:44,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:44,116::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:07:44,127::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:44,128::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:07:44,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:44,130::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:44,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:44,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:44,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:44,135::__init__::225::IOProcess::(_processLogs) (272298) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:44,136::__init__::225::IOProcess::(_processLogs) (272298) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:44,138::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272298) Building response >Thread-18::DEBUG::2014-07-08 16:07:44,139::__init__::225::IOProcess::(_processLogs) (272298) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:44,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:44,141::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:44,142::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:44,143::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:07:44,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:44,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:44,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:44,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:44,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:44,144::__init__::225::IOProcess::(_processLogs) (272299) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:44,145::__init__::225::IOProcess::(_processLogs) (272299) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:44,145::__init__::225::IOProcess::(_processLogs) (272299) Building response >Thread-18::DEBUG::2014-07-08 16:07:44,145::__init__::225::IOProcess::(_processLogs) (272299) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:44,145::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:44,145::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:44,147::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:44,147::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:07:44,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:44,147::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:44,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:44,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:44,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:44,148::__init__::225::IOProcess::(_processLogs) (272300) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:44,149::__init__::225::IOProcess::(_processLogs) (272300) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:44,149::__init__::225::IOProcess::(_processLogs) (272300) Building response >Thread-18::DEBUG::2014-07-08 16:07:44,149::__init__::225::IOProcess::(_processLogs) (272300) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:44,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:44,149::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:07:45,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:45,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174182 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:47,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:48,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177367 s, 57.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:50,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:50,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177976 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:52,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:07:52,697::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:07:52,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`095a8816-8e7a-4e32-a42d-7c9acfa8c743`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:07:52,708::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:07:52,798::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:07:52,799::task::1191::Storage.TaskManager.Task::(prepare) Task=`095a8816-8e7a-4e32-a42d-7c9acfa8c743`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:07:52,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243628 s, 42.0 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:07:52,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`095a8816-8e7a-4e32-a42d-7c9acfa8c743`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:07:52,802::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:07:52,803::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:07:52,804::task::993::Storage.TaskManager.Task::(_decref) Task=`095a8816-8e7a-4e32-a42d-7c9acfa8c743`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:07:52,818::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:07:52,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`55bc3d40-26e1-4291-b066-7026a8b5ea3a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:07:52,822::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:07:52,825::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f50b3bea-07fd-44a7-ab3f-a211b6e07ede`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:07:52,826::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:07:52,828::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:07:52,828::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f50b3bea-07fd-44a7-ab3f-a211b6e07ede`::Granted request >Thread-6940::DEBUG::2014-07-08 16:07:52,831::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`55bc3d40-26e1-4291-b066-7026a8b5ea3a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:07:52,832::task::993::Storage.TaskManager.Task::(_decref) Task=`55bc3d40-26e1-4291-b066-7026a8b5ea3a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:07:52,860::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:52,860::task::1191::Storage.TaskManager.Task::(prepare) Task=`55bc3d40-26e1-4291-b066-7026a8b5ea3a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:07:52,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`55bc3d40-26e1-4291-b066-7026a8b5ea3a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:07:52,861::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:07:52,861::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:07:52,861::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:07:52,862::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:07:52,862::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:07:52,862::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:07:52,862::task::993::Storage.TaskManager.Task::(_decref) Task=`55bc3d40-26e1-4291-b066-7026a8b5ea3a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:07:54,153::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:54,153::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:54,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:54,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:54,154::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:54,154::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:54,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:54,155::__init__::225::IOProcess::(_processLogs) (272301) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:54,155::__init__::225::IOProcess::(_processLogs) (272301) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:54,155::__init__::225::IOProcess::(_processLogs) (272301) Building response >Thread-18::DEBUG::2014-07-08 16:07:54,156::__init__::225::IOProcess::(_processLogs) (272301) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:54,156::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:07:54,156::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:07:54,158::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:07:54,311::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000567376 s, 814 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:07:54,313::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:54,313::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:07:54,313::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:54,314::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:54,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:54,314::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:54,314::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:54,315::__init__::225::IOProcess::(_processLogs) (272302) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:07:54,315::__init__::225::IOProcess::(_processLogs) (272302) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:07:54,315::__init__::225::IOProcess::(_processLogs) (272302) Building response >Thread-18::DEBUG::2014-07-08 16:07:54,315::__init__::225::IOProcess::(_processLogs) (272302) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:54,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:54,316::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:07:54,318::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:07:54,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:54,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:54,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:54,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:54,319::__init__::225::IOProcess::(_processLogs) (272303) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:54,320::__init__::225::IOProcess::(_processLogs) (272303) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:54,320::__init__::225::IOProcess::(_processLogs) (272303) Building response >Thread-18::DEBUG::2014-07-08 16:07:54,320::__init__::225::IOProcess::(_processLogs) (272303) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:54,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:54,321::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:54,322::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:07:54,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:54,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:54,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:54,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:54,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:54,323::__init__::225::IOProcess::(_processLogs) (272304) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:54,323::__init__::225::IOProcess::(_processLogs) (272304) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:54,324::__init__::225::IOProcess::(_processLogs) (272304) Building response >Thread-18::DEBUG::2014-07-08 16:07:54,324::__init__::225::IOProcess::(_processLogs) (272304) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:54,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:54,324::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:07:54,325::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:07:54,326::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:07:54,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:07:54,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:07:54,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:07:54,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:07:54,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:07:54,327::__init__::225::IOProcess::(_processLogs) (272305) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:07:54,327::__init__::225::IOProcess::(_processLogs) (272305) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:07:54,328::__init__::225::IOProcess::(_processLogs) (272305) Building response >Thread-18::DEBUG::2014-07-08 16:07:54,328::__init__::225::IOProcess::(_processLogs) (272305) Queuing response >Thread-18::DEBUG::2014-07-08 16:07:54,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:07:54,328::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:07:54,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:55,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174621 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:07:57,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:57,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327729 s, 31.2 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:07:59,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`a010431b-72b4-4c2d-8e6a-67d920a55f6d`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:07:59,288::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:07:59,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567376', 'lastCheck': '5.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:07:59,289::task::1191::Storage.TaskManager.Task::(prepare) Task=`a010431b-72b4-4c2d-8e6a-67d920a55f6d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567376', 'lastCheck': '5.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:07:59,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`a010431b-72b4-4c2d-8e6a-67d920a55f6d`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:07:59,289::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:07:59,289::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:07:59,290::task::993::Storage.TaskManager.Task::(_decref) Task=`a010431b-72b4-4c2d-8e6a-67d920a55f6d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:07:59,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:07:59,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175845 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:01,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:01,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184969 s, 55.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:08:02,876::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:08:02,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`211359ce-aab6-4684-956d-24a580a94b06`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:08:02,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:08:02,892::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:02,893::task::1191::Storage.TaskManager.Task::(prepare) Task=`211359ce-aab6-4684-956d-24a580a94b06`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:02,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`211359ce-aab6-4684-956d-24a580a94b06`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:08:02,893::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:08:02,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:08:02,894::task::993::Storage.TaskManager.Task::(_decref) Task=`211359ce-aab6-4684-956d-24a580a94b06`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:08:02,908::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:08:02,909::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8dfaf5c-6c33-4bfb-a286-97b8ee471279`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:08:02,910::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:08:02,911::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7b57d0ce-f1fb-4003-bced-b5615559bdfb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:08:02,911::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:08:02,912::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:08:02,912::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7b57d0ce-f1fb-4003-bced-b5615559bdfb`::Granted request >Thread-6940::DEBUG::2014-07-08 16:08:02,917::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f8dfaf5c-6c33-4bfb-a286-97b8ee471279`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:08:02,917::task::993::Storage.TaskManager.Task::(_decref) Task=`f8dfaf5c-6c33-4bfb-a286-97b8ee471279`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:08:02,937::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:02,937::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8dfaf5c-6c33-4bfb-a286-97b8ee471279`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:02,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8dfaf5c-6c33-4bfb-a286-97b8ee471279`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:08:02,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:08:02,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:08:02,938::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:08:02,939::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:08:02,939::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:08:02,939::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:08:02,940::task::993::Storage.TaskManager.Task::(_decref) Task=`f8dfaf5c-6c33-4bfb-a286-97b8ee471279`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:08:03,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:04,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368716 s, 27.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:04,417::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:04,424::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:04,428::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:04,430::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:04,434::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:04,437::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:04,441::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:04,444::__init__::225::IOProcess::(_processLogs) (272306) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:04,449::__init__::225::IOProcess::(_processLogs) (272306) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:04,452::__init__::225::IOProcess::(_processLogs) (272306) Building response >Thread-18::DEBUG::2014-07-08 16:08:04,455::__init__::225::IOProcess::(_processLogs) (272306) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:04,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:04,460::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:08:04,471::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:08:04,630::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000540837 s, 854 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:04,637::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:04,639::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:04,642::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:04,644::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:04,646::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:04,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:04,649::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:04,651::__init__::225::IOProcess::(_processLogs) (272307) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:04,654::__init__::225::IOProcess::(_processLogs) (272307) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:04,656::__init__::225::IOProcess::(_processLogs) (272307) Building response >Thread-18::DEBUG::2014-07-08 16:08:04,658::__init__::225::IOProcess::(_processLogs) (272307) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:04,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:04,664::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:08:04,678::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:04,681::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:08:04,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:04,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:04,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:04,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:04,693::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:04,695::__init__::225::IOProcess::(_processLogs) (272308) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:04,697::__init__::225::IOProcess::(_processLogs) (272308) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:04,700::__init__::225::IOProcess::(_processLogs) (272308) Building response >Thread-18::DEBUG::2014-07-08 16:08:04,702::__init__::225::IOProcess::(_processLogs) (272308) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:04,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:04,707::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:04,716::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:04,718::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:08:04,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:04,724::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:04,726::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:04,729::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:04,731::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:04,733::__init__::225::IOProcess::(_processLogs) (272309) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:04,735::__init__::225::IOProcess::(_processLogs) (272309) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:04,738::__init__::225::IOProcess::(_processLogs) (272309) Building response >Thread-18::DEBUG::2014-07-08 16:08:04,741::__init__::225::IOProcess::(_processLogs) (272309) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:04,743::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:04,745::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:04,753::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:04,756::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:08:04,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:04,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:04,763::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:04,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:04,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:04,771::__init__::225::IOProcess::(_processLogs) (272310) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:04,773::__init__::225::IOProcess::(_processLogs) (272310) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:04,776::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(272310) Building response >Thread-18::DEBUG::2014-07-08 16:08:04,778::__init__::225::IOProcess::(_processLogs) (272310) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:04,780::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:04,782::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:08:06,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:07,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175713 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:09,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:09,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175875 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:11,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:11,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421856 s, 24.3 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:08:12,955::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:08:12,956::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0afdf07-8537-40f0-aea5-34c40317ac69`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:08:12,957::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:08:12,971::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:12,972::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0afdf07-8537-40f0-aea5-34c40317ac69`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:12,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0afdf07-8537-40f0-aea5-34c40317ac69`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:08:12,972::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:08:12,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:08:12,973::task::993::Storage.TaskManager.Task::(_decref) Task=`a0afdf07-8537-40f0-aea5-34c40317ac69`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:08:12,984::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:08:12,985::task::595::Storage.TaskManager.Task::(_updateState) Task=`7649a297-c334-4ca8-8d50-a770259ac18e`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:08:12,985::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:08:12,986::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`04c6f3f1-7749-4284-9da7-ec253e266dec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:08:12,986::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:08:12,987::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:08:12,987::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`04c6f3f1-7749-4284-9da7-ec253e266dec`::Granted request >Thread-6940::DEBUG::2014-07-08 16:08:12,988::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7649a297-c334-4ca8-8d50-a770259ac18e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:08:12,988::task::993::Storage.TaskManager.Task::(_decref) Task=`7649a297-c334-4ca8-8d50-a770259ac18e`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:08:13,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:13,007::task::1191::Storage.TaskManager.Task::(prepare) Task=`7649a297-c334-4ca8-8d50-a770259ac18e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:13,008::task::595::Storage.TaskManager.Task::(_updateState) Task=`7649a297-c334-4ca8-8d50-a770259ac18e`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:08:13,008::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:08:13,008::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:08:13,008::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:08:13,009::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:08:13,009::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:08:13,009::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:08:13,010::task::993::Storage.TaskManager.Task::(_decref) Task=`7649a297-c334-4ca8-8d50-a770259ac18e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:08:13,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:13,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174213 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:08:14,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ab4639f-8967-4a04-8a29-6faba47b8214`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:08:14,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:08:14,565::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540837', 'lastCheck': '9.8', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:08:14,565::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ab4639f-8967-4a04-8a29-6faba47b8214`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540837', 'lastCheck': '9.8', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:08:14,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ab4639f-8967-4a04-8a29-6faba47b8214`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:08:14,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:08:14,566::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:08:14,567::task::993::Storage.TaskManager.Task::(_decref) Task=`5ab4639f-8967-4a04-8a29-6faba47b8214`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:08:14,790::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:14,790::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:14,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:14,791::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:14,791::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:14,791::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:14,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:14,792::__init__::225::IOProcess::(_processLogs) (272311) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:14,792::__init__::225::IOProcess::(_processLogs) (272311) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:14,792::__init__::225::IOProcess::(_processLogs) (272311) Building response >Thread-18::DEBUG::2014-07-08 16:08:14,792::__init__::225::IOProcess::(_processLogs) (272311) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:14,793::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:14,793::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:08:14,794::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:08:14,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000452001 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:14,952::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:15,035::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:15,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:15,039::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:15,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:15,043::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:15,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:15,047::__init__::225::IOProcess::(_processLogs) (272312) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:15,048::__init__::225::IOProcess::(_processLogs) (272312) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:15,050::__init__::225::IOProcess::(_processLogs) (272312) Building response >Thread-18::DEBUG::2014-07-08 16:08:15,052::__init__::225::IOProcess::(_processLogs) (272312) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:15,054::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:15,056::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:08:15,086::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:15,088::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:08:15,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:15,091::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:15,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:15,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:15,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:15,098::__init__::225::IOProcess::(_processLogs) DEBUG|(272313) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:15,099::__init__::225::IOProcess::(_processLogs) (272313) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:15,101::__init__::225::IOProcess::(_processLogs) (272313) Building response >Thread-18::DEBUG::2014-07-08 16:08:15,103::__init__::225::IOProcess::(_processLogs) (272313) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:15,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:15,106::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:15,112::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:15,112::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:08:15,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:15,113::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:15,114::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:15,114::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:15,114::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:15,115::__init__::225::IOProcess::(_processLogs) (272314) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:15,115::__init__::225::IOProcess::(_processLogs) (272314) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:15,116::__init__::225::IOProcess::(_processLogs) (272314) Building response >Thread-18::DEBUG::2014-07-08 16:08:15,120::__init__::225::IOProcess::(_processLogs) (272314) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:15,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:15,123::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:15,129::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:15,130::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:08:15,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:15,134::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:15,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:15,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:15,139::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:15,140::__init__::225::IOProcess::(_processLogs) (272315) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:15,142::__init__::225::IOProcess::(_processLogs) (272315) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:15,143::__init__::225::IOProcess::(_processLogs) (272315) Building response >Thread-18::DEBUG::2014-07-08 16:08:15,145::__init__::225::IOProcess::(_processLogs) (272315) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:15,146::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:08:15,148::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:08:15,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:16,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176627 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:18,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:18,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0221045 s, 46.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:20,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:20,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246307 s, 41.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:22,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:23,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175501 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:08:23,047::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:08:23,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`71c2d67d-29a8-4faa-92fa-e5fc0bb02a99`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:08:23,052::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:08:23,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:23,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`71c2d67d-29a8-4faa-92fa-e5fc0bb02a99`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:23,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`71c2d67d-29a8-4faa-92fa-e5fc0bb02a99`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:08:23,070::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:08:23,071::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:08:23,072::task::993::Storage.TaskManager.Task::(_decref) Task=`71c2d67d-29a8-4faa-92fa-e5fc0bb02a99`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:08:23,085::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:08:23,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d172aad-369a-4104-a82f-5c5bf36e2c4b`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:08:23,086::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:08:23,087::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`619037eb-9b46-4898-8ab5-9f6f186b99aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:08:23,087::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:08:23,088::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:08:23,088::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`619037eb-9b46-4898-8ab5-9f6f186b99aa`::Granted request >Thread-6940::DEBUG::2014-07-08 16:08:23,089::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0d172aad-369a-4104-a82f-5c5bf36e2c4b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:08:23,089::task::993::Storage.TaskManager.Task::(_decref) Task=`0d172aad-369a-4104-a82f-5c5bf36e2c4b`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:08:23,108::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:23,109::task::1191::Storage.TaskManager.Task::(prepare) Task=`0d172aad-369a-4104-a82f-5c5bf36e2c4b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:23,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d172aad-369a-4104-a82f-5c5bf36e2c4b`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:08:23,109::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:08:23,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:08:23,110::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:08:23,110::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:08:23,111::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:08:23,111::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:08:23,111::task::993::Storage.TaskManager.Task::(_decref) Task=`0d172aad-369a-4104-a82f-5c5bf36e2c4b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:08:25,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:08:25,242::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:25,246::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:25,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:25,254::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:25,257::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:25,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:25,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:25,267::__init__::225::IOProcess::(_processLogs) (272316) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:25,271::__init__::225::IOProcess::(_processLogs) (272316) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:25,276::__init__::225::IOProcess::(_processLogs) DEBUG|(272316) Building response >Thread-18::DEBUG::2014-07-08 16:08:25,280::__init__::225::IOProcess::(_processLogs) (272316) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:25,283::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:25,286::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:08:25,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:08:25,537::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000693088 s, 667 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:25,557::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:25,561::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:25,567::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:25,655::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-6860::DEBUG::2014-07-08 16:08:25,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.333549 s, 3.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:25,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:25,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:25,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:25,666::__init__::225::IOProcess::(_processLogs) (272317) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:25,669::__init__::225::IOProcess::(_processLogs) (272317) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:25,671::__init__::225::IOProcess::(_processLogs) DEBUG|(272317) Building response >Thread-18::DEBUG::2014-07-08 16:08:25,674::__init__::225::IOProcess::(_processLogs) (272317) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:25,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:25,678::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:08:25,693::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:25,695::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:08:25,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:25,699::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:25,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:25,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:25,707::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:25,709::__init__::225::IOProcess::(_processLogs) (272318) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:25,713::__init__::225::IOProcess::(_processLogs) (272318) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:25,717::__init__::225::IOProcess::(_processLogs) DEBUG|(272318) Building response >Thread-18::DEBUG::2014-07-08 16:08:25,719::__init__::225::IOProcess::(_processLogs) (272318) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:25,721::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:25,722::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:25,731::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:25,733::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:08:25,735::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:25,736::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:25,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:25,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:25,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:25,750::__init__::225::IOProcess::(_processLogs) (272319) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:25,752::__init__::225::IOProcess::(_processLogs) (272319) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:25,755::__init__::225::IOProcess::(_processLogs) DEBUG|(272319) Building response >Thread-18::DEBUG::2014-07-08 16:08:25,757::__init__::225::IOProcess::(_processLogs) (272319) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:25,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:25,762::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:25,771::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:25,773::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:08:25,775::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:25,778::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:25,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:25,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:25,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:25,787::__init__::225::IOProcess::(_processLogs) (272320) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:25,790::__init__::225::IOProcess::(_processLogs) (272320) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:25,799::__init__::225::IOProcess::(_processLogs) DEBUG|(272320) Building response >Thread-18::DEBUG::2014-07-08 16:08:25,806::__init__::225::IOProcess::(_processLogs) (272320) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:25,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:25,819::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:08:27,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:28,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017597 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:08:29,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec707e94-9041-460a-8333-c6acb7b341f2`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:08:29,788::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:08:29,789::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693088', 'lastCheck': '4.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:08:29,789::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec707e94-9041-460a-8333-c6acb7b341f2`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693088', 'lastCheck': '4.0', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:08:29,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec707e94-9041-460a-8333-c6acb7b341f2`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:08:29,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:08:29,790::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:08:29,790::task::993::Storage.TaskManager.Task::(_decref) Task=`ec707e94-9041-460a-8333-c6acb7b341f2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:08:30,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:30,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0212195 s, 48.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:32,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:32,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180376 s, 56.8 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:08:33,126::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:08:33,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`23e117e5-251c-4ba3-a85b-bad7f2536941`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:08:33,128::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:08:33,144::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:33,144::task::1191::Storage.TaskManager.Task::(prepare) Task=`23e117e5-251c-4ba3-a85b-bad7f2536941`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:33,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`23e117e5-251c-4ba3-a85b-bad7f2536941`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:08:33,145::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:08:33,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:08:33,145::task::993::Storage.TaskManager.Task::(_decref) Task=`23e117e5-251c-4ba3-a85b-bad7f2536941`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:08:33,158::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:08:33,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5014590-a58a-49b2-9bf0-34532961a884`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:08:33,159::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:08:33,160::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c782d114-32d2-4320-ad3d-077065d53550`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:08:33,160::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:08:33,161::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:08:33,161::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c782d114-32d2-4320-ad3d-077065d53550`::Granted request >Thread-6940::DEBUG::2014-07-08 16:08:33,162::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b5014590-a58a-49b2-9bf0-34532961a884`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:08:33,162::task::993::Storage.TaskManager.Task::(_decref) Task=`b5014590-a58a-49b2-9bf0-34532961a884`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:08:33,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:33,182::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5014590-a58a-49b2-9bf0-34532961a884`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:33,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5014590-a58a-49b2-9bf0-34532961a884`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:08:33,182::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:08:33,183::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:08:33,183::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:08:33,183::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:08:33,184::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:08:33,184::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:08:33,184::task::993::Storage.TaskManager.Task::(_decref) Task=`b5014590-a58a-49b2-9bf0-34532961a884`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:08:34,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:35,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176624 s, 58.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:35,920::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:35,927::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:35,927::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:35,927::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:35,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:35,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:35,928::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:35,929::__init__::225::IOProcess::(_processLogs) (272321) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:35,929::__init__::225::IOProcess::(_processLogs) (272321) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:35,929::__init__::225::IOProcess::(_processLogs) (272321) Building response >Thread-18::DEBUG::2014-07-08 16:08:35,929::__init__::225::IOProcess::(_processLogs) (272321) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:35,930::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:35,930::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:08:35,932::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:08:36,092::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000627438 s, 736 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:36,101::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:36,106::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:36,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:36,117::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:36,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:36,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:36,130::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:36,134::__init__::225::IOProcess::(_processLogs) (272322) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:36,138::__init__::225::IOProcess::(_processLogs) (272322) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:36,143::__init__::225::IOProcess::(_processLogs) (272322) Building response >Thread-18::DEBUG::2014-07-08 16:08:36,147::__init__::225::IOProcess::(_processLogs) (272322) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:36,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:36,154::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:08:36,174::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:36,175::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:08:36,176::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:36,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:36,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:36,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:36,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:36,183::__init__::225::IOProcess::(_processLogs) (272323) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:36,185::__init__::225::IOProcess::(_processLogs) (272323) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:36,187::__init__::225::IOProcess::(_processLogs) DEBUG|(272323) Building response >Thread-18::DEBUG::2014-07-08 16:08:36,188::__init__::225::IOProcess::(_processLogs) (272323) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:36,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:36,191::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:36,196::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:36,197::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:08:36,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:36,200::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:36,201::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:36,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:36,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:36,205::__init__::225::IOProcess::(_processLogs) (272324) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:36,207::__init__::225::IOProcess::(_processLogs) DEBUG|(272324) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:36,209::__init__::225::IOProcess::(_processLogs) (272324) Building response >Thread-18::DEBUG::2014-07-08 16:08:36,210::__init__::225::IOProcess::(_processLogs) (272324) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:36,211::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:36,213::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:36,217::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:36,219::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:08:36,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:36,221::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:36,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:36,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:36,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:36,227::__init__::225::IOProcess::(_processLogs) (272325) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:36,228::__init__::225::IOProcess::(_processLogs) (272325) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:36,230::__init__::225::IOProcess::(_processLogs) DEBUG|(272325) Building response >Thread-18::DEBUG::2014-07-08 16:08:36,231::__init__::225::IOProcess::(_processLogs) (272325) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:36,232::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:36,234::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:08:37,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:37,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173694 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:39,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:39,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0213896 s, 47.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:41,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:41,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175378 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:08:43,199::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:08:43,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3869fda-9115-43ef-b3d0-451ddb46546b`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:08:43,201::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:08:43,215::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:43,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3869fda-9115-43ef-b3d0-451ddb46546b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:43,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3869fda-9115-43ef-b3d0-451ddb46546b`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:08:43,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:08:43,217::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:08:43,217::task::993::Storage.TaskManager.Task::(_decref) Task=`d3869fda-9115-43ef-b3d0-451ddb46546b`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:08:43,228::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:08:43,229::task::595::Storage.TaskManager.Task::(_updateState) Task=`66c6a9d9-bdea-4160-acc8-5e2fafc807ae`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:08:43,230::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:08:43,231::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5bc773e4-2090-4e9a-9e3c-3193eba1ca77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:08:43,231::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:08:43,231::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:08:43,232::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5bc773e4-2090-4e9a-9e3c-3193eba1ca77`::Granted request >Thread-6940::DEBUG::2014-07-08 16:08:43,232::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`66c6a9d9-bdea-4160-acc8-5e2fafc807ae`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:08:43,233::task::993::Storage.TaskManager.Task::(_decref) Task=`66c6a9d9-bdea-4160-acc8-5e2fafc807ae`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:08:43,252::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:43,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`66c6a9d9-bdea-4160-acc8-5e2fafc807ae`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:43,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`66c6a9d9-bdea-4160-acc8-5e2fafc807ae`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:08:43,253::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:08:43,253::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:08:43,253::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:08:43,254::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:08:43,254::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:08:43,254::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:08:43,255::task::993::Storage.TaskManager.Task::(_decref) Task=`66c6a9d9-bdea-4160-acc8-5e2fafc807ae`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:08:43,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:44,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176219 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:08:44,964::task::595::Storage.TaskManager.Task::(_updateState) Task=`28f9a8cb-0f60-400a-8a46-c011e9d17b29`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:08:44,965::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:08:44,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627438', 'lastCheck': '8.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:08:44,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`28f9a8cb-0f60-400a-8a46-c011e9d17b29`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627438', 'lastCheck': '8.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:08:44,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`28f9a8cb-0f60-400a-8a46-c011e9d17b29`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:08:44,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:08:44,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:08:44,967::task::993::Storage.TaskManager.Task::(_decref) Task=`28f9a8cb-0f60-400a-8a46-c011e9d17b29`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:08:46,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:08:46,407::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:46,420::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:46,428::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:46,436::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:46,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:46,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:46,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:46,465::__init__::225::IOProcess::(_processLogs) (272326) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:46,473::__init__::225::IOProcess::(_processLogs) (272326) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:46,479::__init__::225::IOProcess::(_processLogs) (272326) Building response >Thread-18::DEBUG::2014-07-08 16:08:46,488::__init__::225::IOProcess::(_processLogs) (272326) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:46,497::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:46,507::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:08:46,537::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:08:46,694::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000542513 s, 852 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:46,708::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:46,719::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:46,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:46,727::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:46,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 16:08:46,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.420044 s, 2.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:46,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:46,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:46,822::__init__::225::IOProcess::(_processLogs) (272327) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:46,825::__init__::225::IOProcess::(_processLogs) (272327) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:46,829::__init__::225::IOProcess::(_processLogs) (272327) Building response >Thread-18::DEBUG::2014-07-08 16:08:46,831::__init__::225::IOProcess::(_processLogs) (272327) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:46,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:46,838::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:08:46,855::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:46,859::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:08:46,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:46,867::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:46,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:46,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:46,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:46,880::__init__::225::IOProcess::(_processLogs) (272328) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:46,883::__init__::225::IOProcess::(_processLogs) (272328) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:46,886::__init__::225::IOProcess::(_processLogs) (272328) Building response >Thread-18::DEBUG::2014-07-08 16:08:46,889::__init__::225::IOProcess::(_processLogs) (272328) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:46,892::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:46,895::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:46,906::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:46,910::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:08:46,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:46,915::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:46,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:46,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:46,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:46,925::__init__::225::IOProcess::(_processLogs) (272329) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:46,927::__init__::225::IOProcess::(_processLogs) (272329) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:46,929::__init__::225::IOProcess::(_processLogs) (272329) Building response >Thread-18::DEBUG::2014-07-08 16:08:46,932::__init__::225::IOProcess::(_processLogs) (272329) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:46,935::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:46,939::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:46,949::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:08:46,952::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:46,955::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:46,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:46,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:46,961::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:46,964::__init__::225::IOProcess::(_processLogs) (272330) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:46,966::__init__::225::IOProcess::(_processLogs) (272330) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:46,969::__init__::225::IOProcess::(_processLogs) (272330) Building response >Thread-18::DEBUG::2014-07-08 16:08:46,972::__init__::225::IOProcess::(_processLogs) (272330) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:46,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:46,977::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:08:49,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:49,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176498 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:51,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:51,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10356 s, 9.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:08:53,268::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:08:53,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`e482b231-761d-4723-9e6c-a3bec77ca3c2`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:08:53,269::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:08:53,284::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:53,284::task::1191::Storage.TaskManager.Task::(prepare) Task=`e482b231-761d-4723-9e6c-a3bec77ca3c2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:08:53,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`e482b231-761d-4723-9e6c-a3bec77ca3c2`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:08:53,285::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:08:53,285::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:08:53,285::task::993::Storage.TaskManager.Task::(_decref) Task=`e482b231-761d-4723-9e6c-a3bec77ca3c2`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:08:53,296::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:08:53,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`75c2ffe4-28da-454d-918b-2f39bd2092d7`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:08:53,298::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:08:53,299::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4af33c7c-2026-49f2-ad1c-e280cf876f8f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:08:53,299::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:08:53,299::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:08:53,300::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4af33c7c-2026-49f2-ad1c-e280cf876f8f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:08:53,300::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`75c2ffe4-28da-454d-918b-2f39bd2092d7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:08:53,301::task::993::Storage.TaskManager.Task::(_decref) Task=`75c2ffe4-28da-454d-918b-2f39bd2092d7`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:08:53,319::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:53,320::task::1191::Storage.TaskManager.Task::(prepare) Task=`75c2ffe4-28da-454d-918b-2f39bd2092d7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:08:53,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`75c2ffe4-28da-454d-918b-2f39bd2092d7`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:08:53,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:08:53,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:08:53,321::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:08:53,321::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:08:53,322::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:08:53,322::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:08:53,322::task::993::Storage.TaskManager.Task::(_decref) Task=`75c2ffe4-28da-454d-918b-2f39bd2092d7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:08:53,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:53,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186949 s, 54.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:08:56,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:56,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175674 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:56,985::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:56,985::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:56,986::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:56,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:56,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:56,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:56,987::__init__::225::IOProcess::(_processLogs) (272331) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:56,987::__init__::225::IOProcess::(_processLogs) (272331) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:56,987::__init__::225::IOProcess::(_processLogs) (272331) Building response >Thread-18::DEBUG::2014-07-08 16:08:56,987::__init__::225::IOProcess::(_processLogs) (272331) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:56,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:56,988::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:08:56,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:08:57,142::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000505918 s, 913 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:08:57,151::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:08:57,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:57,155::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:57,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:57,158::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:57,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:57,161::__init__::225::IOProcess::(_processLogs) (272332) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:08:57,163::__init__::225::IOProcess::(_processLogs) (272332) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:08:57,165::__init__::225::IOProcess::(_processLogs) (272332) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:57,166::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:57,168::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:08:57,181::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:08:57,184::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:57,185::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:57,186::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:57,188::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:57,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:57,191::__init__::225::IOProcess::(_processLogs) (272333) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:57,192::__init__::225::IOProcess::(_processLogs) (272333) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:57,193::__init__::225::IOProcess::(_processLogs) (272333) Building response >Thread-18::DEBUG::2014-07-08 16:08:57,194::__init__::225::IOProcess::(_processLogs) (272333) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:57,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:57,197::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:57,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:57,203::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:08:57,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:57,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:57,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:57,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:57,210::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:57,211::__init__::225::IOProcess::(_processLogs) (272334) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:57,212::__init__::225::IOProcess::(_processLogs) (272334) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:57,213::__init__::225::IOProcess::(_processLogs) (272334) Building response >Thread-18::DEBUG::2014-07-08 16:08:57,215::__init__::225::IOProcess::(_processLogs) (272334) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:57,216::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:57,217::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:08:57,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:08:57,224::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:08:57,225::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:08:57,226::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:08:57,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:08:57,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:08:57,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:08:57,232::__init__::225::IOProcess::(_processLogs) (272335) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:08:57,233::__init__::225::IOProcess::(_processLogs) (272335) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:08:57,234::__init__::225::IOProcess::(_processLogs) (272335) Building response >Thread-18::DEBUG::2014-07-08 16:08:57,236::__init__::225::IOProcess::(_processLogs) (272335) Queuing response >Thread-18::DEBUG::2014-07-08 16:08:57,237::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:08:57,238::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:08:58,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:08:58,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171984 s, 59.5 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:09:00,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`db72ef5f-bfc0-4a46-af66-7cc999402a53`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:00,165::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:09:00,165::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505918', 'lastCheck': '2.9', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:09:00,166::task::1191::Storage.TaskManager.Task::(prepare) Task=`db72ef5f-bfc0-4a46-af66-7cc999402a53`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505918', 'lastCheck': '2.9', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:09:00,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`db72ef5f-bfc0-4a46-af66-7cc999402a53`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:00,166::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:00,166::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:00,167::task::993::Storage.TaskManager.Task::(_decref) Task=`db72ef5f-bfc0-4a46-af66-7cc999402a53`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:00,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:00,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176099 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:09:02,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:03,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046748 s, 21.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:09:03,335::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:09:03,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ff9e880-a819-4fb7-80a8-fdf441347ca4`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:03,337::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:09:03,352::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:03,352::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ff9e880-a819-4fb7-80a8-fdf441347ca4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:03,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ff9e880-a819-4fb7-80a8-fdf441347ca4`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:03,353::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:03,353::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:03,353::task::993::Storage.TaskManager.Task::(_decref) Task=`5ff9e880-a819-4fb7-80a8-fdf441347ca4`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:09:03,364::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:09:03,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e7b4493-6c3b-46e2-806c-28f59ede4043`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:09:03,365::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:09:03,366::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`80ec624c-7412-46ed-a081-d17003351553`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:09:03,367::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:09:03,367::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:09:03,367::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`80ec624c-7412-46ed-a081-d17003351553`::Granted request >Thread-6940::DEBUG::2014-07-08 16:09:03,368::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1e7b4493-6c3b-46e2-806c-28f59ede4043`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:09:03,368::task::993::Storage.TaskManager.Task::(_decref) Task=`1e7b4493-6c3b-46e2-806c-28f59ede4043`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:09:03,388::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:03,389::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e7b4493-6c3b-46e2-806c-28f59ede4043`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:03,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e7b4493-6c3b-46e2-806c-28f59ede4043`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:09:03,389::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:09:03,389::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:09:03,390::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:09:03,390::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:09:03,391::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:09:03,391::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:09:03,391::task::993::Storage.TaskManager.Task::(_decref) Task=`1e7b4493-6c3b-46e2-806c-28f59ede4043`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:05,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:05,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172194 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:07,245::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:07,245::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:07,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:07,246::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:07,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:07,246::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:07,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:07,247::__init__::225::IOProcess::(_processLogs) (272336) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:07,247::__init__::225::IOProcess::(_processLogs) (272336) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:07,247::__init__::225::IOProcess::(_processLogs) (272336) Building response >Thread-18::DEBUG::2014-07-08 16:09:07,247::__init__::225::IOProcess::(_processLogs) (272336) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:07,248::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:07,248::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:09:07,250::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:07,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:09:07,401::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000557318 s, 829 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:07,557::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:07,559::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:07,560::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:07,563::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:07,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:07,570::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:07,573::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:07,576::__init__::225::IOProcess::(_processLogs) (272337) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:07,579::__init__::225::IOProcess::(_processLogs) (272337) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:07,581::__init__::225::IOProcess::(_processLogs) (272337) Building response >Thread-18::DEBUG::2014-07-08 16:09:07,585::__init__::225::IOProcess::(_processLogs) (272337) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:07,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:07,590::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:09:07,606::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:07,609::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:09:07,612::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:07,616::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:07,620::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:07,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:07,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:07,628::__init__::225::IOProcess::(_processLogs) (272338) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:07,711::__init__::225::IOProcess::(_processLogs) (272338) Got request for method 'access' >Dummy-6860::DEBUG::2014-07-08 16:09:07,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.074897 s, 13.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:07,714::__init__::225::IOProcess::(_processLogs) (272338) Building response >Thread-18::DEBUG::2014-07-08 16:09:07,717::__init__::225::IOProcess::(_processLogs) (272338) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:07,720::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:07,722::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:07,731::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:07,735::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:09:07,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:07,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:07,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:07,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:07,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:07,747::__init__::225::IOProcess::(_processLogs) (272339) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:07,750::__init__::225::IOProcess::(_processLogs) (272339) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:07,753::__init__::225::IOProcess::(_processLogs) (272339) Building response >Thread-18::DEBUG::2014-07-08 16:09:07,755::__init__::225::IOProcess::(_processLogs) (272339) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:07,757::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:07,764::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:07,773::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:07,775::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:09:07,778::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:07,781::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:07,784::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:07,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:07,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:07,791::__init__::225::IOProcess::(_processLogs) (272340) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:07,793::__init__::225::IOProcess::(_processLogs) (272340) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:07,795::__init__::225::IOProcess::(_processLogs) (272340) Building response >Thread-18::DEBUG::2014-07-08 16:09:07,797::__init__::225::IOProcess::(_processLogs) (272340) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:07,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:07,803::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:09:09,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:10,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175445 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:09:12,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:12,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101813 s, 10.1 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:09:13,405::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:09:13,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dedd2b5-162a-4593-a386-79c9127c5090`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:13,406::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:09:13,422::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:13,423::task::1191::Storage.TaskManager.Task::(prepare) Task=`2dedd2b5-162a-4593-a386-79c9127c5090`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:13,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dedd2b5-162a-4593-a386-79c9127c5090`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:13,423::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:13,423::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:13,424::task::993::Storage.TaskManager.Task::(_decref) Task=`2dedd2b5-162a-4593-a386-79c9127c5090`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:09:13,437::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:09:13,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`4af7dc23-d059-4fb5-894c-7811f9dff81d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:09:13,439::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:09:13,440::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2bea21b6-a2e5-49ce-ae71-9eaf8c45a10b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:09:13,440::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:09:13,440::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:09:13,441::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2bea21b6-a2e5-49ce-ae71-9eaf8c45a10b`::Granted request >Thread-6940::DEBUG::2014-07-08 16:09:13,441::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4af7dc23-d059-4fb5-894c-7811f9dff81d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:09:13,441::task::993::Storage.TaskManager.Task::(_decref) Task=`4af7dc23-d059-4fb5-894c-7811f9dff81d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:09:13,460::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:13,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`4af7dc23-d059-4fb5-894c-7811f9dff81d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:13,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`4af7dc23-d059-4fb5-894c-7811f9dff81d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:09:13,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:09:13,462::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:09:13,462::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:09:13,463::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:09:13,463::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:09:13,463::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:09:13,463::task::993::Storage.TaskManager.Task::(_decref) Task=`4af7dc23-d059-4fb5-894c-7811f9dff81d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:14,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:14,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172425 s, 59.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:09:15,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`69fcc022-493b-4e40-8d73-1aacc6bb872f`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:15,453::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:09:15,454::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557318', 'lastCheck': '7.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:09:15,454::task::1191::Storage.TaskManager.Task::(prepare) Task=`69fcc022-493b-4e40-8d73-1aacc6bb872f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557318', 'lastCheck': '7.6', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:09:15,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`69fcc022-493b-4e40-8d73-1aacc6bb872f`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:15,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:15,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:15,455::task::993::Storage.TaskManager.Task::(_decref) Task=`69fcc022-493b-4e40-8d73-1aacc6bb872f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:16,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:17,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176646 s, 58.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:17,812::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:17,812::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:17,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:17,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:17,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:17,813::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:17,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:17,814::__init__::225::IOProcess::(_processLogs) (272341) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:17,814::__init__::225::IOProcess::(_processLogs) (272341) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:17,814::__init__::225::IOProcess::(_processLogs) (272341) Building response >Thread-18::DEBUG::2014-07-08 16:09:17,815::__init__::225::IOProcess::(_processLogs) (272341) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:17,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:17,815::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:09:17,817::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:09:17,966::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000488039 s, 947 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:17,977::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:17,979::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:17,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:17,984::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:17,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:17,987::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:17,989::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:17,992::__init__::225::IOProcess::(_processLogs) (272342) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:17,993::__init__::225::IOProcess::(_processLogs) (272342) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:17,995::__init__::225::IOProcess::(_processLogs) (272342) Building response >Thread-18::DEBUG::2014-07-08 16:09:17,996::__init__::225::IOProcess::(_processLogs) (272342) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:17,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:17,999::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:09:18,006::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:18,007::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:09:18,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:18,008::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:18,008::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:18,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:18,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:18,009::__init__::225::IOProcess::(_processLogs) (272343) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:18,010::__init__::225::IOProcess::(_processLogs) (272343) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:18,010::__init__::225::IOProcess::(_processLogs) (272343) Building response >Thread-18::DEBUG::2014-07-08 16:09:18,011::__init__::225::IOProcess::(_processLogs) (272343) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:18,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:18,011::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:18,014::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:18,015::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:09:18,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:18,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:18,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:18,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:18,017::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:18,017::__init__::225::IOProcess::(_processLogs) (272344) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:18,018::__init__::225::IOProcess::(_processLogs) (272344) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:18,018::__init__::225::IOProcess::(_processLogs) (272344) Building response >Thread-18::DEBUG::2014-07-08 16:09:18,018::__init__::225::IOProcess::(_processLogs) (272344) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:18,019::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:18,019::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:18,029::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:18,029::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:09:18,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:18,030::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:18,031::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:18,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:18,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:18,032::__init__::225::IOProcess::(_processLogs) (272345) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:18,032::__init__::225::IOProcess::(_processLogs) (272345) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:18,033::__init__::225::IOProcess::(_processLogs) (272345) Building response >Thread-18::DEBUG::2014-07-08 16:09:18,033::__init__::225::IOProcess::(_processLogs) (272345) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:18,033::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:18,034::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:09:19,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:19,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413076 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:09:21,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:21,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264471 s, 38.7 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:09:23,481::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:09:23,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c67eb06-0fce-427d-b1aa-8f8bc95331f9`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:23,487::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:09:23,504::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:23,506::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c67eb06-0fce-427d-b1aa-8f8bc95331f9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:23,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c67eb06-0fce-427d-b1aa-8f8bc95331f9`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:23,507::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:23,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:23,510::task::993::Storage.TaskManager.Task::(_decref) Task=`3c67eb06-0fce-427d-b1aa-8f8bc95331f9`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:09:23,522::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:09:23,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`d44460b5-14f5-4cb7-a2e5-cd56a134a693`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:09:23,523::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:09:23,524::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e6cfb278-3231-4ba6-99b0-55ec4d3a05cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:09:23,525::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:09:23,525::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:09:23,525::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e6cfb278-3231-4ba6-99b0-55ec4d3a05cd`::Granted request >Thread-6940::DEBUG::2014-07-08 16:09:23,526::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d44460b5-14f5-4cb7-a2e5-cd56a134a693`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:09:23,526::task::993::Storage.TaskManager.Task::(_decref) Task=`d44460b5-14f5-4cb7-a2e5-cd56a134a693`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:09:23,545::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:23,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`d44460b5-14f5-4cb7-a2e5-cd56a134a693`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:23,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`d44460b5-14f5-4cb7-a2e5-cd56a134a693`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:09:23,547::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:09:23,547::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:09:23,547::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:09:23,548::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:09:23,548::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:09:23,548::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:09:23,548::task::993::Storage.TaskManager.Task::(_decref) Task=`d44460b5-14f5-4cb7-a2e5-cd56a134a693`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:23,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:24,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173828 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:09:26,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:26,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176272 s, 58.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:28,048::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:28,052::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:28,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:28,053::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:28,053::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:28,053::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:28,053::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:28,054::__init__::225::IOProcess::(_processLogs) (272346) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:28,054::__init__::225::IOProcess::(_processLogs) (272346) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:28,054::__init__::225::IOProcess::(_processLogs) DEBUG|(272346) Building response >Thread-18::DEBUG::2014-07-08 16:09:28,055::__init__::225::IOProcess::(_processLogs) (272346) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:28,055::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:28,055::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:09:28,057::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:09:28,210::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000618219 s, 747 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:28,215::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:28,217::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:28,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:28,220::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:28,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:28,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:28,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:28,225::__init__::225::IOProcess::(_processLogs) (272347) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:28,226::__init__::225::IOProcess::(_processLogs) (272347) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:28,228::__init__::225::IOProcess::(_processLogs) DEBUG|(272347) Building response >Thread-18::DEBUG::2014-07-08 16:09:28,229::__init__::225::IOProcess::(_processLogs) (272347) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:28,231::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:28,232::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:09:28,241::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:28,243::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:09:28,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:28,247::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:28,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:28,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:28,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:28,252::__init__::225::IOProcess::(_processLogs) (272348) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:28,253::__init__::225::IOProcess::(_processLogs) (272348) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:28,255::__init__::225::IOProcess::(_processLogs) (272348) Building response >Thread-18::DEBUG::2014-07-08 16:09:28,256::__init__::225::IOProcess::(_processLogs) (272348) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:28,258::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:28,260::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:28,265::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:28,267::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:09:28,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:28,270::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:28,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:28,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:28,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:28,275::__init__::225::IOProcess::(_processLogs) (272349) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:28,277::__init__::225::IOProcess::(_processLogs) (272349) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:28,279::__init__::225::IOProcess::(_processLogs) (272349) Building response >Thread-18::DEBUG::2014-07-08 16:09:28,280::__init__::225::IOProcess::(_processLogs) (272349) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:28,281::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:28,283::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:28,288::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:28,289::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:09:28,290::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:28,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:28,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:28,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:28,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:28,296::__init__::225::IOProcess::(_processLogs) (272350) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:28,299::__init__::225::IOProcess::(_processLogs) (272350) Got request for method 'access' >Dummy-6860::DEBUG::2014-07-08 16:09:28,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:09:28,302::__init__::225::IOProcess::(_processLogs) (272350) Building response >Thread-18::DEBUG::2014-07-08 16:09:28,463::__init__::225::IOProcess::(_processLogs) DEBUG|(272350) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:28,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:28,469::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:09:28,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494489 s, 20.7 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:09:30,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`3263e91f-d081-4f15-89fa-0ded0a279739`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:30,686::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:09:30,687::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618219', 'lastCheck': '2.2', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:09:30,687::task::1191::Storage.TaskManager.Task::(prepare) Task=`3263e91f-d081-4f15-89fa-0ded0a279739`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618219', 'lastCheck': '2.2', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:09:30,687::task::595::Storage.TaskManager.Task::(_updateState) Task=`3263e91f-d081-4f15-89fa-0ded0a279739`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:30,688::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:30,688::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:30,688::task::993::Storage.TaskManager.Task::(_decref) Task=`3263e91f-d081-4f15-89fa-0ded0a279739`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:30,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:30,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176219 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:09:33,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:33,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181474 s, 56.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:09:33,562::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:09:33,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b487745-8dd2-4cbd-8388-b3536e9e2137`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:33,564::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:09:33,580::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:33,581::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b487745-8dd2-4cbd-8388-b3536e9e2137`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:33,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b487745-8dd2-4cbd-8388-b3536e9e2137`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:33,581::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:33,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:33,582::task::993::Storage.TaskManager.Task::(_decref) Task=`2b487745-8dd2-4cbd-8388-b3536e9e2137`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:09:33,596::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:09:33,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`04559b8f-9305-414f-9e2d-ee1b101dd2dd`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:09:33,602::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:09:33,612::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`663fd8a1-78b4-4862-aabf-b79c8dd5a4a7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:09:33,614::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:09:33,616::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:09:33,617::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`663fd8a1-78b4-4862-aabf-b79c8dd5a4a7`::Granted request >Thread-6940::DEBUG::2014-07-08 16:09:33,620::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`04559b8f-9305-414f-9e2d-ee1b101dd2dd`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:09:33,621::task::993::Storage.TaskManager.Task::(_decref) Task=`04559b8f-9305-414f-9e2d-ee1b101dd2dd`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:09:33,694::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:33,695::task::1191::Storage.TaskManager.Task::(prepare) Task=`04559b8f-9305-414f-9e2d-ee1b101dd2dd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:33,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`04559b8f-9305-414f-9e2d-ee1b101dd2dd`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:09:33,697::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:09:33,698::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:09:33,699::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:09:33,701::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:09:33,702::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:09:33,703::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:09:33,704::task::993::Storage.TaskManager.Task::(_decref) Task=`04559b8f-9305-414f-9e2d-ee1b101dd2dd`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:35,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:35,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173613 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:09:37,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:37,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338205 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:38,525::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:38,529::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:38,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:38,533::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:38,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:38,533::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:38,534::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:38,534::__init__::225::IOProcess::(_processLogs) (272351) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:38,534::__init__::225::IOProcess::(_processLogs) (272351) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:38,534::__init__::225::IOProcess::(_processLogs) (272351) Building response >Thread-18::DEBUG::2014-07-08 16:09:38,535::__init__::225::IOProcess::(_processLogs) (272351) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:38,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:38,535::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:09:38,537::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:09:38,689::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000677164 s, 682 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:38,691::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:38,691::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:38,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:38,692::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:38,692::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:38,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:38,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:38,693::__init__::225::IOProcess::(_processLogs) (272352) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:38,693::__init__::225::IOProcess::(_processLogs) (272352) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:38,693::__init__::225::IOProcess::(_processLogs) (272352) Building response >Thread-18::DEBUG::2014-07-08 16:09:38,693::__init__::225::IOProcess::(_processLogs) (272352) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:38,694::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:38,694::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:09:38,696::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:38,696::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:09:38,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:38,697::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:38,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:38,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:38,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:38,698::__init__::225::IOProcess::(_processLogs) (272353) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:38,698::__init__::225::IOProcess::(_processLogs) (272353) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:38,698::__init__::225::IOProcess::(_processLogs) (272353) Building response >Thread-18::DEBUG::2014-07-08 16:09:38,698::__init__::225::IOProcess::(_processLogs) (272353) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:38,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:38,699::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:38,700::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:38,700::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:09:38,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:38,701::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:38,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:38,701::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:38,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:38,702::__init__::225::IOProcess::(_processLogs) (272354) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:38,702::__init__::225::IOProcess::(_processLogs) (272354) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:38,702::__init__::225::IOProcess::(_processLogs) (272354) Building response >Thread-18::DEBUG::2014-07-08 16:09:38,703::__init__::225::IOProcess::(_processLogs) (272354) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:38,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:38,703::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:38,704::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:38,704::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 170 >Thread-18::DEBUG::2014-07-08 16:09:38,705::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:38,705::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:38,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:38,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:38,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:38,706::__init__::225::IOProcess::(_processLogs) (272355) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:38,706::__init__::225::IOProcess::(_processLogs) (272355) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:38,706::__init__::225::IOProcess::(_processLogs) (272355) Building response >Thread-18::DEBUG::2014-07-08 16:09:38,706::__init__::225::IOProcess::(_processLogs) (272355) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:38,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:38,707::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:09:39,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:40,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173479 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:09:42,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:42,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173973 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:09:43,775::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:09:43,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`63f27c0a-70bb-4afc-a066-cf21f1be8bb7`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:43,781::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:09:43,797::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:43,797::task::1191::Storage.TaskManager.Task::(prepare) Task=`63f27c0a-70bb-4afc-a066-cf21f1be8bb7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:43,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`63f27c0a-70bb-4afc-a066-cf21f1be8bb7`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:43,798::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:43,801::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:43,802::task::993::Storage.TaskManager.Task::(_decref) Task=`63f27c0a-70bb-4afc-a066-cf21f1be8bb7`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:09:43,815::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:09:43,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bacc202-84a9-40b7-b7a5-0699709881fb`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:09:43,816::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:09:43,817::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f2db5818-21fc-4701-bf8a-2645040a66f8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:09:43,818::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:09:43,818::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:09:43,818::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f2db5818-21fc-4701-bf8a-2645040a66f8`::Granted request >Thread-6940::DEBUG::2014-07-08 16:09:43,819::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3bacc202-84a9-40b7-b7a5-0699709881fb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:09:43,820::task::993::Storage.TaskManager.Task::(_decref) Task=`3bacc202-84a9-40b7-b7a5-0699709881fb`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:09:43,840::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:43,841::task::1191::Storage.TaskManager.Task::(prepare) Task=`3bacc202-84a9-40b7-b7a5-0699709881fb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:43,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bacc202-84a9-40b7-b7a5-0699709881fb`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:09:43,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:09:43,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:09:43,842::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:09:43,842::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:09:43,842::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:09:43,843::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:09:43,843::task::993::Storage.TaskManager.Task::(_decref) Task=`3bacc202-84a9-40b7-b7a5-0699709881fb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:44,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:44,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176294 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:09:45,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8bd7d0c-8bc5-4427-b277-171a51ce5047`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:45,840::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:09:45,840::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677164', 'lastCheck': '7.1', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:09:45,840::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8bd7d0c-8bc5-4427-b277-171a51ce5047`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677164', 'lastCheck': '7.1', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:09:45,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8bd7d0c-8bc5-4427-b277-171a51ce5047`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:45,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:45,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:45,841::task::993::Storage.TaskManager.Task::(_decref) Task=`f8bd7d0c-8bc5-4427-b277-171a51ce5047`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:46,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:46,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174859 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:48,710::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:48,710::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:48,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:48,711::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:48,711::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:48,711::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:48,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:48,712::__init__::225::IOProcess::(_processLogs) (272356) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:48,712::__init__::225::IOProcess::(_processLogs) (272356) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:48,712::__init__::225::IOProcess::(_processLogs) (272356) Building response >Thread-18::DEBUG::2014-07-08 16:09:48,712::__init__::225::IOProcess::(_processLogs) (272356) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:48,713::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:48,713::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:09:48,714::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:09:48,867::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000513459 s, 900 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:48,958::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:48,974::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:48,977::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:48,978::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:48,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:48,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:48,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:48,986::__init__::225::IOProcess::(_processLogs) (272357) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:48,987::__init__::225::IOProcess::(_processLogs) (272357) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:48,989::__init__::225::IOProcess::(_processLogs) (272357) Building response >Thread-18::DEBUG::2014-07-08 16:09:48,993::__init__::225::IOProcess::(_processLogs) (272357) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:09:48,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:09:48,997::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:49,156::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:09:49,177::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:49,181::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:09:49,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:49,185::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:49,188::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:49,192::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:49,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:49,197::__init__::225::IOProcess::(_processLogs) (272358) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:49,201::__init__::225::IOProcess::(_processLogs) (272358) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:49,204::__init__::225::IOProcess::(_processLogs) (272358) Building response >Thread-18::DEBUG::2014-07-08 16:09:49,206::__init__::225::IOProcess::(_processLogs) (272358) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:49,209::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:49,212::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:49,223::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:09:49,225::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:09:49,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:49,232::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:49,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 16:09:49,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0829939 s, 12.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:49,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:49,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:49,327::__init__::225::IOProcess::(_processLogs) (272359) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:49,330::__init__::225::IOProcess::(_processLogs) (272359) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:49,333::__init__::225::IOProcess::(_processLogs) (272359) Building response >Thread-18::DEBUG::2014-07-08 16:09:49,336::__init__::225::IOProcess::(_processLogs) (272359) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:49,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:49,341::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:49,351::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:09:49,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:49,356::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:49,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:49,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:49,365::__init__::225::IOProcess::(_processLogs) (272360) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:49,368::__init__::225::IOProcess::(_processLogs) (272360) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:49,371::__init__::225::IOProcess::(_processLogs) (272360) Building response >Thread-18::DEBUG::2014-07-08 16:09:49,374::__init__::225::IOProcess::(_processLogs) (272360) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:49,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:49,379::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:09:51,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:51,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0210189 s, 48.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:09:53,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:09:53,940::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:09:53,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0003bcd-50c7-43d4-8e8b-6b092675acc8`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:09:53,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:09:53,977::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:53,982::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0003bcd-50c7-43d4-8e8b-6b092675acc8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:09:53,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0003bcd-50c7-43d4-8e8b-6b092675acc8`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:09:53,990::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:09:53,994::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:09:53,998::task::993::Storage.TaskManager.Task::(_decref) Task=`c0003bcd-50c7-43d4-8e8b-6b092675acc8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:54,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0692517 s, 14.8 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:09:54,104::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:09:54,111::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6eef1dc-6651-49fd-abd2-ed2a1ebb7246`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:09:54,113::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:09:54,116::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4ac3972f-103b-47bd-9cb1-f5f03a2f03e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:09:54,116::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:09:54,118::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:09:54,119::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4ac3972f-103b-47bd-9cb1-f5f03a2f03e8`::Granted request >Thread-6940::DEBUG::2014-07-08 16:09:54,121::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c6eef1dc-6651-49fd-abd2-ed2a1ebb7246`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:09:54,122::task::993::Storage.TaskManager.Task::(_decref) Task=`c6eef1dc-6651-49fd-abd2-ed2a1ebb7246`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:09:54,150::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:54,151::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6eef1dc-6651-49fd-abd2-ed2a1ebb7246`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:09:54,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6eef1dc-6651-49fd-abd2-ed2a1ebb7246`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:09:54,152::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:09:54,153::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:09:54,154::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:09:54,155::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:09:54,156::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:09:54,157::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:09:54,158::task::993::Storage.TaskManager.Task::(_decref) Task=`c6eef1dc-6651-49fd-abd2-ed2a1ebb7246`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:09:56,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:56,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175065 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:09:58,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:09:58,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174188 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:59,419::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:59,423::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:59,423::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:59,423::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:59,424::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:59,424::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:59,424::__init__::225::IOProcess::(_processLogs) (272361) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:59,425::__init__::225::IOProcess::(_processLogs) (272361) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:59,428::__init__::225::IOProcess::(_processLogs) (272361) Building response >Thread-18::DEBUG::2014-07-08 16:09:59,428::__init__::225::IOProcess::(_processLogs) (272361) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:59,429::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:09:59,431::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:09:59,583::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000436077 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:09:59,588::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:09:59,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:59,592::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:59,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:59,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:59,598::__init__::225::IOProcess::(_processLogs) (272362) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:09:59,600::__init__::225::IOProcess::(_processLogs) (272362) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:09:59,602::__init__::225::IOProcess::(_processLogs) (272362) Building response >Thread-18::DEBUG::2014-07-08 16:09:59,603::__init__::225::IOProcess::(_processLogs) (272362) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:59,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:59,606::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:09:59,616::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:09:59,618::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:59,619::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:59,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:59,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:59,625::__init__::225::IOProcess::(_processLogs) (272363) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:59,626::__init__::225::IOProcess::(_processLogs) (272363) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:59,627::__init__::225::IOProcess::(_processLogs) (272363) Building response >Thread-18::DEBUG::2014-07-08 16:09:59,629::__init__::225::IOProcess::(_processLogs) (272363) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:59,631::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:59,632::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:59,637::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:09:59,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:59,641::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:59,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:59,643::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:59,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:59,646::__init__::225::IOProcess::(_processLogs) (272364) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:59,648::__init__::225::IOProcess::(_processLogs) (272364) Building response >Thread-18::DEBUG::2014-07-08 16:09:59,649::__init__::225::IOProcess::(_processLogs) (272364) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:59,651::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:59,652::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:09:59,662::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:09:59,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:09:59,665::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:09:59,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:09:59,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:09:59,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:09:59,671::__init__::225::IOProcess::(_processLogs) (272365) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:09:59,673::__init__::225::IOProcess::(_processLogs) (272365) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:09:59,674::__init__::225::IOProcess::(_processLogs) (272365) Queuing response >Thread-18::DEBUG::2014-07-08 16:09:59,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:09:59,678::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:10:00,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:01,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174487 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:10:01,044::task::595::Storage.TaskManager.Task::(_updateState) Task=`429dcc64-ee36-4b41-9a4f-00da24353fe1`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:10:01,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:10:01,048::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436077', 'lastCheck': '1.4', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:10:01,049::task::1191::Storage.TaskManager.Task::(prepare) Task=`429dcc64-ee36-4b41-9a4f-00da24353fe1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436077', 'lastCheck': '1.4', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:10:01,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`429dcc64-ee36-4b41-9a4f-00da24353fe1`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:10:01,051::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:10:01,052::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:10:01,053::task::993::Storage.TaskManager.Task::(_decref) Task=`429dcc64-ee36-4b41-9a4f-00da24353fe1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:03,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:03,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180471 s, 56.7 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:10:04,252::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:10:04,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b6df3e3-b93e-4f4a-a975-5cb3d1d0d555`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:10:04,256::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:10:04,300::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:10:04,301::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b6df3e3-b93e-4f4a-a975-5cb3d1d0d555`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:10:04,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b6df3e3-b93e-4f4a-a975-5cb3d1d0d555`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:10:04,303::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:10:04,303::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:10:04,304::task::993::Storage.TaskManager.Task::(_decref) Task=`9b6df3e3-b93e-4f4a-a975-5cb3d1d0d555`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:10:04,320::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:10:04,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa37c42d-999f-40d4-97a7-0f2460ae8de6`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:10:04,324::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:10:04,327::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9f8581c2-1fdf-4dd3-b8c7-d4e8001f5f7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:10:04,328::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:10:04,330::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:10:04,330::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9f8581c2-1fdf-4dd3-b8c7-d4e8001f5f7c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:10:04,333::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fa37c42d-999f-40d4-97a7-0f2460ae8de6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:10:04,334::task::993::Storage.TaskManager.Task::(_decref) Task=`fa37c42d-999f-40d4-97a7-0f2460ae8de6`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:10:04,364::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:04,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa37c42d-999f-40d4-97a7-0f2460ae8de6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:04,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa37c42d-999f-40d4-97a7-0f2460ae8de6`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:10:04,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:10:04,367::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:10:04,369::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:10:04,370::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:10:04,371::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:10:04,372::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:10:04,374::task::993::Storage.TaskManager.Task::(_decref) Task=`fa37c42d-999f-40d4-97a7-0f2460ae8de6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:05,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:05,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017716 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:10:07,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:07,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173473 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:09,684::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:10:09,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:09,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:09,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:09,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:09,685::__init__::225::IOProcess::(_processLogs) (272366) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:09,686::__init__::225::IOProcess::(_processLogs) (272366) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:09,686::__init__::225::IOProcess::(_processLogs) (272366) Building response >Thread-18::DEBUG::2014-07-08 16:10:09,686::__init__::225::IOProcess::(_processLogs) (272366) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:09,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:09,687::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:10:09,688::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:10:09,844::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000549778 s, 840 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:09,938::__init__::225::IOProcess::(_processLogs) Message size is 147 >Dummy-6860::DEBUG::2014-07-08 16:10:09,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:10:09,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:10,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:10,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:10,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:10,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:10,106::__init__::225::IOProcess::(_processLogs) (272367) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:10,106::__init__::225::IOProcess::(_processLogs) (272367) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:10,112::__init__::225::IOProcess::(_processLogs) (272367) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:10,114::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:10,115::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:10:10,133::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:10:10,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:10,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:10,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:10,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:10,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:10,154::__init__::225::IOProcess::(_processLogs) (272368) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:10,158::__init__::225::IOProcess::(_processLogs) (272368) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:10,161::__init__::225::IOProcess::(_processLogs) (272368) Building response >Thread-18::DEBUG::2014-07-08 16:10:10,164::__init__::225::IOProcess::(_processLogs) (272368) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:10,167::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:10,170::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:10,181::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:10,183::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:10:10,185::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:10,190::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:10,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 16:10:10,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0887146 s, 11.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:10,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:10,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:10,310::__init__::225::IOProcess::(_processLogs) (272369) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:10,316::__init__::225::IOProcess::(_processLogs) (272369) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:10,323::__init__::225::IOProcess::(_processLogs) (272369) Building response >Thread-18::DEBUG::2014-07-08 16:10:10,329::__init__::225::IOProcess::(_processLogs) (272369) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:10,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:10,343::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:10,361::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:10,366::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:10:10,373::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:10,380::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:10,386::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:10,391::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:10,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:10,401::__init__::225::IOProcess::(_processLogs) (272370) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:10,403::__init__::225::IOProcess::(_processLogs) (272370) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:10,406::__init__::225::IOProcess::(_processLogs) (272370) Building response >Thread-18::DEBUG::2014-07-08 16:10:10,409::__init__::225::IOProcess::(_processLogs) (272370) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:10,411::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:10,414::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:10:14,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:10:14,470::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:10:14,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`43ef4ca5-140a-4bac-a28a-1ef48638809c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:10:14,490::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:10:14,513::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:14,520::task::1191::Storage.TaskManager.Task::(prepare) Task=`43ef4ca5-140a-4bac-a28a-1ef48638809c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:14,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`43ef4ca5-140a-4bac-a28a-1ef48638809c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:10:14,532::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:10:14,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:10:14,546::task::993::Storage.TaskManager.Task::(_decref) Task=`43ef4ca5-140a-4bac-a28a-1ef48638809c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:14,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121187 s, 8.4 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:10:14,654::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:10:14,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`aedb999d-73e5-47fc-be73-d79093f3e48a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:10:14,658::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:10:14,661::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`526a223c-8447-47b3-83b6-0b1d8c1eb8ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:10:14,661::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:10:14,663::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:10:14,664::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`526a223c-8447-47b3-83b6-0b1d8c1eb8ca`::Granted request >Thread-6940::DEBUG::2014-07-08 16:10:14,666::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`aedb999d-73e5-47fc-be73-d79093f3e48a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:10:14,667::task::993::Storage.TaskManager.Task::(_decref) Task=`aedb999d-73e5-47fc-be73-d79093f3e48a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:10:14,694::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:14,695::task::1191::Storage.TaskManager.Task::(prepare) Task=`aedb999d-73e5-47fc-be73-d79093f3e48a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:14,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`aedb999d-73e5-47fc-be73-d79093f3e48a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:10:14,696::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:10:14,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:10:14,698::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:10:14,699::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:10:14,700::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:10:14,700::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:10:14,702::task::993::Storage.TaskManager.Task::(_decref) Task=`aedb999d-73e5-47fc-be73-d79093f3e48a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:16,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:16,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174959 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:10:17,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`45e50f89-0969-4284-80fe-a150e659aabb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:10:17,480::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:10:17,481::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549778', 'lastCheck': '7.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:10:17,481::task::1191::Storage.TaskManager.Task::(prepare) Task=`45e50f89-0969-4284-80fe-a150e659aabb`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549778', 'lastCheck': '7.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:10:17,481::task::595::Storage.TaskManager.Task::(_updateState) Task=`45e50f89-0969-4284-80fe-a150e659aabb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:10:17,481::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:10:17,481::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:10:17,482::task::993::Storage.TaskManager.Task::(_decref) Task=`45e50f89-0969-4284-80fe-a150e659aabb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:18,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:19,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175507 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:20,423::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:20,424::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:10:20,424::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:20,425::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:20,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:20,425::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:20,425::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:20,426::__init__::225::IOProcess::(_processLogs) (272371) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:20,426::__init__::225::IOProcess::(_processLogs) (272371) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:20,426::__init__::225::IOProcess::(_processLogs) (272371) Building response >Thread-18::DEBUG::2014-07-08 16:10:20,426::__init__::225::IOProcess::(_processLogs) (272371) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:20,427::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:20,427::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:10:20,429::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:10:20,580::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000473512 s, 976 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:20,585::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:20,585::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:10:20,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:20,586::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:20,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:20,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:20,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:20,587::__init__::225::IOProcess::(_processLogs) (272372) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:20,587::__init__::225::IOProcess::(_processLogs) (272372) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:20,587::__init__::225::IOProcess::(_processLogs) (272372) Building response >Thread-18::DEBUG::2014-07-08 16:10:20,587::__init__::225::IOProcess::(_processLogs) (272372) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:20,588::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:20,588::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:10:20,590::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:10:20,591::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:20,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:20,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:20,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:20,592::__init__::225::IOProcess::(_processLogs) (272373) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:20,592::__init__::225::IOProcess::(_processLogs) (272373) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:20,592::__init__::225::IOProcess::(_processLogs) (272373) Building response >Thread-18::DEBUG::2014-07-08 16:10:20,592::__init__::225::IOProcess::(_processLogs) (272373) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:20,593::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:20,593::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:20,594::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:10:20,594::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:20,595::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:20,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:20,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:20,595::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:20,596::__init__::225::IOProcess::(_processLogs) (272374) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:20,596::__init__::225::IOProcess::(_processLogs) (272374) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:20,596::__init__::225::IOProcess::(_processLogs) (272374) Building response >Thread-18::DEBUG::2014-07-08 16:10:20,596::__init__::225::IOProcess::(_processLogs) (272374) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:20,596::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:20,597::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:20,598::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:20,598::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:10:20,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:20,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:20,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:20,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:20,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:20,600::__init__::225::IOProcess::(_processLogs) (272375) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:20,600::__init__::225::IOProcess::(_processLogs) (272375) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:20,600::__init__::225::IOProcess::(_processLogs) (272375) Building response >Thread-18::DEBUG::2014-07-08 16:10:20,600::__init__::225::IOProcess::(_processLogs) (272375) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:20,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:20,601::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:10:21,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:21,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176035 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:10:23,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:23,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211066 s, 48.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:10:24,718::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:10:24,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`552a9769-1457-44e4-9415-9bd0042d3f2a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:10:24,720::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:10:24,735::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:24,736::task::1191::Storage.TaskManager.Task::(prepare) Task=`552a9769-1457-44e4-9415-9bd0042d3f2a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:24,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`552a9769-1457-44e4-9415-9bd0042d3f2a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:10:24,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:10:24,741::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:10:24,742::task::993::Storage.TaskManager.Task::(_decref) Task=`552a9769-1457-44e4-9415-9bd0042d3f2a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:10:24,760::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:10:24,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`50e73339-6d6b-436e-837f-77c35b27c891`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:10:24,765::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:10:24,768::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ed91b314-9d19-4e08-98d1-bb81fe3bc114`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:10:24,768::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:10:24,769::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:10:24,769::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ed91b314-9d19-4e08-98d1-bb81fe3bc114`::Granted request >Thread-6940::DEBUG::2014-07-08 16:10:24,770::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`50e73339-6d6b-436e-837f-77c35b27c891`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:10:24,770::task::993::Storage.TaskManager.Task::(_decref) Task=`50e73339-6d6b-436e-837f-77c35b27c891`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:10:24,789::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:24,789::task::1191::Storage.TaskManager.Task::(prepare) Task=`50e73339-6d6b-436e-837f-77c35b27c891`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:24,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`50e73339-6d6b-436e-837f-77c35b27c891`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:10:24,790::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:10:24,790::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:10:24,790::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:10:24,791::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:10:24,791::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:10:24,791::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:10:24,792::task::993::Storage.TaskManager.Task::(_decref) Task=`50e73339-6d6b-436e-837f-77c35b27c891`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:25,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:26,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177146 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:10:28,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:28,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177233 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:10:30,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:30,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178828 s, 57.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:30,606::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:30,607::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:10:30,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:30,610::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:30,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:30,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:30,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:30,615::__init__::225::IOProcess::(_processLogs) (272376) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:30,616::__init__::225::IOProcess::(_processLogs) (272376) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:30,617::__init__::225::IOProcess::(_processLogs) (272376) Building response >Thread-18::DEBUG::2014-07-08 16:10:30,618::__init__::225::IOProcess::(_processLogs) (272376) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:30,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:30,621::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:10:30,626::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:10:30,776::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000843381 s, 548 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:30,868::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:30,871::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:10:30,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:30,872::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:30,873::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:30,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:30,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:30,885::__init__::225::IOProcess::(_processLogs) (272377) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:30,890::__init__::225::IOProcess::(_processLogs) (272377) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:30,898::__init__::225::IOProcess::(_processLogs) (272377) Building response >Thread-18::DEBUG::2014-07-08 16:10:30,903::__init__::225::IOProcess::(_processLogs) (272377) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:30,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:30,913::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:10:30,942::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:30,947::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:10:30,953::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:30,956::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:30,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:30,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:30,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:30,969::__init__::225::IOProcess::(_processLogs) (272378) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:30,972::__init__::225::IOProcess::(_processLogs) (272378) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:30,976::__init__::225::IOProcess::(_processLogs) (272378) Building response >Thread-18::DEBUG::2014-07-08 16:10:30,979::__init__::225::IOProcess::(_processLogs) (272378) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:30,981::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:30,984::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:30,996::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:30,997::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:10:30,998::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:30,999::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:31,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:31,001::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:31,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:31,004::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272379) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:31,005::__init__::225::IOProcess::(_processLogs) (272379) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:31,006::__init__::225::IOProcess::(_processLogs) (272379) Building response >Thread-18::DEBUG::2014-07-08 16:10:31,007::__init__::225::IOProcess::(_processLogs) (272379) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:31,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:31,009::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:31,012::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:31,013::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:10:31,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:31,014::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:31,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:31,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:31,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:31,015::__init__::225::IOProcess::(_processLogs) (272380) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:31,015::__init__::225::IOProcess::(_processLogs) (272380) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:31,015::__init__::225::IOProcess::(_processLogs) (272380) Building response >Thread-18::DEBUG::2014-07-08 16:10:31,015::__init__::225::IOProcess::(_processLogs) (272380) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:31,016::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:31,016::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:10:32,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`f16809eb-4171-40b2-8eda-dba73a83f30c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:10:32,719::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:10:32,719::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000843381', 'lastCheck': '1.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:10:32,719::task::1191::Storage.TaskManager.Task::(prepare) Task=`f16809eb-4171-40b2-8eda-dba73a83f30c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000843381', 'lastCheck': '1.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:10:32,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`f16809eb-4171-40b2-8eda-dba73a83f30c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:10:32,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:10:32,720::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:10:32,720::task::993::Storage.TaskManager.Task::(_decref) Task=`f16809eb-4171-40b2-8eda-dba73a83f30c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:33,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:33,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179099 s, 57.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:10:34,809::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:10:34,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`277b3008-077f-493f-9b51-9daf02383184`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:10:34,810::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:10:34,826::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:34,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`277b3008-077f-493f-9b51-9daf02383184`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:34,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`277b3008-077f-493f-9b51-9daf02383184`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:10:34,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:10:34,827::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:10:34,828::task::993::Storage.TaskManager.Task::(_decref) Task=`277b3008-077f-493f-9b51-9daf02383184`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:10:34,839::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:10:34,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`dedde6c2-94e3-43b3-ae1c-bece5c117047`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:10:34,840::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:10:34,841::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9c764089-72a1-4c78-a8c6-a1f991c3d6f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:10:34,841::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:10:34,842::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:10:34,842::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9c764089-72a1-4c78-a8c6-a1f991c3d6f9`::Granted request >Thread-6940::DEBUG::2014-07-08 16:10:34,845::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dedde6c2-94e3-43b3-ae1c-bece5c117047`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:10:34,845::task::993::Storage.TaskManager.Task::(_decref) Task=`dedde6c2-94e3-43b3-ae1c-bece5c117047`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:10:34,864::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:34,864::task::1191::Storage.TaskManager.Task::(prepare) Task=`dedde6c2-94e3-43b3-ae1c-bece5c117047`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:34,864::task::595::Storage.TaskManager.Task::(_updateState) Task=`dedde6c2-94e3-43b3-ae1c-bece5c117047`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:10:34,865::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:10:34,865::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:10:34,865::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:10:34,866::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:10:34,866::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:10:34,866::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:10:34,866::task::993::Storage.TaskManager.Task::(_decref) Task=`dedde6c2-94e3-43b3-ae1c-bece5c117047`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:35,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:35,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0221472 s, 46.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:10:37,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:37,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175001 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:10:39,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:40,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174624 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:41,021::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:41,022::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:10:41,022::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:41,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:41,023::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:41,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:41,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:41,023::__init__::225::IOProcess::(_processLogs) (272381) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:41,024::__init__::225::IOProcess::(_processLogs) (272381) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:41,024::__init__::225::IOProcess::(_processLogs) (272381) Building response >Thread-18::DEBUG::2014-07-08 16:10:41,024::__init__::225::IOProcess::(_processLogs) (272381) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:41,024::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:41,024::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:10:41,026::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:10:41,181::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000522399 s, 884 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:41,265::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:41,270::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:10:41,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:41,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:41,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:41,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:41,287::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:41,287::__init__::225::IOProcess::(_processLogs) (272382) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:41,287::__init__::225::IOProcess::(_processLogs) (272382) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:41,288::__init__::225::IOProcess::(_processLogs) (272382) Building response >Thread-18::DEBUG::2014-07-08 16:10:41,288::__init__::225::IOProcess::(_processLogs) (272382) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:41,288::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:41,288::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:10:41,305::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:41,306::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:10:41,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:41,309::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:41,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:41,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:41,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:41,317::__init__::225::IOProcess::(_processLogs) (272383) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:41,319::__init__::225::IOProcess::(_processLogs) (272383) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:41,319::__init__::225::IOProcess::(_processLogs) (272383) Building response >Thread-18::DEBUG::2014-07-08 16:10:41,321::__init__::225::IOProcess::(_processLogs) (272383) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:41,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:41,322::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:41,333::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:41,334::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:10:41,335::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:41,336::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:41,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:41,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:41,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:41,341::__init__::225::IOProcess::(_processLogs) (272384) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:41,342::__init__::225::IOProcess::(_processLogs) (272384) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:41,342::__init__::225::IOProcess::(_processLogs) (272384) Building response >Thread-18::DEBUG::2014-07-08 16:10:41,343::__init__::225::IOProcess::(_processLogs) (272384) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:41,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:41,343::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:41,344::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:41,345::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:10:41,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:41,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:41,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:41,346::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:41,346::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:41,347::__init__::225::IOProcess::(_processLogs) (272385) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:41,347::__init__::225::IOProcess::(_processLogs) (272385) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:41,347::__init__::225::IOProcess::(_processLogs) (272385) Building response >Thread-18::DEBUG::2014-07-08 16:10:41,347::__init__::225::IOProcess::(_processLogs) (272385) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:41,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:41,348::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:10:42,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:42,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173417 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:10:44,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:44,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273335 s, 37.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:10:44,879::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:10:44,880::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba73c8dc-0e8c-43c8-879a-9eb0a8e63ec1`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:10:44,881::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:10:44,895::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:44,896::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba73c8dc-0e8c-43c8-879a-9eb0a8e63ec1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:44,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba73c8dc-0e8c-43c8-879a-9eb0a8e63ec1`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:10:44,896::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:10:44,896::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:10:44,897::task::993::Storage.TaskManager.Task::(_decref) Task=`ba73c8dc-0e8c-43c8-879a-9eb0a8e63ec1`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:10:44,949::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:10:44,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`266e67cc-4fc0-4bdc-80c5-b5588ac1b85d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:10:44,951::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:10:44,952::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ef894df8-b4e9-4a8c-9830-c866a80936b4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:10:44,952::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:10:44,952::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:10:44,953::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ef894df8-b4e9-4a8c-9830-c866a80936b4`::Granted request >Thread-6940::DEBUG::2014-07-08 16:10:44,953::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`266e67cc-4fc0-4bdc-80c5-b5588ac1b85d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:10:44,954::task::993::Storage.TaskManager.Task::(_decref) Task=`266e67cc-4fc0-4bdc-80c5-b5588ac1b85d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:10:44,972::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:44,973::task::1191::Storage.TaskManager.Task::(prepare) Task=`266e67cc-4fc0-4bdc-80c5-b5588ac1b85d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:44,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`266e67cc-4fc0-4bdc-80c5-b5588ac1b85d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:10:44,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:10:44,974::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:10:44,974::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:10:44,974::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:10:44,974::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:10:44,975::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:10:44,975::task::993::Storage.TaskManager.Task::(_decref) Task=`266e67cc-4fc0-4bdc-80c5-b5588ac1b85d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:46,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:46,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177459 s, 57.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:10:47,873::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd4163ec-fc43-4d41-86c9-b05c6a4b1d13`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:10:47,873::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:10:47,874::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522399', 'lastCheck': '6.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:10:47,874::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd4163ec-fc43-4d41-86c9-b05c6a4b1d13`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522399', 'lastCheck': '6.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:10:47,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd4163ec-fc43-4d41-86c9-b05c6a4b1d13`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:10:47,874::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:10:47,875::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:10:47,875::task::993::Storage.TaskManager.Task::(_decref) Task=`dd4163ec-fc43-4d41-86c9-b05c6a4b1d13`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:48,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:49,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174037 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:10:51,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:10:51,375::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:51,376::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:10:51,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:51,376::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:51,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:51,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:51,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:51,377::__init__::225::IOProcess::(_processLogs) (272386) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:51,378::__init__::225::IOProcess::(_processLogs) (272386) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:51,383::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(272386) Building response >Thread-18::DEBUG::2014-07-08 16:10:51,384::__init__::225::IOProcess::(_processLogs) (272386) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:51,384::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:51,384::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:10:51,391::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:10:51,552::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000810138 s, 570 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:51,654::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:51,660::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:10:51,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:51,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:51,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:51,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:51,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:51,694::__init__::225::IOProcess::(_processLogs) (272387) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:10:51,699::__init__::225::IOProcess::(_processLogs) (272387) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:10:51,705::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(272387) Building response >Thread-18::DEBUG::2014-07-08 16:10:51,710::__init__::225::IOProcess::(_processLogs) (272387) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:51,715::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:51,719::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:10:51,828::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Dummy-6860::DEBUG::2014-07-08 16:10:51,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.361607 s, 2.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:10:51,832::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:10:51,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:51,840::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:51,843::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:51,846::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:51,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:51,854::__init__::225::IOProcess::(_processLogs) (272388) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:51,855::__init__::225::IOProcess::(_processLogs) (272388) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:51,856::__init__::225::IOProcess::(_processLogs) (272388) Building response >Thread-18::DEBUG::2014-07-08 16:10:51,857::__init__::225::IOProcess::(_processLogs) (272388) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:51,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:51,859::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:51,863::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:51,864::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:10:51,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:51,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:51,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:51,868::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:51,869::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:51,870::__init__::225::IOProcess::(_processLogs) (272389) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:51,871::__init__::225::IOProcess::(_processLogs) (272389) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:51,872::__init__::225::IOProcess::(_processLogs) (272389) Building response >Thread-18::DEBUG::2014-07-08 16:10:51,873::__init__::225::IOProcess::(_processLogs) (272389) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:51,874::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:51,875::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:10:51,878::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:10:51,879::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:10:51,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:10:51,881::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:10:51,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:10:51,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:10:51,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:10:51,885::__init__::225::IOProcess::(_processLogs) (272390) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:10:51,886::__init__::225::IOProcess::(_processLogs) (272390) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:10:51,887::__init__::225::IOProcess::(_processLogs) (272390) Building response >Thread-18::DEBUG::2014-07-08 16:10:51,888::__init__::225::IOProcess::(_processLogs) (272390) Queuing response >Thread-18::DEBUG::2014-07-08 16:10:51,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:10:51,890::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:10:53,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:54,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175892 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:10:54,990::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:10:54,991::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fcbd272-aecb-4e17-950d-b50f31d45f1c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:10:54,992::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:10:55,007::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:55,007::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fcbd272-aecb-4e17-950d-b50f31d45f1c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:10:55,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fcbd272-aecb-4e17-950d-b50f31d45f1c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:10:55,008::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:10:55,008::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:10:55,008::task::993::Storage.TaskManager.Task::(_decref) Task=`9fcbd272-aecb-4e17-950d-b50f31d45f1c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:10:55,019::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:10:55,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f5630fe-be30-4f44-b28d-6720e420e173`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:10:55,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:10:55,021::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a4b0ae6d-3e2a-4bca-8f74-5475f3c09f65`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:10:55,021::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:10:55,022::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:10:55,022::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a4b0ae6d-3e2a-4bca-8f74-5475f3c09f65`::Granted request >Thread-6940::DEBUG::2014-07-08 16:10:55,023::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7f5630fe-be30-4f44-b28d-6720e420e173`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:10:55,023::task::993::Storage.TaskManager.Task::(_decref) Task=`7f5630fe-be30-4f44-b28d-6720e420e173`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:10:55,042::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:55,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f5630fe-be30-4f44-b28d-6720e420e173`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:10:55,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f5630fe-be30-4f44-b28d-6720e420e173`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:10:55,043::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:10:55,043::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:10:55,043::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:10:55,044::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:10:55,044::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:10:55,044::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:10:55,044::task::993::Storage.TaskManager.Task::(_decref) Task=`7f5630fe-be30-4f44-b28d-6720e420e173`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:10:56,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:56,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172682 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:10:58,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:10:58,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175476 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:00,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:00,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176937 s, 57.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:01,896::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:01,896::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:01,897::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:01,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:01,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:01,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:01,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:01,898::__init__::225::IOProcess::(_processLogs) (272391) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:01,898::__init__::225::IOProcess::(_processLogs) (272391) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:01,899::__init__::225::IOProcess::(_processLogs) (272391) Building response >Thread-18::DEBUG::2014-07-08 16:11:01,899::__init__::225::IOProcess::(_processLogs) (272391) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:01,899::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:01,899::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:11:01,901::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:11:02,057::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000534132 s, 865 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:02,141::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:02,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:02,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:02,159::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:02,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:02,169::__init__::225::IOProcess::(_processLogs) (272392) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:02,174::__init__::225::IOProcess::(_processLogs) (272392) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:02,177::__init__::225::IOProcess::(_processLogs) (272392) Building response >Thread-18::DEBUG::2014-07-08 16:11:02,182::__init__::225::IOProcess::(_processLogs) (272392) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:02,183::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:02,185::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:11:02,198::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:11:02,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:02,201::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:02,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:02,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:02,205::__init__::225::IOProcess::(_processLogs) (272393) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:02,206::__init__::225::IOProcess::(_processLogs) (272393) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:02,207::__init__::225::IOProcess::(_processLogs) (272393) Building response >Thread-18::DEBUG::2014-07-08 16:11:02,209::__init__::225::IOProcess::(_processLogs) (272393) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:02,210::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:02,212::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:02,217::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:11:02,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:02,220::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:02,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:02,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:02,224::__init__::225::IOProcess::(_processLogs) (272394) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:02,224::__init__::225::IOProcess::(_processLogs) (272394) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:02,225::__init__::225::IOProcess::(_processLogs) (272394) Building response >Thread-18::DEBUG::2014-07-08 16:11:02,225::__init__::225::IOProcess::(_processLogs) (272394) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:02,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:02,225::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:02,226::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:11:02,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:02,227::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:02,227::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:02,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:02,229::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:11:02,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:11:03,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2014d66-8438-421d-8369-21955c33337a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:03,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:11:03,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534132', 'lastCheck': '0.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:11:03,148::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2014d66-8438-421d-8369-21955c33337a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534132', 'lastCheck': '0.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:11:03,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2014d66-8438-421d-8369-21955c33337a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:03,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:03,148::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:03,149::task::993::Storage.TaskManager.Task::(_decref) Task=`b2014d66-8438-421d-8369-21955c33337a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:11:03,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034204 s, 29.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:11:05,056::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:11:05,057::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac3e0ca4-d988-44da-9a08-b26458d16789`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:05,057::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:11:05,072::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:05,073::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac3e0ca4-d988-44da-9a08-b26458d16789`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:05,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac3e0ca4-d988-44da-9a08-b26458d16789`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:05,073::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:05,073::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:05,074::task::993::Storage.TaskManager.Task::(_decref) Task=`ac3e0ca4-d988-44da-9a08-b26458d16789`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:11:05,084::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:11:05,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`a66d073c-d2fe-4e4a-ae36-b5c23c55412d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:11:05,086::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:11:05,086::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fe61841c-6753-44fc-b45b-ec63a27cd018`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:11:05,087::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:11:05,087::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:11:05,087::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fe61841c-6753-44fc-b45b-ec63a27cd018`::Granted request >Thread-6940::DEBUG::2014-07-08 16:11:05,088::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a66d073c-d2fe-4e4a-ae36-b5c23c55412d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:11:05,088::task::993::Storage.TaskManager.Task::(_decref) Task=`a66d073c-d2fe-4e4a-ae36-b5c23c55412d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:11:05,107::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:05,108::task::1191::Storage.TaskManager.Task::(prepare) Task=`a66d073c-d2fe-4e4a-ae36-b5c23c55412d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:05,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`a66d073c-d2fe-4e4a-ae36-b5c23c55412d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:11:05,108::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:11:05,109::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:11:05,109::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:11:05,109::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:11:05,110::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:11:05,110::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:11:05,110::task::993::Storage.TaskManager.Task::(_decref) Task=`a66d073c-d2fe-4e4a-ae36-b5c23c55412d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:11:05,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:05,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175236 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:07,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:07,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176174 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:09,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:10,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176135 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:12,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:11:12,259::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:11:12,270::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:11:12,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,277::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,280::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,281::__init__::225::IOProcess::(_processLogs) (272396) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:11:12,282::__init__::225::IOProcess::(_processLogs) (272396) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:11:12,283::__init__::225::IOProcess::(_processLogs) (272396) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,284::__init__::225::IOProcess::(_processLogs) (272396) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,287::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:11:12,292::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:11:12,295::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,296::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,297::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,300::__init__::225::IOProcess::(_processLogs) (272397) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:11:12,302::__init__::225::IOProcess::(_processLogs) (272397) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:11:12,303::__init__::225::IOProcess::(_processLogs) (272397) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,305::__init__::225::IOProcess::(_processLogs) (272397) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,307::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:11:12,395::__init__::225::IOProcess::(_processLogs) Message size is 127 >Dummy-6860::DEBUG::2014-07-08 16:11:12,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0485913 s, 21.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:12,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,416::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,498::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,517::__init__::225::IOProcess::(_processLogs) (272398) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:11:12,522::__init__::225::IOProcess::(_processLogs) (272398) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:11:12,524::__init__::225::IOProcess::(_processLogs) (272398) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,526::__init__::225::IOProcess::(_processLogs) (272398) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,533::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:11:12,557::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:11:12,564::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,569::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,574::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,583::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,587::__init__::225::IOProcess::(_processLogs) (272399) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:11:12,591::__init__::225::IOProcess::(_processLogs) (272399) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:11:12,597::__init__::225::IOProcess::(_processLogs) (272399) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,610::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-37::DEBUG::2014-07-08 16:11:12,621::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:11:12,630::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:11:12,634::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,637::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,643::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,644::__init__::225::IOProcess::(_processLogs) (272400) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:11:12,645::__init__::225::IOProcess::(_processLogs) (272400) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:11:12,646::__init__::225::IOProcess::(_processLogs) (272400) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,647::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,648::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:11:12,650::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:11:12,653::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:11:12,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,656::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,658::__init__::225::IOProcess::(_processLogs) (272401) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:11:12,659::__init__::225::IOProcess::(_processLogs) (272401) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:11:12,660::__init__::225::IOProcess::(_processLogs) (272401) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,661::__init__::225::IOProcess::(_processLogs) (272401) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,663::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:11:12,665::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:11:12,668::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:11:12,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,670::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,673::__init__::225::IOProcess::(_processLogs) (272402) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:12,674::__init__::225::IOProcess::(_processLogs) (272402) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:12,675::__init__::225::IOProcess::(_processLogs) (272402) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,676::__init__::225::IOProcess::(_processLogs) (272402) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,678::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:12,681::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:11:12,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,683::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,684::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,686::__init__::225::IOProcess::(_processLogs) (272403) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:11:12,687::__init__::225::IOProcess::(_processLogs) (272403) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:11:12,688::__init__::225::IOProcess::(_processLogs) (272403) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,689::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,690::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:11:12,692::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:11:12,693::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:11:12,694::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:11:12,696::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:12,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,699::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,702::__init__::225::IOProcess::(_processLogs) (272404) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:12,703::__init__::225::IOProcess::(_processLogs) (272404) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:12,703::__init__::225::IOProcess::(_processLogs) (272404) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,704::__init__::225::IOProcess::(_processLogs) (272404) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,706::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:11:12,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:11:12,871::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0113816 s, 40.6 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:12,873::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:12,873::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:12,873::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,874::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,874::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,874::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,875::__init__::225::IOProcess::(_processLogs) (272405) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:12,875::__init__::225::IOProcess::(_processLogs) (272405) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:12,875::__init__::225::IOProcess::(_processLogs) (272405) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,875::__init__::225::IOProcess::(_processLogs) (272405) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,876::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:11:12,878::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:12,878::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:11:12,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,879::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,880::__init__::225::IOProcess::(_processLogs) (272406) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:12,880::__init__::225::IOProcess::(_processLogs) (272406) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:12,880::__init__::225::IOProcess::(_processLogs) (272406) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,881::__init__::225::IOProcess::(_processLogs) (272406) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,881::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,881::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:12,882::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:12,883::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:11:12,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,883::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,884::__init__::225::IOProcess::(_processLogs) (272407) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:12,884::__init__::225::IOProcess::(_processLogs) (272407) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:12,884::__init__::225::IOProcess::(_processLogs) (272407) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,885::__init__::225::IOProcess::(_processLogs) (272407) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,885::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,885::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:12,886::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:12,887::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:11:12,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:12,887::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:12,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:12,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:12,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:12,888::__init__::225::IOProcess::(_processLogs) (272408) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:12,888::__init__::225::IOProcess::(_processLogs) (272408) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:12,889::__init__::225::IOProcess::(_processLogs) (272408) Building response >Thread-18::DEBUG::2014-07-08 16:11:12,889::__init__::225::IOProcess::(_processLogs) (272408) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:12,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:12,889::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:11:14,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:15,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392833 s, 26.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:11:15,150::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:11:15,157::task::595::Storage.TaskManager.Task::(_updateState) Task=`74cc6a07-8a48-48d8-a7a6-c42180787d9f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:15,159::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:11:15,180::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:15,183::task::1191::Storage.TaskManager.Task::(prepare) Task=`74cc6a07-8a48-48d8-a7a6-c42180787d9f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:15,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`74cc6a07-8a48-48d8-a7a6-c42180787d9f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:15,188::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:15,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:15,192::task::993::Storage.TaskManager.Task::(_decref) Task=`74cc6a07-8a48-48d8-a7a6-c42180787d9f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:11:15,215::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:11:15,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`06f51078-5d4d-4c6c-a252-18358ee6927f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:11:15,221::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:11:15,228::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f9e95306-1fb8-4f22-a1eb-253eef676ea5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:11:15,230::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:11:15,233::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:11:15,235::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f9e95306-1fb8-4f22-a1eb-253eef676ea5`::Granted request >Thread-6940::DEBUG::2014-07-08 16:11:15,240::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`06f51078-5d4d-4c6c-a252-18358ee6927f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:11:15,243::task::993::Storage.TaskManager.Task::(_decref) Task=`06f51078-5d4d-4c6c-a252-18358ee6927f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:11:15,289::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:15,291::task::1191::Storage.TaskManager.Task::(prepare) Task=`06f51078-5d4d-4c6c-a252-18358ee6927f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:15,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`06f51078-5d4d-4c6c-a252-18358ee6927f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:11:15,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:11:15,296::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:11:15,299::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:11:15,302::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:11:15,304::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:11:15,305::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:11:15,309::task::993::Storage.TaskManager.Task::(_decref) Task=`06f51078-5d4d-4c6c-a252-18358ee6927f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:11:17,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:17,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185843 s, 55.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:11:18,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`55895e74-766e-4355-b605-9b74eb5c49a1`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:18,449::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:11:18,450::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113816', 'lastCheck': '5.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:11:18,450::task::1191::Storage.TaskManager.Task::(prepare) Task=`55895e74-766e-4355-b605-9b74eb5c49a1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113816', 'lastCheck': '5.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:11:18,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`55895e74-766e-4355-b605-9b74eb5c49a1`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:18,451::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:18,451::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:18,451::task::993::Storage.TaskManager.Task::(_decref) Task=`55895e74-766e-4355-b605-9b74eb5c49a1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:11:19,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:20,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175476 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:22,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:22,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175495 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:22,920::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:22,922::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:22,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:22,923::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:22,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:22,923::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:22,923::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:22,924::__init__::225::IOProcess::(_processLogs) (272409) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:22,924::__init__::225::IOProcess::(_processLogs) (272409) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:22,924::__init__::225::IOProcess::(_processLogs) (272409) Building response >Thread-18::DEBUG::2014-07-08 16:11:22,924::__init__::225::IOProcess::(_processLogs) (272409) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:22,925::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:22,925::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:11:22,930::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:11:23,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000475747 s, 971 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:23,082::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:23,082::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:23,082::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:23,083::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:23,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:23,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:23,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:23,084::__init__::225::IOProcess::(_processLogs) (272410) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:23,084::__init__::225::IOProcess::(_processLogs) (272410) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:23,084::__init__::225::IOProcess::(_processLogs) (272410) Building response >Thread-18::DEBUG::2014-07-08 16:11:23,084::__init__::225::IOProcess::(_processLogs) (272410) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:23,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:23,085::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:11:23,087::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:23,087::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:11:23,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:23,088::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:23,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:23,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:23,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:23,089::__init__::225::IOProcess::(_processLogs) (272411) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:23,089::__init__::225::IOProcess::(_processLogs) (272411) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:23,089::__init__::225::IOProcess::(_processLogs) (272411) Building response >Thread-18::DEBUG::2014-07-08 16:11:23,090::__init__::225::IOProcess::(_processLogs) (272411) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:23,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:23,090::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:23,091::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:23,091::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:11:23,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:23,092::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:23,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:23,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:23,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:23,093::__init__::225::IOProcess::(_processLogs) (272412) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:23,093::__init__::225::IOProcess::(_processLogs) (272412) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:23,093::__init__::225::IOProcess::(_processLogs) (272412) Building response >Thread-18::DEBUG::2014-07-08 16:11:23,094::__init__::225::IOProcess::(_processLogs) (272412) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:23,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:23,094::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:23,095::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:23,095::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:11:23,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:23,096::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:23,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:23,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:23,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:23,097::__init__::225::IOProcess::(_processLogs) (272413) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:23,097::__init__::225::IOProcess::(_processLogs) (272413) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:23,097::__init__::225::IOProcess::(_processLogs) (272413) Building response >Thread-18::DEBUG::2014-07-08 16:11:23,098::__init__::225::IOProcess::(_processLogs) (272413) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:23,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:23,098::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:11:24,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:24,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176431 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:11:25,330::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:11:25,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fe56772-a4e3-48f1-985d-2d8fb226dc05`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:25,332::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:11:25,347::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:25,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`4fe56772-a4e3-48f1-985d-2d8fb226dc05`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:25,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fe56772-a4e3-48f1-985d-2d8fb226dc05`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:25,348::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:25,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:25,348::task::993::Storage.TaskManager.Task::(_decref) Task=`4fe56772-a4e3-48f1-985d-2d8fb226dc05`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:11:25,360::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:11:25,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`52447e8d-0e84-4848-9dd2-156ea9e51448`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:11:25,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:11:25,362::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`20343d67-2562-41ba-8cbb-5069cfac1199`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:11:25,362::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:11:25,363::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:11:25,363::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`20343d67-2562-41ba-8cbb-5069cfac1199`::Granted request >Thread-6940::DEBUG::2014-07-08 16:11:25,364::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`52447e8d-0e84-4848-9dd2-156ea9e51448`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:11:25,364::task::993::Storage.TaskManager.Task::(_decref) Task=`52447e8d-0e84-4848-9dd2-156ea9e51448`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:11:25,383::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:25,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`52447e8d-0e84-4848-9dd2-156ea9e51448`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:25,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`52447e8d-0e84-4848-9dd2-156ea9e51448`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:11:25,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:11:25,384::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:11:25,385::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:11:25,385::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:11:25,385::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:11:25,385::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:11:25,386::task::993::Storage.TaskManager.Task::(_decref) Task=`52447e8d-0e84-4848-9dd2-156ea9e51448`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:11:26,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:26,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174414 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:28,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:29,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174331 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:31,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:31,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175468 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:33,101::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:33,102::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:33,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:33,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:33,102::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:33,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:33,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:33,103::__init__::225::IOProcess::(_processLogs) (272414) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:33,103::__init__::225::IOProcess::(_processLogs) (272414) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:33,104::__init__::225::IOProcess::(_processLogs) (272414) Building response >Thread-18::DEBUG::2014-07-08 16:11:33,104::__init__::225::IOProcess::(_processLogs) (272414) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:33,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:33,104::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:11:33,106::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:11:33,257::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000484966 s, 953 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:33,342::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:33,343::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:33,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:33,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:33,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:33,344::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:33,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:33,345::__init__::225::IOProcess::(_processLogs) (272415) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:33,348::__init__::225::IOProcess::(_processLogs) (272415) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:33,349::__init__::225::IOProcess::(_processLogs) (272415) Building response >Thread-18::DEBUG::2014-07-08 16:11:33,349::__init__::225::IOProcess::(_processLogs) (272415) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:33,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:33,350::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:11:33,353::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:33,353::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:11:33,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:33,354::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:33,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:33,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:33,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:33,355::__init__::225::IOProcess::(_processLogs) (272416) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:33,355::__init__::225::IOProcess::(_processLogs) (272416) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:33,355::__init__::225::IOProcess::(_processLogs) (272416) Building response >Thread-18::DEBUG::2014-07-08 16:11:33,356::__init__::225::IOProcess::(_processLogs) (272416) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:33,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:33,356::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:33,357::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:33,358::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:11:33,358::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:33,358::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:33,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:33,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:33,359::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:33,360::__init__::225::IOProcess::(_processLogs) (272417) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:33,360::__init__::225::IOProcess::(_processLogs) (272417) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:33,360::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|(272417) Building response >Thread-18::DEBUG::2014-07-08 16:11:33,361::__init__::225::IOProcess::(_processLogs) (272417) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:33,361::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:33,361::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:33,363::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:33,363::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:11:33,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:33,364::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:33,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:33,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:33,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:33,365::__init__::225::IOProcess::(_processLogs) (272418) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:33,365::__init__::225::IOProcess::(_processLogs) (272418) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:33,366::__init__::225::IOProcess::(_processLogs) (272418) Building response >Thread-18::DEBUG::2014-07-08 16:11:33,366::__init__::225::IOProcess::(_processLogs) (272418) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:33,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:33,366::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:11:33,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:33,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178124 s, 57.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:11:33,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`467b59b7-701a-409b-8072-dadfa801262f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:33,698::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:11:33,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484966', 'lastCheck': '0.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:11:33,703::task::1191::Storage.TaskManager.Task::(prepare) Task=`467b59b7-701a-409b-8072-dadfa801262f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484966', 'lastCheck': '0.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:11:33,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`467b59b7-701a-409b-8072-dadfa801262f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:33,705::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:33,707::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:33,709::task::993::Storage.TaskManager.Task::(_decref) Task=`467b59b7-701a-409b-8072-dadfa801262f`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:11:35,400::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:11:35,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`44e84bc2-2456-4360-9ae4-be6fdd932269`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:35,401::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:11:35,417::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:35,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`44e84bc2-2456-4360-9ae4-be6fdd932269`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:35,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`44e84bc2-2456-4360-9ae4-be6fdd932269`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:35,418::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:35,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:35,418::task::993::Storage.TaskManager.Task::(_decref) Task=`44e84bc2-2456-4360-9ae4-be6fdd932269`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:11:35,429::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:11:35,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8dd52e7-8a44-4450-8ef7-c82f4e93dc90`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:11:35,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:11:35,432::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e4c23e27-1d09-4fc0-8b8d-f2f4c1bf8195`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:11:35,432::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:11:35,432::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:11:35,433::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e4c23e27-1d09-4fc0-8b8d-f2f4c1bf8195`::Granted request >Thread-6940::DEBUG::2014-07-08 16:11:35,433::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c8dd52e7-8a44-4450-8ef7-c82f4e93dc90`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:11:35,433::task::993::Storage.TaskManager.Task::(_decref) Task=`c8dd52e7-8a44-4450-8ef7-c82f4e93dc90`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:11:35,452::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:35,453::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8dd52e7-8a44-4450-8ef7-c82f4e93dc90`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:35,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8dd52e7-8a44-4450-8ef7-c82f4e93dc90`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:11:35,453::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:11:35,454::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:11:35,454::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:11:35,455::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:11:35,455::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:11:35,455::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:11:35,455::task::993::Storage.TaskManager.Task::(_decref) Task=`c8dd52e7-8a44-4450-8ef7-c82f4e93dc90`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:11:35,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:36,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172543 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:38,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:38,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174127 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:40,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:40,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01729 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:42,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:43,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196674 s, 52.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:43,370::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:43,370::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:43,371::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:43,371::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:43,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:43,371::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:43,372::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:43,372::__init__::225::IOProcess::(_processLogs) (272419) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:43,372::__init__::225::IOProcess::(_processLogs) (272419) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:43,372::__init__::225::IOProcess::(_processLogs) (272419) Building response >Thread-18::DEBUG::2014-07-08 16:11:43,373::__init__::225::IOProcess::(_processLogs) (272419) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:43,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:43,373::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:11:43,375::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:11:43,523::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000502844 s, 919 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:43,525::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:43,526::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:43,526::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:43,526::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:43,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:43,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:43,527::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:43,527::__init__::225::IOProcess::(_processLogs) (272420) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:43,528::__init__::225::IOProcess::(_processLogs) (272420) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:43,528::__init__::225::IOProcess::(_processLogs) DEBUG|(272420) Building response >Thread-18::DEBUG::2014-07-08 16:11:43,528::__init__::225::IOProcess::(_processLogs) (272420) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:43,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:43,529::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:11:43,531::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:43,531::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:11:43,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:43,532::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:43,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:43,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:43,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:43,533::__init__::225::IOProcess::(_processLogs) (272421) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:43,533::__init__::225::IOProcess::(_processLogs) (272421) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:43,533::__init__::225::IOProcess::(_processLogs) (272421) Building response >Thread-18::DEBUG::2014-07-08 16:11:43,533::__init__::225::IOProcess::(_processLogs) (272421) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:43,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:43,534::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:43,535::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:43,535::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:11:43,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:43,536::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:43,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:43,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:43,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:43,537::__init__::225::IOProcess::(_processLogs) (272422) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:43,537::__init__::225::IOProcess::(_processLogs) (272422) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:43,537::__init__::225::IOProcess::(_processLogs) (272422) Building response >Thread-18::DEBUG::2014-07-08 16:11:43,537::__init__::225::IOProcess::(_processLogs) (272422) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:43,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:43,538::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:43,539::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:43,539::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:11:43,539::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:43,540::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:43,540::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:43,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:43,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:43,541::__init__::225::IOProcess::(_processLogs) (272423) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:43,541::__init__::225::IOProcess::(_processLogs) (272423) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:43,541::__init__::225::IOProcess::(_processLogs) (272423) Building response >Thread-18::DEBUG::2014-07-08 16:11:43,541::__init__::225::IOProcess::(_processLogs) (272423) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:43,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:43,542::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:11:45,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:45,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358489 s, 28.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:11:45,469::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:11:45,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`17b5ee97-11c4-4cc3-a467-265a177663c7`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:45,471::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:11:45,486::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:45,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`17b5ee97-11c4-4cc3-a467-265a177663c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:45,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`17b5ee97-11c4-4cc3-a467-265a177663c7`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:45,487::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:45,487::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:45,487::task::993::Storage.TaskManager.Task::(_decref) Task=`17b5ee97-11c4-4cc3-a467-265a177663c7`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:11:45,499::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:11:45,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`0712f787-20a2-4ba2-bdf0-49b54e9674b2`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:11:45,500::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:11:45,501::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f98a0a10-d5ed-477c-8433-5fdb7f9c3d21`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:11:45,501::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:11:45,501::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:11:45,502::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f98a0a10-d5ed-477c-8433-5fdb7f9c3d21`::Granted request >Thread-6940::DEBUG::2014-07-08 16:11:45,502::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0712f787-20a2-4ba2-bdf0-49b54e9674b2`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:11:45,503::task::993::Storage.TaskManager.Task::(_decref) Task=`0712f787-20a2-4ba2-bdf0-49b54e9674b2`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:11:45,521::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:45,522::task::1191::Storage.TaskManager.Task::(prepare) Task=`0712f787-20a2-4ba2-bdf0-49b54e9674b2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:45,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`0712f787-20a2-4ba2-bdf0-49b54e9674b2`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:11:45,522::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:11:45,523::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:11:45,523::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:11:45,524::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:11:45,524::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:11:45,524::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:11:45,524::task::993::Storage.TaskManager.Task::(_decref) Task=`0712f787-20a2-4ba2-bdf0-49b54e9674b2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:11:47,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:47,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177102 s, 57.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:11:49,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`26e743df-af4c-4230-9cc4-abd0d195d4cd`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:49,071::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:11:49,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502844', 'lastCheck': '5.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:11:49,072::task::1191::Storage.TaskManager.Task::(prepare) Task=`26e743df-af4c-4230-9cc4-abd0d195d4cd`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502844', 'lastCheck': '5.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:11:49,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`26e743df-af4c-4230-9cc4-abd0d195d4cd`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:49,073::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:49,073::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:49,073::task::993::Storage.TaskManager.Task::(_decref) Task=`26e743df-af4c-4230-9cc4-abd0d195d4cd`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:11:49,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:49,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172531 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:51,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:52,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174917 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:53,545::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:53,545::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:53,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:53,546::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:53,546::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:53,546::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:53,546::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:53,547::__init__::225::IOProcess::(_processLogs) (272424) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:53,547::__init__::225::IOProcess::(_processLogs) (272424) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:53,547::__init__::225::IOProcess::(_processLogs) (272424) Building response >Thread-18::DEBUG::2014-07-08 16:11:53,547::__init__::225::IOProcess::(_processLogs) (272424) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:53,548::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:53,548::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:11:53,549::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:11:53,702::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000555085 s, 832 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:11:53,704::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:53,704::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:11:53,705::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:53,705::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:53,705::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:53,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:53,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:53,706::__init__::225::IOProcess::(_processLogs) (272425) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:11:53,706::__init__::225::IOProcess::(_processLogs) (272425) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:11:53,706::__init__::225::IOProcess::(_processLogs) (272425) Building response >Thread-18::DEBUG::2014-07-08 16:11:53,707::__init__::225::IOProcess::(_processLogs) (272425) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:53,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:53,707::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:11:53,709::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:53,709::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:11:53,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:53,710::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:53,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:53,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:53,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:53,711::__init__::225::IOProcess::(_processLogs) (272426) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:53,711::__init__::225::IOProcess::(_processLogs) (272426) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:53,711::__init__::225::IOProcess::(_processLogs) (272426) Building response >Thread-18::DEBUG::2014-07-08 16:11:53,712::__init__::225::IOProcess::(_processLogs) (272426) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:53,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:53,712::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:53,713::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:53,714::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:11:53,714::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:53,714::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:53,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:53,715::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:53,715::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:53,715::__init__::225::IOProcess::(_processLogs) (272427) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:53,715::__init__::225::IOProcess::(_processLogs) (272427) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:53,716::__init__::225::IOProcess::(_processLogs) (272427) Building response >Thread-18::DEBUG::2014-07-08 16:11:53,716::__init__::225::IOProcess::(_processLogs) (272427) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:53,716::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:53,716::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:11:53,717::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:11:53,717::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:11:53,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:11:53,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:11:53,718::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:11:53,719::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:11:53,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:11:53,719::__init__::225::IOProcess::(_processLogs) (272428) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:11:53,719::__init__::225::IOProcess::(_processLogs) (272428) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:11:53,719::__init__::225::IOProcess::(_processLogs) (272428) Building response >Thread-18::DEBUG::2014-07-08 16:11:53,720::__init__::225::IOProcess::(_processLogs) (272428) Queuing response >Thread-18::DEBUG::2014-07-08 16:11:53,720::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:11:53,720::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:11:54,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:54,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175068 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:11:55,537::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:11:55,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`23f15bf0-2f9d-4a0f-b690-7ccaff7d6ee9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:11:55,538::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:11:55,553::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:55,554::task::1191::Storage.TaskManager.Task::(prepare) Task=`23f15bf0-2f9d-4a0f-b690-7ccaff7d6ee9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:11:55,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`23f15bf0-2f9d-4a0f-b690-7ccaff7d6ee9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:11:55,554::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:11:55,555::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:11:55,555::task::993::Storage.TaskManager.Task::(_decref) Task=`23f15bf0-2f9d-4a0f-b690-7ccaff7d6ee9`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:11:55,567::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:11:55,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`909bb99b-d1ed-4ec4-a7a1-6f94511e32eb`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:11:55,569::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:11:55,570::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`38d50a4f-6896-4850-9a97-55b17f4c991a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:11:55,570::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:11:55,570::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:11:55,571::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`38d50a4f-6896-4850-9a97-55b17f4c991a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:11:55,571::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`909bb99b-d1ed-4ec4-a7a1-6f94511e32eb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:11:55,572::task::993::Storage.TaskManager.Task::(_decref) Task=`909bb99b-d1ed-4ec4-a7a1-6f94511e32eb`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:11:55,591::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:55,591::task::1191::Storage.TaskManager.Task::(prepare) Task=`909bb99b-d1ed-4ec4-a7a1-6f94511e32eb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:11:55,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`909bb99b-d1ed-4ec4-a7a1-6f94511e32eb`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:11:55,592::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:11:55,592::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:11:55,592::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:11:55,593::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:11:55,593::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:11:55,593::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:11:55,594::task::993::Storage.TaskManager.Task::(_decref) Task=`909bb99b-d1ed-4ec4-a7a1-6f94511e32eb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:11:56,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:56,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172009 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:11:58,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:11:59,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176049 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:01,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:01,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174856 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:03,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:03,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361945 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:03,725::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:03,727::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:03,728::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:03,730::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:03,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:03,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:03,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:03,735::__init__::225::IOProcess::(_processLogs) (272429) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:03,736::__init__::225::IOProcess::(_processLogs) (272429) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:03,738::__init__::225::IOProcess::(_processLogs) (272429) Building response >Thread-18::DEBUG::2014-07-08 16:12:03,739::__init__::225::IOProcess::(_processLogs) (272429) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:03,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:03,741::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:12:03,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:12:03,894::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000487201 s, 948 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:03,899::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:03,900::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:03,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:03,903::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:03,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:03,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:03,907::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:03,908::__init__::225::IOProcess::(_processLogs) (272430) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:03,909::__init__::225::IOProcess::(_processLogs) (272430) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:03,910::__init__::225::IOProcess::(_processLogs) (272430) Building response >Thread-18::DEBUG::2014-07-08 16:12:03,911::__init__::225::IOProcess::(_processLogs) (272430) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:03,912::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:03,913::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:12:03,920::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:03,922::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:12:03,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:03,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:03,925::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:03,927::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:03,928::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:03,929::__init__::225::IOProcess::(_processLogs) (272431) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:03,930::__init__::225::IOProcess::(_processLogs) (272431) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:03,932::__init__::225::IOProcess::(_processLogs) (272431) Building response >Thread-18::DEBUG::2014-07-08 16:12:03,933::__init__::225::IOProcess::(_processLogs) (272431) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:03,935::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:12:03,936::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:03,942::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:03,943::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:12:03,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:03,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:03,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:03,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:03,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:03,952::__init__::225::IOProcess::(_processLogs) (272432) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:03,953::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272432) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:03,955::__init__::225::IOProcess::(_processLogs) (272432) Building response >Thread-18::DEBUG::2014-07-08 16:12:03,956::__init__::225::IOProcess::(_processLogs) (272432) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:03,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:03,959::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:03,965::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:03,966::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:12:03,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:03,969::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:03,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:03,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:03,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:03,974::__init__::225::IOProcess::(_processLogs) (272433) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:03,976::__init__::225::IOProcess::(_processLogs) (272433) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:03,977::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272433) Building response >Thread-18::DEBUG::2014-07-08 16:12:03,979::__init__::225::IOProcess::(_processLogs) (272433) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:03,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:03,981::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:12:04,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`eac18638-6dac-4298-aabc-3d6bab507e14`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:04,358::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:12:04,439::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487201', 'lastCheck': '0.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:12:04,442::task::1191::Storage.TaskManager.Task::(prepare) Task=`eac18638-6dac-4298-aabc-3d6bab507e14`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487201', 'lastCheck': '0.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:12:04,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`eac18638-6dac-4298-aabc-3d6bab507e14`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:04,444::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:04,445::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:04,446::task::993::Storage.TaskManager.Task::(_decref) Task=`eac18638-6dac-4298-aabc-3d6bab507e14`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:12:05,608::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:12:05,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ebebd2e-44dd-4db2-b54f-d796e21cbebb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:05,609::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:12:05,624::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:05,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`3ebebd2e-44dd-4db2-b54f-d796e21cbebb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:05,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ebebd2e-44dd-4db2-b54f-d796e21cbebb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:05,625::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:05,626::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:05,626::task::993::Storage.TaskManager.Task::(_decref) Task=`3ebebd2e-44dd-4db2-b54f-d796e21cbebb`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:12:05,639::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:12:05,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bb6c1cf-8fa1-4665-9876-ddbb9dc33c44`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:12:05,640::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:12:05,641::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`772ad15c-c178-414e-8a1c-f5d4ad0699cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:12:05,641::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:12:05,642::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:12:05,642::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`772ad15c-c178-414e-8a1c-f5d4ad0699cd`::Granted request >Thread-6940::DEBUG::2014-07-08 16:12:05,643::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5bb6c1cf-8fa1-4665-9876-ddbb9dc33c44`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:12:05,643::task::993::Storage.TaskManager.Task::(_decref) Task=`5bb6c1cf-8fa1-4665-9876-ddbb9dc33c44`::ref 1 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:05,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6940::INFO::2014-07-08 16:12:05,844::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:05,848::task::1191::Storage.TaskManager.Task::(prepare) Task=`5bb6c1cf-8fa1-4665-9876-ddbb9dc33c44`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:05,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bb6c1cf-8fa1-4665-9876-ddbb9dc33c44`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:12:05,853::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:12:05,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:12:05,860::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:12:05,864::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:12:05,866::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:12:05,868::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:12:05,873::task::993::Storage.TaskManager.Task::(_decref) Task=`5bb6c1cf-8fa1-4665-9876-ddbb9dc33c44`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:05,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0739514 s, 13.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:08,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:08,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175325 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:10,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:10,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186075 s, 55.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:12,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:12,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173783 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:13,987::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:13,987::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:13,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:13,988::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:13,988::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:13,989::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:13,989::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:13,989::__init__::225::IOProcess::(_processLogs) (272434) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:13,990::__init__::225::IOProcess::(_processLogs) (272434) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:13,990::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272434) Building response >Thread-18::DEBUG::2014-07-08 16:12:13,990::__init__::225::IOProcess::(_processLogs) (272434) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:13,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:13,991::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:12:13,992::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:12:14,137::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000462058 s, 1000 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:14,140::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:14,140::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:14,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:14,141::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:14,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:14,141::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:14,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:14,142::__init__::225::IOProcess::(_processLogs) (272435) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:14,142::__init__::225::IOProcess::(_processLogs) (272435) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:14,142::__init__::225::IOProcess::(_processLogs) (272435) Building response >Thread-18::DEBUG::2014-07-08 16:12:14,142::__init__::225::IOProcess::(_processLogs) (272435) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:14,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:14,143::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:12:14,145::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:14,145::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:12:14,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:14,146::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:14,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:14,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:14,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:14,147::__init__::225::IOProcess::(_processLogs) (272436) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:14,147::__init__::225::IOProcess::(_processLogs) (272436) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:14,147::__init__::225::IOProcess::(_processLogs) (272436) Building response >Thread-18::DEBUG::2014-07-08 16:12:14,148::__init__::225::IOProcess::(_processLogs) (272436) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:14,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:14,148::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:14,149::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:14,149::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:12:14,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:14,150::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:14,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:14,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:14,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:14,151::__init__::225::IOProcess::(_processLogs) (272437) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:14,151::__init__::225::IOProcess::(_processLogs) (272437) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:14,151::__init__::225::IOProcess::(_processLogs) (272437) Building response >Thread-18::DEBUG::2014-07-08 16:12:14,152::__init__::225::IOProcess::(_processLogs) (272437) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:14,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:14,152::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:14,153::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:14,153::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:12:14,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:14,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:14,154::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:14,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:14,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:14,155::__init__::225::IOProcess::(_processLogs) (272438) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:14,155::__init__::225::IOProcess::(_processLogs) (272438) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:14,156::__init__::225::IOProcess::(_processLogs) (272438) Building response >Thread-18::DEBUG::2014-07-08 16:12:14,156::__init__::225::IOProcess::(_processLogs) (272438) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:14,156::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:14,156::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:12:14,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:15,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174375 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:12:15,977::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:12:15,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`764244a8-72af-4630-b55c-514982d50585`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:15,979::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:12:15,994::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:15,994::task::1191::Storage.TaskManager.Task::(prepare) Task=`764244a8-72af-4630-b55c-514982d50585`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:15,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`764244a8-72af-4630-b55c-514982d50585`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:15,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:15,995::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:15,995::task::993::Storage.TaskManager.Task::(_decref) Task=`764244a8-72af-4630-b55c-514982d50585`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:12:16,007::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:12:16,008::task::595::Storage.TaskManager.Task::(_updateState) Task=`9590bd8c-2fd7-4af4-9d97-1725f4e3b8f9`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:12:16,008::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:12:16,009::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3c3fc0f1-ef20-47fe-b44f-08094c6d9538`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:12:16,009::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:12:16,010::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:12:16,010::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3c3fc0f1-ef20-47fe-b44f-08094c6d9538`::Granted request >Thread-6940::DEBUG::2014-07-08 16:12:16,011::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9590bd8c-2fd7-4af4-9d97-1725f4e3b8f9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:12:16,011::task::993::Storage.TaskManager.Task::(_decref) Task=`9590bd8c-2fd7-4af4-9d97-1725f4e3b8f9`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:12:16,030::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:16,030::task::1191::Storage.TaskManager.Task::(prepare) Task=`9590bd8c-2fd7-4af4-9d97-1725f4e3b8f9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:16,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`9590bd8c-2fd7-4af4-9d97-1725f4e3b8f9`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:12:16,031::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:12:16,031::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:12:16,032::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:12:16,032::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:12:16,032::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:12:16,032::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:12:16,033::task::993::Storage.TaskManager.Task::(_decref) Task=`9590bd8c-2fd7-4af4-9d97-1725f4e3b8f9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:17,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:17,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172976 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:19,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:12:19,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0d52ddc-a180-4527-aff6-7342fa7e5ed7`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:19,682::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:12:19,682::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462058', 'lastCheck': '5.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:12:19,683::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0d52ddc-a180-4527-aff6-7342fa7e5ed7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462058', 'lastCheck': '5.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:12:19,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0d52ddc-a180-4527-aff6-7342fa7e5ed7`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:19,683::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:19,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:19,684::task::993::Storage.TaskManager.Task::(_decref) Task=`d0d52ddc-a180-4527-aff6-7342fa7e5ed7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:19,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030973 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:21,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:22,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176448 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:24,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:12:24,289::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:24,289::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:24,290::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:24,290::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:24,290::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:24,290::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:24,291::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:24,291::__init__::225::IOProcess::(_processLogs) (272439) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:24,292::__init__::225::IOProcess::(_processLogs) (272439) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:24,298::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272439) Building response >Thread-18::DEBUG::2014-07-08 16:12:24,299::__init__::225::IOProcess::(_processLogs) (272439) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:24,301::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:12:24,302::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:12:24,310::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:24,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.17394 s, 5.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:12:24,545::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00621935 s, 74.3 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:24,548::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:24,550::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:24,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:24,552::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:24,553::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:24,554::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:24,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:24,556::__init__::225::IOProcess::(_processLogs) (272440) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:24,557::__init__::225::IOProcess::(_processLogs) (272440) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:24,557::__init__::225::IOProcess::(_processLogs) (272440) Building response >Thread-18::DEBUG::2014-07-08 16:12:24,558::__init__::225::IOProcess::(_processLogs) (272440) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:24,559::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:24,560::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:12:24,566::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:24,566::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:12:24,567::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:24,567::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:24,568::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:24,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:24,568::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:24,569::__init__::225::IOProcess::(_processLogs) (272441) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:24,569::__init__::225::IOProcess::(_processLogs) (272441) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:24,569::__init__::225::IOProcess::(_processLogs) (272441) Building response >Thread-18::DEBUG::2014-07-08 16:12:24,570::__init__::225::IOProcess::(_processLogs) (272441) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:24,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:24,571::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:24,574::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:24,576::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:12:24,577::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:24,579::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:24,580::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:24,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:24,582::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:24,583::__init__::225::IOProcess::(_processLogs) (272442) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:24,584::__init__::225::IOProcess::(_processLogs) (272442) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:24,585::__init__::225::IOProcess::(_processLogs) (272442) Building response >Thread-18::DEBUG::2014-07-08 16:12:24,586::__init__::225::IOProcess::(_processLogs) (272442) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:24,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:24,588::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:24,592::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:24,593::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:12:24,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:24,596::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:24,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:24,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:24,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:24,600::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272443) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:24,601::__init__::225::IOProcess::(_processLogs) (272443) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:24,602::__init__::225::IOProcess::(_processLogs) (272443) Building response >Thread-18::DEBUG::2014-07-08 16:12:24,603::__init__::225::IOProcess::(_processLogs) (272443) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:24,604::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:24,605::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:12:26,050::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:12:26,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffe961e7-dc49-4a6b-8cfd-973b34d1ce12`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:26,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:12:26,066::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:26,067::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffe961e7-dc49-4a6b-8cfd-973b34d1ce12`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:26,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffe961e7-dc49-4a6b-8cfd-973b34d1ce12`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:26,067::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:26,067::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:26,068::task::993::Storage.TaskManager.Task::(_decref) Task=`ffe961e7-dc49-4a6b-8cfd-973b34d1ce12`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:12:26,080::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:12:26,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`963a4bbb-e5d4-46a6-8be9-d3937e386e56`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:12:26,081::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:12:26,082::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`baff94d5-7690-426b-87e1-3be4f1f3d872`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:12:26,082::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:12:26,083::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:12:26,083::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`baff94d5-7690-426b-87e1-3be4f1f3d872`::Granted request >Thread-6940::DEBUG::2014-07-08 16:12:26,084::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`963a4bbb-e5d4-46a6-8be9-d3937e386e56`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:12:26,084::task::993::Storage.TaskManager.Task::(_decref) Task=`963a4bbb-e5d4-46a6-8be9-d3937e386e56`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:12:26,103::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:26,104::task::1191::Storage.TaskManager.Task::(prepare) Task=`963a4bbb-e5d4-46a6-8be9-d3937e386e56`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:26,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`963a4bbb-e5d4-46a6-8be9-d3937e386e56`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:12:26,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:12:26,104::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:12:26,105::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:12:26,105::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:12:26,106::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:12:26,106::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:12:26,106::task::993::Storage.TaskManager.Task::(_decref) Task=`963a4bbb-e5d4-46a6-8be9-d3937e386e56`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:26,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:26,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176152 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:28,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:29,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017437 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:31,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:31,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173694 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:33,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:33,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179901 s, 56.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:34,612::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:34,615::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:34,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:34,618::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:34,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:34,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:34,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:34,622::__init__::225::IOProcess::(_processLogs) (272444) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:34,623::__init__::225::IOProcess::(_processLogs) (272444) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:34,624::__init__::225::IOProcess::(_processLogs) (272444) Building response >Thread-18::DEBUG::2014-07-08 16:12:34,626::__init__::225::IOProcess::(_processLogs) (272444) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:34,627::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:34,628::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:12:34,633::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:12:34,781::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0005048 s, 915 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:34,783::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:34,783::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:34,784::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:34,784::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:34,784::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:34,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:34,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:34,785::__init__::225::IOProcess::(_processLogs) (272445) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:34,785::__init__::225::IOProcess::(_processLogs) (272445) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:34,785::__init__::225::IOProcess::(_processLogs) (272445) Building response >Thread-18::DEBUG::2014-07-08 16:12:34,786::__init__::225::IOProcess::(_processLogs) (272445) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:34,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:34,786::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:12:34,789::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:34,789::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:12:34,789::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:34,789::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:34,790::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:34,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:34,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:34,790::__init__::225::IOProcess::(_processLogs) (272446) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:34,791::__init__::225::IOProcess::(_processLogs) (272446) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:34,791::__init__::225::IOProcess::(_processLogs) (272446) Building response >Thread-18::DEBUG::2014-07-08 16:12:34,791::__init__::225::IOProcess::(_processLogs) (272446) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:34,791::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:34,791::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:34,793::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:34,793::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:12:34,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:34,793::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:34,794::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:34,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:34,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:34,794::__init__::225::IOProcess::(_processLogs) (272447) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:34,795::__init__::225::IOProcess::(_processLogs) (272447) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:34,795::__init__::225::IOProcess::(_processLogs) (272447) Building response >Thread-18::DEBUG::2014-07-08 16:12:34,795::__init__::225::IOProcess::(_processLogs) (272447) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:34,795::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:34,796::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:34,797::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:34,797::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:12:34,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:34,797::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:34,798::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:34,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:34,798::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:34,798::__init__::225::IOProcess::(_processLogs) (272448) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:34,799::__init__::225::IOProcess::(_processLogs) (272448) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:34,799::__init__::225::IOProcess::(_processLogs) (272448) Building response >Thread-18::DEBUG::2014-07-08 16:12:34,799::__init__::225::IOProcess::(_processLogs) (272448) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:34,799::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:34,800::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:12:35,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`14e92a39-42f3-47c1-96b1-c8e15a202e9b`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:35,081::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:12:35,081::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005048', 'lastCheck': '0.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:12:35,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`14e92a39-42f3-47c1-96b1-c8e15a202e9b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005048', 'lastCheck': '0.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:12:35,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`14e92a39-42f3-47c1-96b1-c8e15a202e9b`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:35,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:35,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:35,083::task::993::Storage.TaskManager.Task::(_decref) Task=`14e92a39-42f3-47c1-96b1-c8e15a202e9b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:35,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:36,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382486 s, 26.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:12:36,174::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [52b30540] >Thread-6941::DEBUG::2014-07-08 16:12:36,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`f16ae577-e031-4ade-91f0-e1480a5e79d7`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:36,179::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:12:36,196::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:36,197::task::1191::Storage.TaskManager.Task::(prepare) Task=`f16ae577-e031-4ade-91f0-e1480a5e79d7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:36,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`f16ae577-e031-4ade-91f0-e1480a5e79d7`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:36,198::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:36,199::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:36,200::task::993::Storage.TaskManager.Task::(_decref) Task=`f16ae577-e031-4ade-91f0-e1480a5e79d7`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:12:36,213::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [52b30540] >Thread-6940::DEBUG::2014-07-08 16:12:36,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cd1d44a-d4da-4ac0-b2f8-1c8f04952ed9`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:12:36,214::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:12:36,215::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7796fa37-5e4c-4f5b-9c63-7238d7c32591`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:12:36,215::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:12:36,216::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:12:36,216::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7796fa37-5e4c-4f5b-9c63-7238d7c32591`::Granted request >Thread-6940::DEBUG::2014-07-08 16:12:36,217::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0cd1d44a-d4da-4ac0-b2f8-1c8f04952ed9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:12:36,217::task::993::Storage.TaskManager.Task::(_decref) Task=`0cd1d44a-d4da-4ac0-b2f8-1c8f04952ed9`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:12:36,236::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:36,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`0cd1d44a-d4da-4ac0-b2f8-1c8f04952ed9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:36,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cd1d44a-d4da-4ac0-b2f8-1c8f04952ed9`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:12:36,237::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:12:36,237::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:12:36,238::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:12:36,238::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:12:36,238::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:12:36,238::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:12:36,239::task::993::Storage.TaskManager.Task::(_decref) Task=`0cd1d44a-d4da-4ac0-b2f8-1c8f04952ed9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:38,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:38,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172017 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:40,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:40,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0844184 s, 12.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:42,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:43,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173308 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:44,802::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:44,803::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:44,803::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:44,803::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:44,804::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:44,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:44,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:44,804::__init__::225::IOProcess::(_processLogs) (272449) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:44,805::__init__::225::IOProcess::(_processLogs) (272449) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:44,805::__init__::225::IOProcess::(_processLogs) (272449) Building response >Thread-18::DEBUG::2014-07-08 16:12:44,805::__init__::225::IOProcess::(_processLogs) (272449) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:44,805::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:44,806::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:12:44,808::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:12:44,961::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00047407 s, 975 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:44,963::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:44,964::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:44,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:44,964::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:44,965::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:44,965::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:44,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:44,965::__init__::225::IOProcess::(_processLogs) (272450) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:44,965::__init__::225::IOProcess::(_processLogs) (272450) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:44,966::__init__::225::IOProcess::(_processLogs) (272450) Building response >Thread-18::DEBUG::2014-07-08 16:12:44,966::__init__::225::IOProcess::(_processLogs) (272450) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:44,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:44,966::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:12:44,969::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:44,969::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:12:44,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:44,970::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:44,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:44,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:44,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:44,971::__init__::225::IOProcess::(_processLogs) (272451) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:44,971::__init__::225::IOProcess::(_processLogs) (272451) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:44,971::__init__::225::IOProcess::(_processLogs) (272451) Building response >Thread-18::DEBUG::2014-07-08 16:12:44,972::__init__::225::IOProcess::(_processLogs) (272451) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:44,972::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:44,972::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:44,973::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:44,974::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:12:44,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:44,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:44,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:44,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:44,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:44,975::__init__::225::IOProcess::(_processLogs) (272452) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:44,975::__init__::225::IOProcess::(_processLogs) (272452) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:44,976::__init__::225::IOProcess::(_processLogs) (272452) Building response >Thread-18::DEBUG::2014-07-08 16:12:44,976::__init__::225::IOProcess::(_processLogs) (272452) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:44,976::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:44,976::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:44,977::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:44,978::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:12:44,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:44,978::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:44,979::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:44,979::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:44,979::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:44,979::__init__::225::IOProcess::(_processLogs) (272453) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:44,979::__init__::225::IOProcess::(_processLogs) (272453) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:44,980::__init__::225::IOProcess::(_processLogs) (272453) Building response >Thread-18::DEBUG::2014-07-08 16:12:44,980::__init__::225::IOProcess::(_processLogs) (272453) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:44,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:44,980::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:12:45,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:45,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171165 s, 59.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:12:46,252::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:12:46,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`497dfdff-5dab-41aa-b6a6-58e5a47397fb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:46,254::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:12:46,270::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:46,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`497dfdff-5dab-41aa-b6a6-58e5a47397fb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:46,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`497dfdff-5dab-41aa-b6a6-58e5a47397fb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:46,273::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:46,274::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:46,275::task::993::Storage.TaskManager.Task::(_decref) Task=`497dfdff-5dab-41aa-b6a6-58e5a47397fb`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:12:46,289::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:12:46,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`43a4f08f-d767-4c06-a16d-34f770ea60a0`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:12:46,290::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:12:46,291::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a7b83cc3-4795-4854-a9c1-15ae8d14e50b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:12:46,292::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:12:46,292::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:12:46,292::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a7b83cc3-4795-4854-a9c1-15ae8d14e50b`::Granted request >Thread-6940::DEBUG::2014-07-08 16:12:46,293::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`43a4f08f-d767-4c06-a16d-34f770ea60a0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:12:46,293::task::993::Storage.TaskManager.Task::(_decref) Task=`43a4f08f-d767-4c06-a16d-34f770ea60a0`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:12:46,313::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:46,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`43a4f08f-d767-4c06-a16d-34f770ea60a0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:46,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`43a4f08f-d767-4c06-a16d-34f770ea60a0`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:12:46,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:12:46,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:12:46,314::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:12:46,315::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:12:46,315::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:12:46,315::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:12:46,316::task::993::Storage.TaskManager.Task::(_decref) Task=`43a4f08f-d767-4c06-a16d-34f770ea60a0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:47,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:47,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174954 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:49,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:49,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175532 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:12:50,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`43e8e2f4-306f-417b-a5dc-030434f89399`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:50,237::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:12:50,238::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047407', 'lastCheck': '5.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:12:50,238::task::1191::Storage.TaskManager.Task::(prepare) Task=`43e8e2f4-306f-417b-a5dc-030434f89399`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047407', 'lastCheck': '5.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:12:50,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`43e8e2f4-306f-417b-a5dc-030434f89399`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:50,238::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:50,239::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:50,239::task::993::Storage.TaskManager.Task::(_decref) Task=`43e8e2f4-306f-417b-a5dc-030434f89399`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:51,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:52,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172791 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:54,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:54,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334473 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:54,983::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:54,984::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:54,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:54,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:54,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:54,985::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:54,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:54,985::__init__::225::IOProcess::(_processLogs) (272454) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:54,985::__init__::225::IOProcess::(_processLogs) (272454) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:54,986::__init__::225::IOProcess::(_processLogs) (272454) Building response >Thread-18::DEBUG::2014-07-08 16:12:54,986::__init__::225::IOProcess::(_processLogs) (272454) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:54,986::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:54,986::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:12:54,988::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:12:55,131::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000439989 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:12:55,133::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:55,134::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:12:55,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:55,134::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:55,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:55,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:55,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:55,135::__init__::225::IOProcess::(_processLogs) (272455) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:12:55,135::__init__::225::IOProcess::(_processLogs) (272455) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:12:55,136::__init__::225::IOProcess::(_processLogs) (272455) Building response >Thread-18::DEBUG::2014-07-08 16:12:55,136::__init__::225::IOProcess::(_processLogs) (272455) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:55,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:55,136::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:12:55,139::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:55,139::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:12:55,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:55,140::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:55,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:55,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:55,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:55,141::__init__::225::IOProcess::(_processLogs) (272456) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:55,141::__init__::225::IOProcess::(_processLogs) (272456) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:55,141::__init__::225::IOProcess::(_processLogs) (272456) Building response >Thread-18::DEBUG::2014-07-08 16:12:55,141::__init__::225::IOProcess::(_processLogs) (272456) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:55,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:55,142::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:55,143::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:55,143::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:12:55,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:55,144::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:55,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:55,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:55,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:55,145::__init__::225::IOProcess::(_processLogs) (272457) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:55,145::__init__::225::IOProcess::(_processLogs) (272457) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:55,145::__init__::225::IOProcess::(_processLogs) (272457) Building response >Thread-18::DEBUG::2014-07-08 16:12:55,145::__init__::225::IOProcess::(_processLogs) (272457) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:55,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:55,146::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:12:55,147::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:12:55,147::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:12:55,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:12:55,148::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:12:55,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:12:55,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:12:55,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:12:55,149::__init__::225::IOProcess::(_processLogs) (272458) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:12:55,149::__init__::225::IOProcess::(_processLogs) (272458) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:12:55,149::__init__::225::IOProcess::(_processLogs) (272458) Building response >Thread-18::DEBUG::2014-07-08 16:12:55,149::__init__::225::IOProcess::(_processLogs) (272458) Queuing response >Thread-18::DEBUG::2014-07-08 16:12:55,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:12:55,150::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:12:56,329::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:12:56,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`337c9954-4197-4a48-a874-b7e564b680a3`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:12:56,330::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:12:56,345::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:56,346::task::1191::Storage.TaskManager.Task::(prepare) Task=`337c9954-4197-4a48-a874-b7e564b680a3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:12:56,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`337c9954-4197-4a48-a874-b7e564b680a3`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:12:56,346::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:12:56,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:12:56,347::task::993::Storage.TaskManager.Task::(_decref) Task=`337c9954-4197-4a48-a874-b7e564b680a3`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:12:56,361::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:12:56,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`57f214c8-01c3-4eeb-839a-1ae22c8af623`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:12:56,364::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:12:56,368::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fd59cd21-5a95-4d5f-8d20-262b1224460a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:12:56,369::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:12:56,369::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:12:56,370::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fd59cd21-5a95-4d5f-8d20-262b1224460a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:12:56,370::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`57f214c8-01c3-4eeb-839a-1ae22c8af623`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:12:56,371::task::993::Storage.TaskManager.Task::(_decref) Task=`57f214c8-01c3-4eeb-839a-1ae22c8af623`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:12:56,389::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:56,390::task::1191::Storage.TaskManager.Task::(prepare) Task=`57f214c8-01c3-4eeb-839a-1ae22c8af623`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:12:56,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`57f214c8-01c3-4eeb-839a-1ae22c8af623`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:12:56,390::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:12:56,390::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:12:56,391::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:12:56,391::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:12:56,392::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:12:56,392::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:12:56,392::task::993::Storage.TaskManager.Task::(_decref) Task=`57f214c8-01c3-4eeb-839a-1ae22c8af623`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:12:56,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:56,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179703 s, 57.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:12:58,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:12:59,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017221 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:01,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:01,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177795 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:03,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:03,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177769 s, 57.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:05,153::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:05,153::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:05,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:05,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:05,154::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:05,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:05,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:05,155::__init__::225::IOProcess::(_processLogs) (272459) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:05,155::__init__::225::IOProcess::(_processLogs) (272459) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:05,155::__init__::225::IOProcess::(_processLogs) (272459) Building response >Thread-18::DEBUG::2014-07-08 16:13:05,156::__init__::225::IOProcess::(_processLogs) (272459) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:05,156::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:05,156::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:13:05,158::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:13:05,307::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000483009 s, 957 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:05,309::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:05,309::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:05,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:05,310::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:05,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:05,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:05,311::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:05,311::__init__::225::IOProcess::(_processLogs) (272460) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:05,311::__init__::225::IOProcess::(_processLogs) (272460) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:05,311::__init__::225::IOProcess::(_processLogs) (272460) Building response >Thread-18::DEBUG::2014-07-08 16:13:05,312::__init__::225::IOProcess::(_processLogs) (272460) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:05,312::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:05,312::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:13:05,314::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:05,315::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:13:05,315::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:05,315::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:05,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:05,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:05,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:05,316::__init__::225::IOProcess::(_processLogs) (272461) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:05,316::__init__::225::IOProcess::(_processLogs) (272461) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:05,317::__init__::225::IOProcess::(_processLogs) (272461) Building response >Thread-18::DEBUG::2014-07-08 16:13:05,317::__init__::225::IOProcess::(_processLogs) (272461) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:05,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:05,317::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:05,318::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:05,319::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:13:05,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:05,319::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:05,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:05,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:05,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:05,320::__init__::225::IOProcess::(_processLogs) (272462) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:05,320::__init__::225::IOProcess::(_processLogs) (272462) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:05,321::__init__::225::IOProcess::(_processLogs) (272462) Building response >Thread-18::DEBUG::2014-07-08 16:13:05,321::__init__::225::IOProcess::(_processLogs) (272462) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:05,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:05,321::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:05,322::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:05,323::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:13:05,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:05,323::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:05,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:05,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:05,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:05,324::__init__::225::IOProcess::(_processLogs) (272463) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:05,325::__init__::225::IOProcess::(_processLogs) (272463) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:05,325::__init__::225::IOProcess::(_processLogs) (272463) Building response >Thread-18::DEBUG::2014-07-08 16:13:05,325::__init__::225::IOProcess::(_processLogs) (272463) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:05,325::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:05,326::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:13:05,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`f12eb4c5-c2ce-4f2e-9875-5e8dc4e2991f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:05,446::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:13:05,446::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483009', 'lastCheck': '0.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:13:05,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`f12eb4c5-c2ce-4f2e-9875-5e8dc4e2991f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483009', 'lastCheck': '0.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:13:05,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`f12eb4c5-c2ce-4f2e-9875-5e8dc4e2991f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:05,447::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:05,447::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:13:05,448::task::993::Storage.TaskManager.Task::(_decref) Task=`f12eb4c5-c2ce-4f2e-9875-5e8dc4e2991f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:13:05,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:05,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170671 s, 60.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:13:06,406::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:13:06,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2183960-d59a-4da6-b5c6-ee53085aa207`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:06,408::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:13:06,423::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:06,423::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2183960-d59a-4da6-b5c6-ee53085aa207`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:06,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2183960-d59a-4da6-b5c6-ee53085aa207`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:06,424::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:06,424::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:13:06,424::task::993::Storage.TaskManager.Task::(_decref) Task=`f2183960-d59a-4da6-b5c6-ee53085aa207`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:13:06,436::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:13:06,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`69b9d0a3-0c87-4530-a86f-2da137f65a8d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:13:06,437::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:13:06,438::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f58b035b-5fea-4bea-ae17-067fb1ef4397`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:13:06,438::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:13:06,439::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:13:06,439::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f58b035b-5fea-4bea-ae17-067fb1ef4397`::Granted request >Thread-6940::DEBUG::2014-07-08 16:13:06,440::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`69b9d0a3-0c87-4530-a86f-2da137f65a8d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:13:06,440::task::993::Storage.TaskManager.Task::(_decref) Task=`69b9d0a3-0c87-4530-a86f-2da137f65a8d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:13:06,459::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:06,459::task::1191::Storage.TaskManager.Task::(prepare) Task=`69b9d0a3-0c87-4530-a86f-2da137f65a8d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:06,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`69b9d0a3-0c87-4530-a86f-2da137f65a8d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:13:06,460::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:13:06,460::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:13:06,461::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:13:06,461::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:13:06,461::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:13:06,461::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:13:06,462::task::993::Storage.TaskManager.Task::(_decref) Task=`69b9d0a3-0c87-4530-a86f-2da137f65a8d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:13:07,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:08,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174546 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:10,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:10,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017606 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:12,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:12,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171763 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:14,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:15,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0206434 s, 49.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:15,328::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:15,329::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:15,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:15,329::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:15,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:15,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:15,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:15,330::__init__::225::IOProcess::(_processLogs) (272464) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:15,330::__init__::225::IOProcess::(_processLogs) (272464) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:15,331::__init__::225::IOProcess::(_processLogs) (272464) Building response >Thread-18::DEBUG::2014-07-08 16:13:15,331::__init__::225::IOProcess::(_processLogs) (272464) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:15,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:15,331::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:13:15,333::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:13:15,476::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000476305 s, 970 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:15,478::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:15,478::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:15,479::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:15,479::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:15,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:15,480::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:15,480::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:15,480::__init__::225::IOProcess::(_processLogs) (272465) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:15,480::__init__::225::IOProcess::(_processLogs) (272465) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:15,481::__init__::225::IOProcess::(_processLogs) (272465) Building response >Thread-18::DEBUG::2014-07-08 16:13:15,481::__init__::225::IOProcess::(_processLogs) (272465) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:15,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:15,481::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:13:15,484::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:13:15,484::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:15,484::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:15,484::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:15,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:15,485::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:15,485::__init__::225::IOProcess::(_processLogs) (272466) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:15,485::__init__::225::IOProcess::(_processLogs) (272466) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:15,486::__init__::225::IOProcess::(_processLogs) (272466) Building response >Thread-18::DEBUG::2014-07-08 16:13:15,486::__init__::225::IOProcess::(_processLogs) (272466) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:15,486::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:15,486::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:15,488::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:13:15,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:15,488::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:15,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:15,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:15,489::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:15,489::__init__::225::IOProcess::(_processLogs) (272467) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:15,489::__init__::225::IOProcess::(_processLogs) (272467) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:15,490::__init__::225::IOProcess::(_processLogs) (272467) Building response >Thread-18::DEBUG::2014-07-08 16:13:15,490::__init__::225::IOProcess::(_processLogs) (272467) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:15,490::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:15,490::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:15,491::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:15,492::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:13:15,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:15,492::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:15,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:15,493::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:15,493::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:15,493::__init__::225::IOProcess::(_processLogs) (272468) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:15,493::__init__::225::IOProcess::(_processLogs) (272468) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:15,494::__init__::225::IOProcess::(_processLogs) (272468) Building response >Thread-18::DEBUG::2014-07-08 16:13:15,494::__init__::225::IOProcess::(_processLogs) (272468) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:15,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:15,494::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:13:16,475::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:13:16,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cea475c-cc10-44dc-a3e0-19daef119759`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:16,476::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:13:16,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:16,492::task::1191::Storage.TaskManager.Task::(prepare) Task=`0cea475c-cc10-44dc-a3e0-19daef119759`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:16,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cea475c-cc10-44dc-a3e0-19daef119759`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:16,492::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:16,492::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:13:16,492::task::993::Storage.TaskManager.Task::(_decref) Task=`0cea475c-cc10-44dc-a3e0-19daef119759`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:13:16,504::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:13:16,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2f7b94f-0bdf-4643-9331-0554a07d1d82`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:13:16,505::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:13:16,506::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`eb20f902-79f0-4986-9874-85dc1d603ab9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:13:16,506::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:13:16,507::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:13:16,507::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`eb20f902-79f0-4986-9874-85dc1d603ab9`::Granted request >Thread-6940::DEBUG::2014-07-08 16:13:16,508::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d2f7b94f-0bdf-4643-9331-0554a07d1d82`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:13:16,508::task::993::Storage.TaskManager.Task::(_decref) Task=`d2f7b94f-0bdf-4643-9331-0554a07d1d82`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:13:16,527::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:16,527::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2f7b94f-0bdf-4643-9331-0554a07d1d82`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:16,527::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2f7b94f-0bdf-4643-9331-0554a07d1d82`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:13:16,528::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:13:16,528::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:13:16,528::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:13:16,529::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:13:16,529::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:13:16,529::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:13:16,529::task::993::Storage.TaskManager.Task::(_decref) Task=`d2f7b94f-0bdf-4643-9331-0554a07d1d82`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:13:17,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:17,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175428 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:19,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:19,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171199 s, 59.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:13:20,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`efeb068f-420d-4e53-9be2-9608460032fb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:20,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:13:20,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476305', 'lastCheck': '5.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:13:20,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`efeb068f-420d-4e53-9be2-9608460032fb`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476305', 'lastCheck': '5.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:13:20,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`efeb068f-420d-4e53-9be2-9608460032fb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:20,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:20,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:13:20,602::task::993::Storage.TaskManager.Task::(_decref) Task=`efeb068f-420d-4e53-9be2-9608460032fb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:13:21,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:21,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178096 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:23,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:24,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196791 s, 52.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:25,497::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:25,498::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:25,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:25,498::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:25,498::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:25,499::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:25,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:25,499::__init__::225::IOProcess::(_processLogs) (272469) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:25,500::__init__::225::IOProcess::(_processLogs) (272469) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:25,500::__init__::225::IOProcess::(_processLogs) (272469) Building response >Thread-18::DEBUG::2014-07-08 16:13:25,500::__init__::225::IOProcess::(_processLogs) (272469) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:25,500::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:25,500::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:13:25,502::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:13:25,646::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000467645 s, 988 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:25,648::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:25,649::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:25,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:25,649::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:25,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:25,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:25,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:25,650::__init__::225::IOProcess::(_processLogs) (272470) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:25,651::__init__::225::IOProcess::(_processLogs) (272470) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:25,651::__init__::225::IOProcess::(_processLogs) (272470) Building response >Thread-18::DEBUG::2014-07-08 16:13:25,651::__init__::225::IOProcess::(_processLogs) (272470) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:25,651::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:25,652::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:13:25,654::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:25,654::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:13:25,655::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:25,655::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:25,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:25,655::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:25,656::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:25,656::__init__::225::IOProcess::(_processLogs) (272471) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:25,656::__init__::225::IOProcess::(_processLogs) (272471) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:25,656::__init__::225::IOProcess::(_processLogs) (272471) Building response >Thread-18::DEBUG::2014-07-08 16:13:25,657::__init__::225::IOProcess::(_processLogs) (272471) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:25,657::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:25,657::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:25,658::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:25,658::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:13:25,659::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:25,659::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:25,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:25,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:25,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:25,660::__init__::225::IOProcess::(_processLogs) (272472) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:25,660::__init__::225::IOProcess::(_processLogs) (272472) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:25,660::__init__::225::IOProcess::(_processLogs) (272472) Building response >Thread-18::DEBUG::2014-07-08 16:13:25,661::__init__::225::IOProcess::(_processLogs) (272472) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:25,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:25,661::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:25,662::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:25,663::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:13:25,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:25,663::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:25,663::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:25,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:25,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:25,664::__init__::225::IOProcess::(_processLogs) (272473) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:25,664::__init__::225::IOProcess::(_processLogs) (272473) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:25,665::__init__::225::IOProcess::(_processLogs) (272473) Building response >Thread-18::DEBUG::2014-07-08 16:13:25,665::__init__::225::IOProcess::(_processLogs) (272473) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:25,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:25,665::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:13:26,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:26,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171291 s, 59.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:13:26,542::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:13:26,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e3035e9-9a20-4611-921b-0a70a07853da`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:26,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:13:26,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:26,559::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e3035e9-9a20-4611-921b-0a70a07853da`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:26,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e3035e9-9a20-4611-921b-0a70a07853da`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:26,560::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:26,560::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:13:26,560::task::993::Storage.TaskManager.Task::(_decref) Task=`0e3035e9-9a20-4611-921b-0a70a07853da`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:13:26,572::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:13:26,572::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2416904-8298-481f-9298-e7f24799fb86`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:13:26,573::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:13:26,574::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e2af99ad-4cb4-4789-b1f2-f3fea47ae5f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:13:26,574::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:13:26,575::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:13:26,575::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e2af99ad-4cb4-4789-b1f2-f3fea47ae5f5`::Granted request >Thread-6940::DEBUG::2014-07-08 16:13:26,575::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d2416904-8298-481f-9298-e7f24799fb86`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:13:26,576::task::993::Storage.TaskManager.Task::(_decref) Task=`d2416904-8298-481f-9298-e7f24799fb86`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:13:26,595::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:26,595::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2416904-8298-481f-9298-e7f24799fb86`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:26,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2416904-8298-481f-9298-e7f24799fb86`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:13:26,596::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:13:26,596::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:13:26,597::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:13:26,597::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:13:26,597::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:13:26,598::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:13:26,598::task::993::Storage.TaskManager.Task::(_decref) Task=`d2416904-8298-481f-9298-e7f24799fb86`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:13:28,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:28,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174367 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:30,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:30,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176549 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:32,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:33,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.022592 s, 45.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:35,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:35,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174529 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:35,668::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:35,669::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:35,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:35,669::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:35,670::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:35,670::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:35,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:35,670::__init__::225::IOProcess::(_processLogs) (272474) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:35,671::__init__::225::IOProcess::(_processLogs) (272474) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:35,671::__init__::225::IOProcess::(_processLogs) (272474) Building response >Thread-18::DEBUG::2014-07-08 16:13:35,671::__init__::225::IOProcess::(_processLogs) (272474) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:35,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:35,672::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:13:35,673::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:13:35,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff7e90bf-2b2f-4e06-8eab-996868b2621e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:35,821::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:13:35,821::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467645', 'lastCheck': '10.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:13:35,822::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff7e90bf-2b2f-4e06-8eab-996868b2621e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467645', 'lastCheck': '10.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:13:35,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff7e90bf-2b2f-4e06-8eab-996868b2621e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:35,823::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:35,824::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-08 16:13:35,825::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0055419 s, 83.4 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:13:35,826::task::993::Storage.TaskManager.Task::(_decref) Task=`ff7e90bf-2b2f-4e06-8eab-996868b2621e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:13:35,829::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:35,830::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:35,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:35,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:35,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:35,839::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:35,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:35,842::__init__::225::IOProcess::(_processLogs) (272475) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:35,843::__init__::225::IOProcess::(_processLogs) (272475) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:35,844::__init__::225::IOProcess::(_processLogs) (272475) Building response >Thread-18::DEBUG::2014-07-08 16:13:35,845::__init__::225::IOProcess::(_processLogs) (272475) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:35,846::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:35,847::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:13:35,854::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:35,854::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:13:35,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:35,855::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:35,855::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:35,856::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:35,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:35,858::__init__::225::IOProcess::(_processLogs) (272476) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:35,859::__init__::225::IOProcess::(_processLogs) (272476) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:35,861::__init__::225::IOProcess::(_processLogs) (272476) Building response >Thread-18::DEBUG::2014-07-08 16:13:35,862::__init__::225::IOProcess::(_processLogs) (272476) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:35,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:35,864::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:35,869::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:35,870::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:13:35,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:35,870::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:35,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:35,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:35,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:35,871::__init__::225::IOProcess::(_processLogs) (272477) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:35,872::__init__::225::IOProcess::(_processLogs) (272477) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:35,872::__init__::225::IOProcess::(_processLogs) (272477) Building response >Thread-18::DEBUG::2014-07-08 16:13:35,872::__init__::225::IOProcess::(_processLogs) (272477) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:35,872::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:35,873::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:35,874::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:35,874::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:13:35,874::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:35,874::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:35,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:35,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:35,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:35,875::__init__::225::IOProcess::(_processLogs) (272478) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:35,876::__init__::225::IOProcess::(_processLogs) (272478) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:35,876::__init__::225::IOProcess::(_processLogs) (272478) Building response >Thread-18::DEBUG::2014-07-08 16:13:35,876::__init__::225::IOProcess::(_processLogs) (272478) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:35,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:35,877::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:13:36,610::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:13:36,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fb9352e-5d1b-4db0-9533-8c1341cfdb5f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:36,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:13:36,627::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:36,627::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fb9352e-5d1b-4db0-9533-8c1341cfdb5f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:36,628::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fb9352e-5d1b-4db0-9533-8c1341cfdb5f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:36,628::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:36,628::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:13:36,628::task::993::Storage.TaskManager.Task::(_decref) Task=`9fb9352e-5d1b-4db0-9533-8c1341cfdb5f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:13:36,639::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:13:36,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`c15c4e0c-cb10-48ef-87e0-d4f96836b609`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:13:36,640::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:13:36,641::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bce94a59-8dae-487e-af2b-d2c33885f6ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:13:36,642::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:13:36,642::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:13:36,642::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bce94a59-8dae-487e-af2b-d2c33885f6ff`::Granted request >Thread-6940::DEBUG::2014-07-08 16:13:36,643::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c15c4e0c-cb10-48ef-87e0-d4f96836b609`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:13:36,643::task::993::Storage.TaskManager.Task::(_decref) Task=`c15c4e0c-cb10-48ef-87e0-d4f96836b609`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:13:36,662::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:36,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`c15c4e0c-cb10-48ef-87e0-d4f96836b609`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:36,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`c15c4e0c-cb10-48ef-87e0-d4f96836b609`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:13:36,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:13:36,663::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:13:36,663::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:13:36,664::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:13:36,664::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:13:36,664::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:13:36,664::task::993::Storage.TaskManager.Task::(_decref) Task=`c15c4e0c-cb10-48ef-87e0-d4f96836b609`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:13:37,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:37,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173476 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:39,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:40,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169135 s, 60.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:42,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:42,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173442 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:44,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:44,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172026 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:45,879::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:45,880::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:45,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:45,880::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:45,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:45,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:45,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:45,881::__init__::225::IOProcess::(_processLogs) (272479) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:45,882::__init__::225::IOProcess::(_processLogs) (272479) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:45,882::__init__::225::IOProcess::(_processLogs) (272479) Building response >Thread-18::DEBUG::2014-07-08 16:13:45,882::__init__::225::IOProcess::(_processLogs) (272479) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:45,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:45,883::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:13:45,884::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:13:46,030::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000435239 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:46,032::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:46,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:46,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:46,033::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:46,033::__init__::225::IOProcess::(_processLogs) (272480) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:46,034::__init__::225::IOProcess::(_processLogs) (272480) Building response >Thread-18::DEBUG::2014-07-08 16:13:46,034::__init__::225::IOProcess::(_processLogs) (272480) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:46,036::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:13:46,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:46,037::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:46,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:46,037::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:46,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:46,038::__init__::225::IOProcess::(_processLogs) (272481) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:46,038::__init__::225::IOProcess::(_processLogs) (272481) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:46,039::__init__::225::IOProcess::(_processLogs) (272481) Building response >Thread-18::DEBUG::2014-07-08 16:13:46,039::__init__::225::IOProcess::(_processLogs) (272481) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:46,039::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:46,040::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:13:46,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:46,041::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:46,041::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:46,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:46,042::__init__::225::IOProcess::(_processLogs) (272482) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:46,042::__init__::225::IOProcess::(_processLogs) (272482) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:46,042::__init__::225::IOProcess::(_processLogs) (272482) Building response >Thread-18::DEBUG::2014-07-08 16:13:46,043::__init__::225::IOProcess::(_processLogs) (272482) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:46,043::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:46,044::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:13:46,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:46,045::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:46,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:46,045::__init__::225::IOProcess::(_processLogs) (272483) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:46,046::__init__::225::IOProcess::(_processLogs) (272483) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:46,046::__init__::225::IOProcess::(_processLogs) (272483) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:46,046::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:13:46,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:13:46,805::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:13:46,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa7f8340-c88b-4769-b6ff-b4ceb29bf0f3`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:46,807::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:13:46,830::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:46,832::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa7f8340-c88b-4769-b6ff-b4ceb29bf0f3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:46,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa7f8340-c88b-4769-b6ff-b4ceb29bf0f3`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:46,833::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:46,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:13:46,835::task::993::Storage.TaskManager.Task::(_decref) Task=`fa7f8340-c88b-4769-b6ff-b4ceb29bf0f3`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:13:46,927::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Dummy-6860::DEBUG::2014-07-08 16:13:46,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318326 s, 32.2 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:13:46,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ab7f33f-f574-4877-bf0e-7f0f36ffd810`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:13:46,936::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:13:46,943::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`08f8739a-979d-48e0-a794-853f8e8eb832`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:13:46,945::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:13:46,949::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:13:46,950::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`08f8739a-979d-48e0-a794-853f8e8eb832`::Granted request >Thread-6940::DEBUG::2014-07-08 16:13:46,956::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4ab7f33f-f574-4877-bf0e-7f0f36ffd810`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:13:46,958::task::993::Storage.TaskManager.Task::(_decref) Task=`4ab7f33f-f574-4877-bf0e-7f0f36ffd810`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:13:47,001::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:47,004::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ab7f33f-f574-4877-bf0e-7f0f36ffd810`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:47,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ab7f33f-f574-4877-bf0e-7f0f36ffd810`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:13:47,008::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:13:47,009::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:13:47,013::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:13:47,017::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:13:47,019::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:13:47,020::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:13:47,024::task::993::Storage.TaskManager.Task::(_decref) Task=`4ab7f33f-f574-4877-bf0e-7f0f36ffd810`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:13:49,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:49,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175049 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:13:51,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`414b3e36-b5c9-4624-8656-49f3124d87af`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:51,024::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:13:51,025::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435239', 'lastCheck': '5.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:13:51,025::task::1191::Storage.TaskManager.Task::(prepare) Task=`414b3e36-b5c9-4624-8656-49f3124d87af`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435239', 'lastCheck': '5.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:13:51,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`414b3e36-b5c9-4624-8656-49f3124d87af`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:51,025::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:51,026::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:13:51,026::task::993::Storage.TaskManager.Task::(_decref) Task=`414b3e36-b5c9-4624-8656-49f3124d87af`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:13:51,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:51,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176185 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:53,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:54,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169593 s, 60.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:13:56,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:13:56,191::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:56,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:56,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:56,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:56,194::__init__::225::IOProcess::(_processLogs) (272484) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:56,194::__init__::225::IOProcess::(_processLogs) (272484) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:56,199::__init__::225::IOProcess::(_processLogs) (272484) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:56,200::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-37::DEBUG::2014-07-08 16:13:56,203::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:13:56,357::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000512063 s, 902 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:56,362::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:13:56,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:56,365::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:56,366::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:56,367::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:56,369::__init__::225::IOProcess::(_processLogs) (272485) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:13:56,370::__init__::225::IOProcess::(_processLogs) (272485) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:13:56,372::__init__::225::IOProcess::(_processLogs) (272485) Building response >Thread-18::DEBUG::2014-07-08 16:13:56,373::__init__::225::IOProcess::(_processLogs) (272485) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:56,374::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:56,375::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:13:56,384::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:13:56,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:56,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:56,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 16:13:56,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.198248 s, 5.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:13:56,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:56,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:56,472::__init__::225::IOProcess::(_processLogs) (272486) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:56,473::__init__::225::IOProcess::(_processLogs) (272486) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:56,475::__init__::225::IOProcess::(_processLogs) (272486) Building response >Thread-18::DEBUG::2014-07-08 16:13:56,476::__init__::225::IOProcess::(_processLogs) (272486) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:56,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:56,478::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:56,482::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:56,483::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:13:56,484::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:56,485::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:56,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:56,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:56,489::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:56,490::__init__::225::IOProcess::(_processLogs) (272487) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:56,491::__init__::225::IOProcess::(_processLogs) (272487) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:56,492::__init__::225::IOProcess::(_processLogs) (272487) Building response >Thread-18::DEBUG::2014-07-08 16:13:56,493::__init__::225::IOProcess::(_processLogs) (272487) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:56,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:56,495::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:13:56,499::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:13:56,500::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:13:56,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:13:56,503::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:13:56,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:13:56,505::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:13:56,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:13:56,507::__init__::225::IOProcess::(_processLogs) (272488) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:13:56,508::__init__::225::IOProcess::(_processLogs) (272488) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:13:56,509::__init__::225::IOProcess::(_processLogs) (272488) Building response >Thread-18::DEBUG::2014-07-08 16:13:56,510::__init__::225::IOProcess::(_processLogs) (272488) Queuing response >Thread-18::DEBUG::2014-07-08 16:13:56,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:13:56,512::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:13:57,050::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:13:57,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`21390a98-f90e-48e5-b870-5fa014c45e45`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:13:57,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:13:57,066::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:57,067::task::1191::Storage.TaskManager.Task::(prepare) Task=`21390a98-f90e-48e5-b870-5fa014c45e45`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:13:57,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`21390a98-f90e-48e5-b870-5fa014c45e45`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:13:57,067::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:13:57,067::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:13:57,068::task::993::Storage.TaskManager.Task::(_decref) Task=`21390a98-f90e-48e5-b870-5fa014c45e45`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:13:57,087::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:13:57,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`d086d6bc-3af8-4902-aef8-3c1078c872f9`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:13:57,088::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:13:57,089::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e3d8dc30-799c-4d39-b40b-342577c5dcf1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:13:57,089::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:13:57,090::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:13:57,090::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e3d8dc30-799c-4d39-b40b-342577c5dcf1`::Granted request >Thread-6940::DEBUG::2014-07-08 16:13:57,091::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d086d6bc-3af8-4902-aef8-3c1078c872f9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:13:57,091::task::993::Storage.TaskManager.Task::(_decref) Task=`d086d6bc-3af8-4902-aef8-3c1078c872f9`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:13:57,110::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:57,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`d086d6bc-3af8-4902-aef8-3c1078c872f9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:13:57,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`d086d6bc-3af8-4902-aef8-3c1078c872f9`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:13:57,111::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:13:57,111::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:13:57,111::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:13:57,112::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:13:57,112::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:13:57,112::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:13:57,113::task::993::Storage.TaskManager.Task::(_decref) Task=`d086d6bc-3af8-4902-aef8-3c1078c872f9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:13:58,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:13:58,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175018 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:00,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:01,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173224 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:03,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:03,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305738 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:05,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:05,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173842 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:14:06,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6e786b5-6e75-4030-be2d-e719781a2e0b`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:14:06,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:14:06,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512063', 'lastCheck': '9.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:14:06,260::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6e786b5-6e75-4030-be2d-e719781a2e0b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512063', 'lastCheck': '9.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:14:06,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6e786b5-6e75-4030-be2d-e719781a2e0b`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:06,261::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:14:06,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:14:06,261::task::993::Storage.TaskManager.Task::(_decref) Task=`f6e786b5-6e75-4030-be2d-e719781a2e0b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:14:06,517::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:06,518::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:14:06,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:06,518::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:06,518::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:06,519::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:06,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:06,519::__init__::225::IOProcess::(_processLogs) (272489) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:06,519::__init__::225::IOProcess::(_processLogs) (272489) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:06,520::__init__::225::IOProcess::(_processLogs) (272489) Building response >Thread-18::DEBUG::2014-07-08 16:14:06,520::__init__::225::IOProcess::(_processLogs) (272489) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:06,520::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:06,520::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:14:06,522::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:14:06,668::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000474629 s, 973 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:14:06,670::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:06,670::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:14:06,671::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:06,671::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:06,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:06,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:06,672::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:06,672::__init__::225::IOProcess::(_processLogs) (272490) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:06,672::__init__::225::IOProcess::(_processLogs) (272490) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:06,673::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272490) Building response >Thread-18::DEBUG::2014-07-08 16:14:06,673::__init__::225::IOProcess::(_processLogs) (272490) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:06,673::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:14:06,673::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:14:06,676::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:06,676::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:14:06,676::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:06,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:06,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:06,677::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:06,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:06,678::__init__::225::IOProcess::(_processLogs) (272491) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:06,678::__init__::225::IOProcess::(_processLogs) (272491) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:06,678::__init__::225::IOProcess::(_processLogs) (272491) Building response >Thread-18::DEBUG::2014-07-08 16:14:06,678::__init__::225::IOProcess::(_processLogs) (272491) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:06,679::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:14:06,679::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:14:06,680::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:06,680::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:14:06,681::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:06,681::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:06,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:06,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:06,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:06,682::__init__::225::IOProcess::(_processLogs) (272492) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:06,682::__init__::225::IOProcess::(_processLogs) (272492) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:06,682::__init__::225::IOProcess::(_processLogs) (272492) Building response >Thread-18::DEBUG::2014-07-08 16:14:06,682::__init__::225::IOProcess::(_processLogs) (272492) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:06,683::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:06,683::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:14:06,684::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:06,684::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:14:06,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:06,685::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:06,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:06,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:06,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:06,686::__init__::225::IOProcess::(_processLogs) (272493) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:06,686::__init__::225::IOProcess::(_processLogs) (272493) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:06,686::__init__::225::IOProcess::(_processLogs) (272493) Building response >Thread-18::DEBUG::2014-07-08 16:14:06,687::__init__::225::IOProcess::(_processLogs) (272493) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:06,687::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:06,687::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:14:07,127::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:14:07,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`13d9a0f6-5c5e-4a39-ab98-74925e313ca9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:14:07,128::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:14:07,143::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:14:07,144::task::1191::Storage.TaskManager.Task::(prepare) Task=`13d9a0f6-5c5e-4a39-ab98-74925e313ca9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:14:07,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`13d9a0f6-5c5e-4a39-ab98-74925e313ca9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:07,144::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:14:07,144::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:14:07,145::task::993::Storage.TaskManager.Task::(_decref) Task=`13d9a0f6-5c5e-4a39-ab98-74925e313ca9`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:14:07,156::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:14:07,157::task::595::Storage.TaskManager.Task::(_updateState) Task=`41d11d78-3279-4863-9c2d-551607f80bad`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:14:07,157::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:14:07,163::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9a8ecf55-8b67-4edf-8f1e-715a98218b5c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:14:07,163::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:14:07,164::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:14:07,164::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9a8ecf55-8b67-4edf-8f1e-715a98218b5c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:14:07,165::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`41d11d78-3279-4863-9c2d-551607f80bad`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:14:07,165::task::993::Storage.TaskManager.Task::(_decref) Task=`41d11d78-3279-4863-9c2d-551607f80bad`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:14:07,184::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:07,185::task::1191::Storage.TaskManager.Task::(prepare) Task=`41d11d78-3279-4863-9c2d-551607f80bad`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:07,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`41d11d78-3279-4863-9c2d-551607f80bad`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:14:07,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:14:07,186::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:14:07,186::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:14:07,186::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:14:07,187::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:14:07,187::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:14:07,187::task::993::Storage.TaskManager.Task::(_decref) Task=`41d11d78-3279-4863-9c2d-551607f80bad`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:14:07,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:07,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170805 s, 60.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:09,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:10,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0213312 s, 48.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:12,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:12,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0210924 s, 48.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:14,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:14,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169056 s, 60.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:14:16,690::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:16,690::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:14:16,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:16,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:16,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:16,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:16,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:16,692::__init__::225::IOProcess::(_processLogs) (272494) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:16,692::__init__::225::IOProcess::(_processLogs) (272494) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:16,692::__init__::225::IOProcess::(_processLogs) (272494) Building response >Thread-18::DEBUG::2014-07-08 16:14:16,693::__init__::225::IOProcess::(_processLogs) (272494) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:16,693::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:16,693::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:14:16,695::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:16,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:14:16,841::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000461499 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:14:16,991::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:16,992::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:14:16,992::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:16,992::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:16,993::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:16,993::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:16,993::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:16,993::__init__::225::IOProcess::(_processLogs) (272495) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:16,994::__init__::225::IOProcess::(_processLogs) (272495) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:17,000::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272495) Building response >Thread-18::DEBUG::2014-07-08 16:14:17,000::__init__::225::IOProcess::(_processLogs) (272495) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:17,002::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:17,003::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:14:17,012::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:17,013::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:14:17,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:17,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:17,017::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:17,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:17,020::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:17,021::__init__::225::IOProcess::(_processLogs) (272496) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:17,022::__init__::225::IOProcess::(_processLogs) (272496) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:17,024::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|(272496) Building response >Thread-18::DEBUG::2014-07-08 16:14:17,025::__init__::225::IOProcess::(_processLogs) (272496) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:17,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:17,028::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:14:17,034::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:17,116::__init__::225::IOProcess::(_processLogs) Message size is 168 >Dummy-6860::DEBUG::2014-07-08 16:14:17,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0434958 s, 23.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:14:17,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:17,119::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:17,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:17,122::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:17,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:17,123::__init__::225::IOProcess::(_processLogs) (272497) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:17,124::__init__::225::IOProcess::(_processLogs) (272497) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:17,125::__init__::225::IOProcess::(_processLogs) (272497) Building response >Thread-18::DEBUG::2014-07-08 16:14:17,126::__init__::225::IOProcess::(_processLogs) (272497) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:17,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:17,128::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:14:17,132::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:17,133::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:14:17,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:17,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:17,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:17,137::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:17,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:17,139::__init__::225::IOProcess::(_processLogs) (272498) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:17,140::__init__::225::IOProcess::(_processLogs) (272498) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:17,141::__init__::225::IOProcess::(_processLogs) (272498) Building response >Thread-18::DEBUG::2014-07-08 16:14:17,142::__init__::225::IOProcess::(_processLogs) (272498) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:17,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:17,144::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:14:17,201::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:14:17,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`5627b1f3-94e8-463c-9eb0-42223974e546`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:14:17,203::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:14:17,218::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:14:17,218::task::1191::Storage.TaskManager.Task::(prepare) Task=`5627b1f3-94e8-463c-9eb0-42223974e546`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:14:17,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`5627b1f3-94e8-463c-9eb0-42223974e546`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:17,219::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:14:17,219::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:14:17,220::task::993::Storage.TaskManager.Task::(_decref) Task=`5627b1f3-94e8-463c-9eb0-42223974e546`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:14:17,231::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:14:17,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`5004a118-9827-4091-8bff-65fc703cd508`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:14:17,232::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:14:17,233::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1083749c-9552-46f5-a462-feb8e7e1ac79`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:14:17,233::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:14:17,234::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:14:17,234::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1083749c-9552-46f5-a462-feb8e7e1ac79`::Granted request >Thread-6940::DEBUG::2014-07-08 16:14:17,235::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5004a118-9827-4091-8bff-65fc703cd508`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:14:17,235::task::993::Storage.TaskManager.Task::(_decref) Task=`5004a118-9827-4091-8bff-65fc703cd508`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:14:17,254::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:17,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`5004a118-9827-4091-8bff-65fc703cd508`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:17,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`5004a118-9827-4091-8bff-65fc703cd508`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:14:17,255::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:14:17,255::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:14:17,256::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:14:17,256::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:14:17,256::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:14:17,257::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:14:17,257::task::993::Storage.TaskManager.Task::(_decref) Task=`5004a118-9827-4091-8bff-65fc703cd508`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:14:19,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:19,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175353 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:21,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:14:21,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9a87fd6-c4c7-4172-8afc-8ae3588687c4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:14:21,600::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:14:21,602::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461499', 'lastCheck': '4.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:14:21,603::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9a87fd6-c4c7-4172-8afc-8ae3588687c4`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461499', 'lastCheck': '4.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:14:21,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9a87fd6-c4c7-4172-8afc-8ae3588687c4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:21,605::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:14:21,606::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:14:21,607::task::993::Storage.TaskManager.Task::(_decref) Task=`b9a87fd6-c4c7-4172-8afc-8ae3588687c4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:14:21,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470484 s, 21.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:23,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:23,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174987 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:26,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:26,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173635 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:14:27,149::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:27,149::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:14:27,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:27,150::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:27,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:27,150::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:27,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:27,151::__init__::225::IOProcess::(_processLogs) (272499) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:27,151::__init__::225::IOProcess::(_processLogs) (272499) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:27,151::__init__::225::IOProcess::(_processLogs) (272499) Building response >Thread-18::DEBUG::2014-07-08 16:14:27,152::__init__::225::IOProcess::(_processLogs) (272499) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:27,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:27,152::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:14:27,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:14:27,301::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:14:27,302::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000605648 s, 763 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:14:27,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1090a68-c9c1-4995-b3aa-fb247bb2ffc7`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:14:27,309::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|Receiving request... >Thread-6941::INFO::2014-07-08 16:14:27,310::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:14:27,311::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:14:27,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:27,312::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:27,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:27,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:27,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:27,313::__init__::225::IOProcess::(_processLogs) (272500) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:27,313::__init__::225::IOProcess::(_processLogs) (272500) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:27,314::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|(272500) Building response >Thread-18::DEBUG::2014-07-08 16:14:27,314::__init__::225::IOProcess::(_processLogs) (272500) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:27,314::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:27,314::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:14:27,317::__init__::225::IOProcess::(_processLogs) (272495) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:27,318::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:14:27,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:27,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:27,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:27,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:27,321::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:27,321::__init__::225::IOProcess::(_processLogs) (272501) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:27,321::__init__::225::IOProcess::(_processLogs) (272501) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:27,325::__init__::225::IOProcess::(_processLogs) DEBUG|(272501) Building response >Thread-18::DEBUG::2014-07-08 16:14:27,325::__init__::225::IOProcess::(_processLogs) (272501) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:27,325::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:27,325::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::INFO::2014-07-08 16:14:27,326::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:14:27,328::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1090a68-c9c1-4995-b3aa-fb247bb2ffc7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:14:27,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1090a68-c9c1-4995-b3aa-fb247bb2ffc7`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:27,329::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:14:27,329::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:14:27,329::task::993::Storage.TaskManager.Task::(_decref) Task=`c1090a68-c9c1-4995-b3aa-fb247bb2ffc7`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:14:27,332::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:27,332::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:14:27,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:27,332::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:27,333::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:27,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:27,333::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:27,333::__init__::225::IOProcess::(_processLogs) (272502) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:27,334::__init__::225::IOProcess::(_processLogs) (272502) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:27,334::__init__::225::IOProcess::(_processLogs) (272502) Building response >Thread-18::DEBUG::2014-07-08 16:14:27,334::__init__::225::IOProcess::(_processLogs) (272502) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:27,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:27,335::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:14:27,336::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:27,336::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:14:27,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:27,337::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:27,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:27,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:27,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:27,338::__init__::225::IOProcess::(_processLogs) (272503) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:27,338::__init__::225::IOProcess::(_processLogs) (272503) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:27,338::__init__::225::IOProcess::(_processLogs) (272503) Building response >Thread-18::DEBUG::2014-07-08 16:14:27,338::__init__::225::IOProcess::(_processLogs) (272503) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:27,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:27,339::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:14:27,342::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:14:27,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`026c0d18-87eb-40cb-9d2f-393db87e9e83`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:14:27,343::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:14:27,344::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c1f3befe-6974-4184-8200-ca5bcf23eb6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:14:27,344::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:14:27,345::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:14:27,345::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c1f3befe-6974-4184-8200-ca5bcf23eb6f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:14:27,346::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`026c0d18-87eb-40cb-9d2f-393db87e9e83`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:14:27,346::task::993::Storage.TaskManager.Task::(_decref) Task=`026c0d18-87eb-40cb-9d2f-393db87e9e83`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:14:27,375::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:27,375::task::1191::Storage.TaskManager.Task::(prepare) Task=`026c0d18-87eb-40cb-9d2f-393db87e9e83`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:27,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`026c0d18-87eb-40cb-9d2f-393db87e9e83`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:14:27,376::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:14:27,376::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:14:27,376::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:14:27,377::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:14:27,377::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:14:27,377::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:14:27,378::task::993::Storage.TaskManager.Task::(_decref) Task=`026c0d18-87eb-40cb-9d2f-393db87e9e83`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:14:28,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:28,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171719 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:30,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:30,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173476 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:32,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:33,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017863 s, 57.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:35,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:35,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169593 s, 60.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:14:36,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`30ffad4f-5f03-4957-91e5-e4a86278922a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:14:36,876::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:14:36,876::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605648', 'lastCheck': '9.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:14:36,877::task::1191::Storage.TaskManager.Task::(prepare) Task=`30ffad4f-5f03-4957-91e5-e4a86278922a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605648', 'lastCheck': '9.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:14:36,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`30ffad4f-5f03-4957-91e5-e4a86278922a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:36,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:14:36,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:14:36,878::task::993::Storage.TaskManager.Task::(_decref) Task=`30ffad4f-5f03-4957-91e5-e4a86278922a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:14:37,342::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:37,342::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:14:37,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:37,343::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:37,343::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:37,343::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:37,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:37,344::__init__::225::IOProcess::(_processLogs) (272504) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:37,344::__init__::225::IOProcess::(_processLogs) (272504) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:37,344::__init__::225::IOProcess::(_processLogs) (272504) Building response >Thread-18::DEBUG::2014-07-08 16:14:37,345::__init__::225::IOProcess::(_processLogs) (272504) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:37,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:37,345::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:14:37,347::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:14:37,503::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000555923 s, 831 kB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:37,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:14:37,504::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:14:37,669::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:37,675::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:14:37,679::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f36e53d-4982-44c5-8f18-e6ae6b309070`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:14:37,681::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:37,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6941::INFO::2014-07-08 16:14:37,686::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:14:37,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:37,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:37,699::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:37,700::__init__::225::IOProcess::(_processLogs) (272505) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:37,703::__init__::225::IOProcess::(_processLogs) (272505) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:37,705::__init__::225::IOProcess::(_processLogs) (272505) Building response >Thread-18::DEBUG::2014-07-08 16:14:37,708::__init__::225::IOProcess::(_processLogs) (272505) Queuing response >Thread-6941::INFO::2014-07-08 16:14:37,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:14:37,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6941::DEBUG::2014-07-08 16:14:37,715::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f36e53d-4982-44c5-8f18-e6ae6b309070`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:14:37,715::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6941::DEBUG::2014-07-08 16:14:37,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f36e53d-4982-44c5-8f18-e6ae6b309070`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:37,726::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:14:37,732::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:14:37,739::task::993::Storage.TaskManager.Task::(_decref) Task=`0f36e53d-4982-44c5-8f18-e6ae6b309070`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:14:37,745::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:37,751::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:14:37,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:37,758::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:37,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:37,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:37,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:14:37,770::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:14:37,775::__init__::225::IOProcess::(_processLogs) (272506) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:37,781::__init__::225::IOProcess::(_processLogs) (272506) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:14:37,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ed11494-5cd0-49a8-8458-ea4c3fc8169d`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:14:37,784::__init__::225::IOProcess::(_processLogs) (272506) Building response >Thread-6940::INFO::2014-07-08 16:14:37,868::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:14:37,868::__init__::225::IOProcess::(_processLogs) (272506) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:14:37,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.120196 s, 8.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:14:37,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:37,879::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:14:37,879::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c1c54ed3-596a-4157-bf2d-060c30eb428b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:14:37,883::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:14:37,890::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:14:37,893::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c1c54ed3-596a-4157-bf2d-060c30eb428b`::Granted request >Thread-18::DEBUG::2014-07-08 16:14:37,894::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:37,899::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:14:37,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:14:37,903::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1ed11494-5cd0-49a8-8458-ea4c3fc8169d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:14:37,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:14:37,907::task::993::Storage.TaskManager.Task::(_decref) Task=`1ed11494-5cd0-49a8-8458-ea4c3fc8169d`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:14:37,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:37,914::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:37,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:37,924::__init__::225::IOProcess::(_processLogs) (272507) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:37,929::__init__::225::IOProcess::(_processLogs) (272507) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:37,933::__init__::225::IOProcess::(_processLogs) (272507) Building response >Thread-18::DEBUG::2014-07-08 16:14:37,938::__init__::225::IOProcess::(_processLogs) (272507) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:37,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:37,947::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:14:37,962::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:37,963::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:14:37,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:37,965::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:37,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:37,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::INFO::2014-07-08 16:14:37,976::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:14:37,978::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:14:37,978::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ed11494-5cd0-49a8-8458-ea4c3fc8169d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:37,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ed11494-5cd0-49a8-8458-ea4c3fc8169d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:14:37,983::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:14:37,984::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:14:37,983::__init__::225::IOProcess::(_processLogs) (272508) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:14:37,987::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:14:37,990::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:14:37,991::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:14:37,993::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:14:37,991::__init__::225::IOProcess::(_processLogs) (272508) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:14:37,996::task::993::Storage.TaskManager.Task::(_decref) Task=`1ed11494-5cd0-49a8-8458-ea4c3fc8169d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:14:38,000::__init__::225::IOProcess::(_processLogs) (272508) Building response >Thread-18::DEBUG::2014-07-08 16:14:38,006::__init__::225::IOProcess::(_processLogs) (272508) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:38,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:38,011::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:14:40,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:40,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174339 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:42,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:42,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172062 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:44,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:45,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0944236 s, 10.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:47,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:47,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017573 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:14:48,017::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:14:48,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`4850b2a9-b8bb-445c-8ce1-33bbab8461fe`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:14:48,022::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:14:48,022::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:48,024::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:14:48,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:48,024::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:48,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:48,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:48,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:48,029::__init__::225::IOProcess::(_processLogs) (272509) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:48,029::__init__::225::IOProcess::(_processLogs) (272509) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:48,029::__init__::225::IOProcess::(_processLogs) (272509) Building response >Thread-18::DEBUG::2014-07-08 16:14:48,029::__init__::225::IOProcess::(_processLogs) (272509) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:48,030::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:48,030::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:14:48,032::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::INFO::2014-07-08 16:14:48,180::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:14:48,182::task::1191::Storage.TaskManager.Task::(prepare) Task=`4850b2a9-b8bb-445c-8ce1-33bbab8461fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:14:48,183::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000497537 s, 929 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:14:48,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`4850b2a9-b8bb-445c-8ce1-33bbab8461fe`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:48,187::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:14:48,188::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:14:48,189::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:14:48,190::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:14:48,191::task::993::Storage.TaskManager.Task::(_decref) Task=`4850b2a9-b8bb-445c-8ce1-33bbab8461fe`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:14:48,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:48,193::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:48,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:48,201::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:48,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:48,206::__init__::225::IOProcess::(_processLogs) (272510) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:48,208::__init__::225::IOProcess::(_processLogs) (272510) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:48,209::__init__::225::IOProcess::(_processLogs) (272510) Building response >Thread-18::DEBUG::2014-07-08 16:14:48,211::__init__::225::IOProcess::(_processLogs) (272510) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:48,212::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:48,214::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6940::DEBUG::2014-07-08 16:14:48,222::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:14:48,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`058d1284-5dcc-44fc-b852-7c7ce7849e3b`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:14:48,232::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:14:48,234::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:48,238::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-6940::DEBUG::2014-07-08 16:14:48,239::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`434228ee-b792-4894-a469-99e3b238ab72`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:14:48,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:14:48,241::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:14:48,245::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-6940::DEBUG::2014-07-08 16:14:48,246::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:14:48,248::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`434228ee-b792-4894-a469-99e3b238ab72`::Granted request >Thread-18::DEBUG::2014-07-08 16:14:48,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:48,253::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:14:48,255::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`058d1284-5dcc-44fc-b852-7c7ce7849e3b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:14:48,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:14:48,257::task::993::Storage.TaskManager.Task::(_decref) Task=`058d1284-5dcc-44fc-b852-7c7ce7849e3b`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:14:48,260::__init__::225::IOProcess::(_processLogs) (272511) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:48,263::__init__::225::IOProcess::(_processLogs) (272511) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:48,268::__init__::225::IOProcess::(_processLogs) (272511) Building response >Thread-18::DEBUG::2014-07-08 16:14:48,271::__init__::225::IOProcess::(_processLogs) (272511) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:48,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:48,277::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:14:48,291::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:48,294::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:14:48,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:48,300::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:48,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:48,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:48,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:48,305::__init__::225::IOProcess::(_processLogs) (272512) Finding callback 'access'... >Thread-6940::INFO::2014-07-08 16:14:48,307::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:48,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`058d1284-5dcc-44fc-b852-7c7ce7849e3b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:48,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`058d1284-5dcc-44fc-b852-7c7ce7849e3b`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:14:48,310::__init__::225::IOProcess::(_processLogs) (272512) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:14:48,312::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:14:48,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:14:48,316::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:14:48,318::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:14:48,319::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:14:48,316::__init__::225::IOProcess::(_processLogs) (272512) Building response >Thread-18::DEBUG::2014-07-08 16:14:48,328::__init__::225::IOProcess::(_processLogs) (272512) Queuing response >Thread-6940::DEBUG::2014-07-08 16:14:48,328::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:14:48,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:48,331::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:14:48,336::task::993::Storage.TaskManager.Task::(_decref) Task=`058d1284-5dcc-44fc-b852-7c7ce7849e3b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:14:48,338::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:48,343::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:14:48,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:48,346::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:48,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:48,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:48,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:48,356::__init__::225::IOProcess::(_processLogs) (272513) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:48,364::__init__::225::IOProcess::(_processLogs) (272513) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:48,366::__init__::225::IOProcess::(_processLogs) (272513) Building response >Thread-18::DEBUG::2014-07-08 16:14:48,368::__init__::225::IOProcess::(_processLogs) (272513) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:48,369::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:48,371::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:14:49,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:49,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017264 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:51,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:51,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177197 s, 57.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:14:52,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`03da8ed2-aa82-4dda-9a68-c018325267f7`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:14:52,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:14:52,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497537', 'lastCheck': '3.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:14:52,029::task::1191::Storage.TaskManager.Task::(prepare) Task=`03da8ed2-aa82-4dda-9a68-c018325267f7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497537', 'lastCheck': '3.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:14:52,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`03da8ed2-aa82-4dda-9a68-c018325267f7`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:52,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:14:52,030::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:14:52,030::task::993::Storage.TaskManager.Task::(_decref) Task=`03da8ed2-aa82-4dda-9a68-c018325267f7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:14:53,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:54,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179175 s, 57.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:56,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:14:56,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173889 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:14:58,354::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:14:58,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fa0be26-e222-42d6-a7a8-98cc480bf897`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:14:58,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:14:58,371::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:14:58,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fa0be26-e222-42d6-a7a8-98cc480bf897`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:14:58,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fa0be26-e222-42d6-a7a8-98cc480bf897`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:14:58,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:14:58,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:14:58,372::task::993::Storage.TaskManager.Task::(_decref) Task=`8fa0be26-e222-42d6-a7a8-98cc480bf897`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:14:58,377::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:58,378::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:14:58,378::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:58,378::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:58,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:58,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:58,379::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:58,379::__init__::225::IOProcess::(_processLogs) (272514) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:58,380::__init__::225::IOProcess::(_processLogs) (272514) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:58,380::__init__::225::IOProcess::(_processLogs) (272514) Building response >Thread-18::DEBUG::2014-07-08 16:14:58,380::__init__::225::IOProcess::(_processLogs) (272514) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:58,380::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:58,380::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:14:58,382::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6940::DEBUG::2014-07-08 16:14:58,534::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:14:58,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000529384 s, 873 kB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:14:58,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6940::DEBUG::2014-07-08 16:14:58,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`176ac0ae-8961-44bc-8b73-95a69cfcf509`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:14:58,701::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:14:58,704::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-6940::DEBUG::2014-07-08 16:14:58,711::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7bf8b01c-ad86-448d-be23-135ec81e95ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:14:58,715::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:14:58,713::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6940::DEBUG::2014-07-08 16:14:58,725::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:14:58,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:14:58,729::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7bf8b01c-ad86-448d-be23-135ec81e95ff`::Granted request >Thread-18::DEBUG::2014-07-08 16:14:58,729::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:58,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:14:58,741::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`176ac0ae-8961-44bc-8b73-95a69cfcf509`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:14:58,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:14:58,746::task::993::Storage.TaskManager.Task::(_decref) Task=`176ac0ae-8961-44bc-8b73-95a69cfcf509`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:14:58,748::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:58,753::__init__::225::IOProcess::(_processLogs) (272515) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:14:58,757::__init__::225::IOProcess::(_processLogs) (272515) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:14:58,762::__init__::225::IOProcess::(_processLogs) (272515) Building response >Thread-18::DEBUG::2014-07-08 16:14:58,767::__init__::225::IOProcess::(_processLogs) (272515) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:58,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:58,777::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:14:58,810::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:58,816::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:14:58,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:58,823::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:58,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:58,831::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:58,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:58,837::__init__::225::IOProcess::(_processLogs) (272516) Finding callback 'access'... >Thread-6940::INFO::2014-07-08 16:14:58,838::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:14:58,842::__init__::225::IOProcess::(_processLogs) (272516) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:14:58,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`176ac0ae-8961-44bc-8b73-95a69cfcf509`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:14:58,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`176ac0ae-8961-44bc-8b73-95a69cfcf509`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:14:58,847::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(272516) Building response >Thread-6940::DEBUG::2014-07-08 16:14:58,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:14:58,850::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:14:58,851::__init__::225::IOProcess::(_processLogs) (272516) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:58,857::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:14:58,857::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:14:58,941::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:14:58,943::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:14:58,945::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:14:58,948::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Dummy-6860::DEBUG::2014-07-08 16:14:58,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.154588 s, 6.6 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:14:58,955::task::993::Storage.TaskManager.Task::(_decref) Task=`176ac0ae-8961-44bc-8b73-95a69cfcf509`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:14:58,959::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:58,964::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:14:58,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:58,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:58,978::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:58,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:58,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:58,987::__init__::225::IOProcess::(_processLogs) (272517) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:58,990::__init__::225::IOProcess::(_processLogs) (272517) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:58,993::__init__::225::IOProcess::(_processLogs) (272517) Building response >Thread-18::DEBUG::2014-07-08 16:14:58,996::__init__::225::IOProcess::(_processLogs) (272517) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:58,999::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:14:59,002::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:14:59,014::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:14:59,017::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:14:59,020::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:14:59,023::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:14:59,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:14:59,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:14:59,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:14:59,039::__init__::225::IOProcess::(_processLogs) (272518) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:14:59,046::__init__::225::IOProcess::(_processLogs) (272518) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:14:59,053::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(272518) Building response >Thread-18::DEBUG::2014-07-08 16:14:59,059::__init__::225::IOProcess::(_processLogs) (272518) Queuing response >Thread-18::DEBUG::2014-07-08 16:14:59,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:14:59,070::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:15:01,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:01,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176892 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:03,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:03,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176753 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:05,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:06,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017471 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:07,188::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9673d87-5cb3-4694-b4bb-69aaa285503d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:07,191::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:15:07,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529384', 'lastCheck': '8.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:15:07,197::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9673d87-5cb3-4694-b4bb-69aaa285503d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529384', 'lastCheck': '8.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:15:07,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9673d87-5cb3-4694-b4bb-69aaa285503d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:07,200::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:07,202::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:07,203::task::993::Storage.TaskManager.Task::(_decref) Task=`e9673d87-5cb3-4694-b4bb-69aaa285503d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:15:08,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:08,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173808 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:08,983::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:15:08,984::task::595::Storage.TaskManager.Task::(_updateState) Task=`37a294ba-3ae8-4cbb-9050-12a9d39114a1`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:08,984::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:15:08,999::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:09,000::task::1191::Storage.TaskManager.Task::(prepare) Task=`37a294ba-3ae8-4cbb-9050-12a9d39114a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:09,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`37a294ba-3ae8-4cbb-9050-12a9d39114a1`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:09,000::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:09,000::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:09,001::task::993::Storage.TaskManager.Task::(_decref) Task=`37a294ba-3ae8-4cbb-9050-12a9d39114a1`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:15:09,012::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:15:09,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7d55c5a-90d7-4e62-81d0-cc5b29c45e97`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:15:09,013::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:15:09,014::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b797f03b-339e-4270-b7bc-2aca9544bb64`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:15:09,014::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:15:09,015::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:15:09,015::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b797f03b-339e-4270-b7bc-2aca9544bb64`::Granted request >Thread-6940::DEBUG::2014-07-08 16:15:09,016::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c7d55c5a-90d7-4e62-81d0-cc5b29c45e97`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:15:09,016::task::993::Storage.TaskManager.Task::(_decref) Task=`c7d55c5a-90d7-4e62-81d0-cc5b29c45e97`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:15:09,035::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:09,036::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7d55c5a-90d7-4e62-81d0-cc5b29c45e97`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:09,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7d55c5a-90d7-4e62-81d0-cc5b29c45e97`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:15:09,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:15:09,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:15:09,037::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:15:09,037::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:15:09,037::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:15:09,038::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:15:09,038::task::993::Storage.TaskManager.Task::(_decref) Task=`c7d55c5a-90d7-4e62-81d0-cc5b29c45e97`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:15:09,091::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:09,091::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:09,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:09,091::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:09,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:09,092::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:09,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:09,092::__init__::225::IOProcess::(_processLogs) (272519) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:09,093::__init__::225::IOProcess::(_processLogs) (272519) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:09,093::__init__::225::IOProcess::(_processLogs) (272519) Building response >Thread-18::DEBUG::2014-07-08 16:15:09,093::__init__::225::IOProcess::(_processLogs) (272519) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:09,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:09,094::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:15:09,095::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:15:09,246::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000573243 s, 806 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:15:09,251::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:09,253::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:09,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:09,257::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:09,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:09,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:09,263::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:09,265::__init__::225::IOProcess::(_processLogs) (272520) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:09,266::__init__::225::IOProcess::(_processLogs) (272520) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:09,268::__init__::225::IOProcess::(_processLogs) (272520) Building response >Thread-18::DEBUG::2014-07-08 16:15:09,269::__init__::225::IOProcess::(_processLogs) (272520) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:09,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:09,279::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:15:09,302::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:09,306::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:15:09,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:09,313::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:09,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:09,321::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:09,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:09,323::__init__::225::IOProcess::(_processLogs) (272521) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:09,325::__init__::225::IOProcess::(_processLogs) (272521) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:09,327::__init__::225::IOProcess::(_processLogs) (272521) Building response >Thread-18::DEBUG::2014-07-08 16:15:09,328::__init__::225::IOProcess::(_processLogs) (272521) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:09,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:09,331::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:09,337::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:09,338::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:15:09,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:09,341::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:09,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:09,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:09,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:09,347::__init__::225::IOProcess::(_processLogs) (272522) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:09,349::__init__::225::IOProcess::(_processLogs) (272522) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:09,350::__init__::225::IOProcess::(_processLogs) (272522) Building response >Thread-18::DEBUG::2014-07-08 16:15:09,351::__init__::225::IOProcess::(_processLogs) (272522) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:09,353::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:09,354::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:09,370::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:09,371::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:15:09,372::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:09,373::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:09,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:09,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:09,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:09,383::__init__::225::IOProcess::(_processLogs) (272523) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:09,384::__init__::225::IOProcess::(_processLogs) (272523) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:09,385::__init__::225::IOProcess::(_processLogs) (272523) Building response >Thread-18::DEBUG::2014-07-08 16:15:09,386::__init__::225::IOProcess::(_processLogs) (272523) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:09,387::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:09,388::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:15:10,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:10,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172342 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:12,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:12,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175227 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:14,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:15,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177772 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:17,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:17,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0427795 s, 23.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:19,051::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:15:19,053::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c3252d1-1423-4426-8610-9b095ca7a10d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:19,053::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:15:19,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:19,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c3252d1-1423-4426-8610-9b095ca7a10d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:19,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c3252d1-1423-4426-8610-9b095ca7a10d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:19,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:19,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:19,070::task::993::Storage.TaskManager.Task::(_decref) Task=`3c3252d1-1423-4426-8610-9b095ca7a10d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:15:19,081::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:15:19,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`29311715-22a8-43ca-9843-df44c0136395`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:15:19,082::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:15:19,083::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5e0f99a6-0a1b-40b1-9064-a9791d703632`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:15:19,084::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:15:19,084::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:15:19,084::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5e0f99a6-0a1b-40b1-9064-a9791d703632`::Granted request >Thread-6940::DEBUG::2014-07-08 16:15:19,085::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`29311715-22a8-43ca-9843-df44c0136395`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:15:19,085::task::993::Storage.TaskManager.Task::(_decref) Task=`29311715-22a8-43ca-9843-df44c0136395`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:15:19,104::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:19,105::task::1191::Storage.TaskManager.Task::(prepare) Task=`29311715-22a8-43ca-9843-df44c0136395`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:19,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`29311715-22a8-43ca-9843-df44c0136395`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:15:19,105::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:15:19,105::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:15:19,106::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:15:19,106::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:15:19,106::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:15:19,107::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:15:19,107::task::993::Storage.TaskManager.Task::(_decref) Task=`29311715-22a8-43ca-9843-df44c0136395`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:15:19,394::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:19,394::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:19,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:19,395::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:19,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:19,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:19,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:19,396::__init__::225::IOProcess::(_processLogs) (272524) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:19,396::__init__::225::IOProcess::(_processLogs) (272524) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:19,396::__init__::225::IOProcess::(_processLogs) (272524) Building response >Thread-18::DEBUG::2014-07-08 16:15:19,396::__init__::225::IOProcess::(_processLogs) (272524) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:19,397::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:19,397::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:15:19,398::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:19,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:15:19,560::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000605927 s, 762 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:15:19,730::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:19,739::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:19,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:19,759::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:19,764::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:19,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:19,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:19,777::__init__::225::IOProcess::(_processLogs) (272525) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:19,782::__init__::225::IOProcess::(_processLogs) (272525) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:19,786::__init__::225::IOProcess::(_processLogs) (272525) Building response >Thread-18::DEBUG::2014-07-08 16:15:19,791::__init__::225::IOProcess::(_processLogs) (272525) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:19,795::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:19,800::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:15:19,827::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:19,832::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:15:19,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:19,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:19,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:19,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:19,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:19,867::__init__::225::IOProcess::(_processLogs) (272526) Finding callback 'access'... >Dummy-6860::DEBUG::2014-07-08 16:15:19,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.148587 s, 6.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:15:19,955::__init__::225::IOProcess::(_processLogs) (272526) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:19,960::__init__::225::IOProcess::(_processLogs) DEBUG|(272526) Building response >Thread-18::DEBUG::2014-07-08 16:15:19,963::__init__::225::IOProcess::(_processLogs) (272526) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:19,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:19,968::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:19,976::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:19,979::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:15:19,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:19,984::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:19,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:19,989::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:19,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:19,994::__init__::225::IOProcess::(_processLogs) (272527) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:19,996::__init__::225::IOProcess::(_processLogs) (272527) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:19,999::__init__::225::IOProcess::(_processLogs) (272527) Building response >Thread-18::DEBUG::2014-07-08 16:15:20,000::__init__::225::IOProcess::(_processLogs) (272527) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:20,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:20,006::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:20,014::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:20,017::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:15:20,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:20,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:20,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:20,028::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:20,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:20,034::__init__::225::IOProcess::(_processLogs) (272528) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:20,037::__init__::225::IOProcess::(_processLogs) (272528) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:20,041::__init__::225::IOProcess::(_processLogs) DEBUG|(272528) Building response >Thread-18::DEBUG::2014-07-08 16:15:20,043::__init__::225::IOProcess::(_processLogs) (272528) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:20,046::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:20,048::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:15:22,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:22,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175688 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:22,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`675e23f6-b38b-4d08-b762-d87368756c89`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:22,450::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:15:22,452::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605927', 'lastCheck': '2.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:15:22,453::task::1191::Storage.TaskManager.Task::(prepare) Task=`675e23f6-b38b-4d08-b762-d87368756c89`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605927', 'lastCheck': '2.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:15:22,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`675e23f6-b38b-4d08-b762-d87368756c89`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:22,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:22,456::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:22,457::task::993::Storage.TaskManager.Task::(_decref) Task=`675e23f6-b38b-4d08-b762-d87368756c89`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:15:24,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:24,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171383 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:26,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:27,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177074 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:29,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:15:29,197::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:15:29,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6fb5090-ea39-4e26-97c1-470ac54b535f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:29,200::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:15:29,296::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:15:29,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196517 s, 52.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:29,298::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6fb5090-ea39-4e26-97c1-470ac54b535f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:29,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6fb5090-ea39-4e26-97c1-470ac54b535f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:29,300::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:29,301::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:29,302::task::993::Storage.TaskManager.Task::(_decref) Task=`c6fb5090-ea39-4e26-97c1-470ac54b535f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:15:29,317::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:15:29,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`77a0f8dc-61f2-4f1c-8e9f-bcb03502f799`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:15:29,321::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:15:29,324::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`160951d8-ad69-4a6f-806f-68c05cd5014f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:15:29,325::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:15:29,326::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:15:29,327::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`160951d8-ad69-4a6f-806f-68c05cd5014f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:15:29,330::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`77a0f8dc-61f2-4f1c-8e9f-bcb03502f799`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:15:29,331::task::993::Storage.TaskManager.Task::(_decref) Task=`77a0f8dc-61f2-4f1c-8e9f-bcb03502f799`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:15:29,359::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:29,360::task::1191::Storage.TaskManager.Task::(prepare) Task=`77a0f8dc-61f2-4f1c-8e9f-bcb03502f799`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:29,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`77a0f8dc-61f2-4f1c-8e9f-bcb03502f799`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:15:29,360::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:15:29,361::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:15:29,361::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:15:29,361::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:15:29,362::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:15:29,362::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:15:29,362::task::993::Storage.TaskManager.Task::(_decref) Task=`77a0f8dc-61f2-4f1c-8e9f-bcb03502f799`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:15:30,058::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:30,058::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:30,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:30,059::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:30,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:30,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:30,060::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:30,060::__init__::225::IOProcess::(_processLogs) (272529) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:30,060::__init__::225::IOProcess::(_processLogs) (272529) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:30,060::__init__::225::IOProcess::(_processLogs) (272529) Building response >Thread-18::DEBUG::2014-07-08 16:15:30,061::__init__::225::IOProcess::(_processLogs) (272529) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:30,061::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:30,061::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:15:30,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:15:30,211::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00043943 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:15:30,213::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:30,214::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:30,214::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:30,215::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:30,215::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:30,215::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:30,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:30,216::__init__::225::IOProcess::(_processLogs) (272530) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:30,216::__init__::225::IOProcess::(_processLogs) (272530) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:30,216::__init__::225::IOProcess::(_processLogs) (272530) Building response >Thread-18::DEBUG::2014-07-08 16:15:30,216::__init__::225::IOProcess::(_processLogs) (272530) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:30,216::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:30,217::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:15:30,219::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:30,219::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:15:30,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:30,224::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:30,227::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:30,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:30,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:30,232::__init__::225::IOProcess::(_processLogs) (272531) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:30,233::__init__::225::IOProcess::(_processLogs) (272531) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:30,235::__init__::225::IOProcess::(_processLogs) (272531) Building response >Thread-18::DEBUG::2014-07-08 16:15:30,236::__init__::225::IOProcess::(_processLogs) (272531) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:30,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:30,239::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:30,244::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:30,245::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:15:30,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:30,249::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:30,251::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:30,253::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:30,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:30,257::__init__::225::IOProcess::(_processLogs) (272532) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:30,258::__init__::225::IOProcess::(_processLogs) (272532) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:30,259::__init__::225::IOProcess::(_processLogs) (272532) Building response >Thread-18::DEBUG::2014-07-08 16:15:30,260::__init__::225::IOProcess::(_processLogs) (272532) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:30,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:30,263::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:30,267::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:30,269::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:15:30,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:30,271::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:30,272::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:30,274::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:30,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:30,276::__init__::225::IOProcess::(_processLogs) (272533) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:30,278::__init__::225::IOProcess::(_processLogs) (272533) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:30,279::__init__::225::IOProcess::(_processLogs) (272533) Building response >Thread-18::DEBUG::2014-07-08 16:15:30,280::__init__::225::IOProcess::(_processLogs) (272533) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:30,281::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:30,282::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:15:31,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:31,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0861155 s, 11.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:33,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:34,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375502 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:36,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:36,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186664 s, 54.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:37,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`551d7063-3b05-4d1b-8d31-a2ff89c03f91`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:37,644::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:15:37,644::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043943', 'lastCheck': '7.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:15:37,645::task::1191::Storage.TaskManager.Task::(prepare) Task=`551d7063-3b05-4d1b-8d31-a2ff89c03f91`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043943', 'lastCheck': '7.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:15:37,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`551d7063-3b05-4d1b-8d31-a2ff89c03f91`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:37,645::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:37,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:37,646::task::993::Storage.TaskManager.Task::(_decref) Task=`551d7063-3b05-4d1b-8d31-a2ff89c03f91`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:15:38,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:38,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171277 s, 59.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:39,376::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:15:39,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb1420c2-024b-46cd-8ecc-55c76f25269c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:39,377::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:15:39,393::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:39,393::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb1420c2-024b-46cd-8ecc-55c76f25269c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:39,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb1420c2-024b-46cd-8ecc-55c76f25269c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:39,394::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:39,394::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:39,394::task::993::Storage.TaskManager.Task::(_decref) Task=`eb1420c2-024b-46cd-8ecc-55c76f25269c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:15:39,406::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:15:39,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`83a5b097-c0bb-40bc-8d1d-96a9720d18c6`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:15:39,407::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:15:39,408::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f9e90312-9084-4e1b-9108-86e4c3b6539e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:15:39,408::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:15:39,409::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:15:39,409::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f9e90312-9084-4e1b-9108-86e4c3b6539e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:15:39,414::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`83a5b097-c0bb-40bc-8d1d-96a9720d18c6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:15:39,415::task::993::Storage.TaskManager.Task::(_decref) Task=`83a5b097-c0bb-40bc-8d1d-96a9720d18c6`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:15:39,434::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:39,434::task::1191::Storage.TaskManager.Task::(prepare) Task=`83a5b097-c0bb-40bc-8d1d-96a9720d18c6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:39,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`83a5b097-c0bb-40bc-8d1d-96a9720d18c6`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:15:39,435::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:15:39,435::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:15:39,435::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:15:39,436::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:15:39,436::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:15:39,436::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:15:39,437::task::993::Storage.TaskManager.Task::(_decref) Task=`83a5b097-c0bb-40bc-8d1d-96a9720d18c6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:15:40,288::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:40,288::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:40,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:40,289::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:40,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:40,290::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:40,290::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:40,290::__init__::225::IOProcess::(_processLogs) (272534) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:40,290::__init__::225::IOProcess::(_processLogs) (272534) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:40,290::__init__::225::IOProcess::(_processLogs) (272534) Building response >Thread-18::DEBUG::2014-07-08 16:15:40,291::__init__::225::IOProcess::(_processLogs) (272534) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:40,291::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:40,291::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:15:40,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:15:40,441::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000424624 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:15:40,447::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:40,449::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:40,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:40,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:40,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:40,457::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:40,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:40,461::__init__::225::IOProcess::(_processLogs) (272535) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:40,462::__init__::225::IOProcess::(_processLogs) (272535) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:40,463::__init__::225::IOProcess::(_processLogs) DEBUG|(272535) Building response >Thread-18::DEBUG::2014-07-08 16:15:40,465::__init__::225::IOProcess::(_processLogs) (272535) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:40,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:40,468::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:15:40,477::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:40,478::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:15:40,479::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:40,481::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:40,482::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:40,484::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:40,485::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:40,486::__init__::225::IOProcess::(_processLogs) (272536) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:40,488::__init__::225::IOProcess::(_processLogs) (272536) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:40,490::__init__::225::IOProcess::(_processLogs) DEBUG|(272536) Building response >Thread-18::DEBUG::2014-07-08 16:15:40,491::__init__::225::IOProcess::(_processLogs) (272536) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:40,492::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:40,493::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:40,498::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:40,499::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:15:40,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:40,502::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:40,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:40,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:40,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:40,506::__init__::225::IOProcess::(_processLogs) (272537) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:40,508::__init__::225::IOProcess::(_processLogs) (272537) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:40,510::__init__::225::IOProcess::(_processLogs) DEBUG|(272537) Building response >Thread-18::DEBUG::2014-07-08 16:15:40,511::__init__::225::IOProcess::(_processLogs) (272537) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:40,513::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:40,514::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:40,518::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:40,519::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:15:40,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:40,521::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:40,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:40,524::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:40,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:40,527::__init__::225::IOProcess::(_processLogs) (272538) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:40,528::__init__::225::IOProcess::(_processLogs) DEBUG|(272538) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:40,529::__init__::225::IOProcess::(_processLogs) (272538) Building response >Thread-18::DEBUG::2014-07-08 16:15:40,531::__init__::225::IOProcess::(_processLogs) (272538) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:40,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:40,534::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:15:40,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:41,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180636 s, 56.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:43,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:43,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174434 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:45,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:45,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177334 s, 57.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:47,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:47,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176459 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:49,450::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:15:49,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`71744aa0-b943-4c57-8cc4-6a6b5201524c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:49,452::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:15:49,467::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:49,467::task::1191::Storage.TaskManager.Task::(prepare) Task=`71744aa0-b943-4c57-8cc4-6a6b5201524c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:49,468::task::595::Storage.TaskManager.Task::(_updateState) Task=`71744aa0-b943-4c57-8cc4-6a6b5201524c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:49,468::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:49,468::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:49,468::task::993::Storage.TaskManager.Task::(_decref) Task=`71744aa0-b943-4c57-8cc4-6a6b5201524c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:15:49,483::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:15:49,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7a63ce3-1540-4e1c-9f8a-b35da4fff707`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:15:49,485::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:15:49,486::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9572dce9-73f3-4cff-981c-a3845ad457f8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:15:49,486::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:15:49,486::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:15:49,487::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9572dce9-73f3-4cff-981c-a3845ad457f8`::Granted request >Thread-6940::DEBUG::2014-07-08 16:15:49,487::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c7a63ce3-1540-4e1c-9f8a-b35da4fff707`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:15:49,488::task::993::Storage.TaskManager.Task::(_decref) Task=`c7a63ce3-1540-4e1c-9f8a-b35da4fff707`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:15:49,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:49,507::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7a63ce3-1540-4e1c-9f8a-b35da4fff707`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:49,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7a63ce3-1540-4e1c-9f8a-b35da4fff707`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:15:49,508::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:15:49,508::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:15:49,508::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:15:49,509::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:15:49,509::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:15:49,509::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:15:49,509::task::993::Storage.TaskManager.Task::(_decref) Task=`c7a63ce3-1540-4e1c-9f8a-b35da4fff707`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:15:49,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:50,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176518 s, 58.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:15:50,539::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:50,539::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:50,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:50,540::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:50,540::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:50,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:50,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:50,541::__init__::225::IOProcess::(_processLogs) (272539) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:50,541::__init__::225::IOProcess::(_processLogs) (272539) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:50,541::__init__::225::IOProcess::(_processLogs) (272539) Building response >Thread-18::DEBUG::2014-07-08 16:15:50,542::__init__::225::IOProcess::(_processLogs) (272539) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:50,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:50,542::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:15:50,544::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:15:50,693::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000479098 s, 964 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:15:50,698::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:50,700::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:15:50,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:50,702::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:50,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:50,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:50,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:50,708::__init__::225::IOProcess::(_processLogs) (272540) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:15:50,709::__init__::225::IOProcess::(_processLogs) (272540) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:15:50,710::__init__::225::IOProcess::(_processLogs) (272540) Building response >Thread-18::DEBUG::2014-07-08 16:15:50,711::__init__::225::IOProcess::(_processLogs) (272540) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:50,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:50,714::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:15:50,726::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:50,727::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:15:50,728::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:50,730::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:50,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:50,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:50,735::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:50,737::__init__::225::IOProcess::(_processLogs) (272541) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:50,738::__init__::225::IOProcess::(_processLogs) (272541) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:50,740::__init__::225::IOProcess::(_processLogs) (272541) Building response >Thread-18::DEBUG::2014-07-08 16:15:50,741::__init__::225::IOProcess::(_processLogs) (272541) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:50,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:50,743::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:50,748::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:50,749::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:15:50,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:50,752::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:50,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:50,756::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:50,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:50,758::__init__::225::IOProcess::(_processLogs) (272542) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:50,760::__init__::225::IOProcess::(_processLogs) (272542) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:50,762::__init__::225::IOProcess::(_processLogs) (272542) Building response >Thread-18::DEBUG::2014-07-08 16:15:50,763::__init__::225::IOProcess::(_processLogs) (272542) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:50,765::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:50,766::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:15:50,771::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:15:50,773::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:15:50,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:15:50,775::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:15:50,777::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:15:50,779::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:15:50,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:15:50,781::__init__::225::IOProcess::(_processLogs) (272543) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:15:50,783::__init__::225::IOProcess::(_processLogs) (272543) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:15:50,784::__init__::225::IOProcess::(_processLogs) (272543) Building response >Thread-18::DEBUG::2014-07-08 16:15:50,786::__init__::225::IOProcess::(_processLogs) (272543) Queuing response >Thread-18::DEBUG::2014-07-08 16:15:50,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:15:50,788::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:15:52,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:52,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.142413 s, 7.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:52,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ddcf5c3-6176-4491-a64f-688845079fa5`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:52,799::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:15:52,799::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479098', 'lastCheck': '2.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:15:52,800::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ddcf5c3-6176-4491-a64f-688845079fa5`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479098', 'lastCheck': '2.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:15:52,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ddcf5c3-6176-4491-a64f-688845079fa5`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:52,801::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:52,801::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:52,801::task::993::Storage.TaskManager.Task::(_decref) Task=`9ddcf5c3-6176-4491-a64f-688845079fa5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:15:54,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:54,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171121 s, 59.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:56,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:57,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178281 s, 57.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:15:59,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:15:59,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185804 s, 55.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:15:59,523::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:15:59,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b2ee47d-fada-455f-9068-90d492bc2f36`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:15:59,525::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:15:59,539::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:59,540::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b2ee47d-fada-455f-9068-90d492bc2f36`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:15:59,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b2ee47d-fada-455f-9068-90d492bc2f36`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:15:59,541::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:15:59,541::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:15:59,541::task::993::Storage.TaskManager.Task::(_decref) Task=`8b2ee47d-fada-455f-9068-90d492bc2f36`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:15:59,552::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:15:59,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2194d7e-fffa-4bd8-aa61-aeaafabdb78f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:15:59,553::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:15:59,554::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c215acd4-eb6e-42e5-a6cf-e6c551edb1f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:15:59,555::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:15:59,555::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:15:59,555::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c215acd4-eb6e-42e5-a6cf-e6c551edb1f1`::Granted request >Thread-6940::DEBUG::2014-07-08 16:15:59,556::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c2194d7e-fffa-4bd8-aa61-aeaafabdb78f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:15:59,556::task::993::Storage.TaskManager.Task::(_decref) Task=`c2194d7e-fffa-4bd8-aa61-aeaafabdb78f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:15:59,575::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:59,576::task::1191::Storage.TaskManager.Task::(prepare) Task=`c2194d7e-fffa-4bd8-aa61-aeaafabdb78f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:15:59,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2194d7e-fffa-4bd8-aa61-aeaafabdb78f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:15:59,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:15:59,577::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:15:59,577::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:15:59,577::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:15:59,578::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:15:59,578::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:15:59,578::task::993::Storage.TaskManager.Task::(_decref) Task=`c2194d7e-fffa-4bd8-aa61-aeaafabdb78f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:16:00,794::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:00,794::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:00,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:00,795::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:00,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:00,795::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:00,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:00,796::__init__::225::IOProcess::(_processLogs) (272544) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:00,796::__init__::225::IOProcess::(_processLogs) (272544) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:00,796::__init__::225::IOProcess::(_processLogs) (272544) Building response >Thread-18::DEBUG::2014-07-08 16:16:00,797::__init__::225::IOProcess::(_processLogs) (272544) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:00,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:00,797::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:16:00,799::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:16:00,953::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00353919 s, 131 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:00,956::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:00,957::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:00,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:00,958::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:00,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:00,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:00,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:00,963::__init__::225::IOProcess::(_processLogs) (272545) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:00,964::__init__::225::IOProcess::(_processLogs) (272545) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:00,964::__init__::225::IOProcess::(_processLogs) (272545) Building response >Thread-18::DEBUG::2014-07-08 16:16:00,965::__init__::225::IOProcess::(_processLogs) (272545) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:00,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:00,965::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:16:00,970::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:00,970::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:16:00,971::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:00,971::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:00,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:00,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:00,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:00,977::__init__::225::IOProcess::(_processLogs) (272546) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:00,978::__init__::225::IOProcess::(_processLogs) (272546) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:00,980::__init__::225::IOProcess::(_processLogs) (272546) Building response >Thread-18::DEBUG::2014-07-08 16:16:00,981::__init__::225::IOProcess::(_processLogs) (272546) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:00,982::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:00,984::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:00,988::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:00,989::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:16:00,990::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:00,992::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:00,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:00,996::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:00,997::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:00,998::__init__::225::IOProcess::(_processLogs) (272547) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:01,001::__init__::225::IOProcess::(_processLogs) (272547) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:01,002::__init__::225::IOProcess::(_processLogs) (272547) Building response >Thread-18::DEBUG::2014-07-08 16:16:01,004::__init__::225::IOProcess::(_processLogs) (272547) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:01,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:01,006::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:01,015::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:01,015::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:16:01,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:01,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:01,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:01,017::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:01,020::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:01,021::__init__::225::IOProcess::(_processLogs) (272548) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:01,022::__init__::225::IOProcess::(_processLogs) (272548) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:01,024::__init__::225::IOProcess::(_processLogs) (272548) Building response >Thread-18::DEBUG::2014-07-08 16:16:01,026::__init__::225::IOProcess::(_processLogs) (272548) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:01,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:01,028::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:16:01,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:01,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172431 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:03,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:03,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352656 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:06,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:06,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179851 s, 56.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:07,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c575e78-9c8c-40c3-8918-8ffd55f6a281`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:07,954::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:16:07,954::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00353919', 'lastCheck': '6.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:16:07,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c575e78-9c8c-40c3-8918-8ffd55f6a281`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00353919', 'lastCheck': '6.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:16:07,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c575e78-9c8c-40c3-8918-8ffd55f6a281`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:07,955::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:07,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:07,955::task::993::Storage.TaskManager.Task::(_decref) Task=`3c575e78-9c8c-40c3-8918-8ffd55f6a281`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:16:08,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:08,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172428 s, 59.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:09,592::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:16:09,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebfe4a04-fbeb-44e4-8a38-2eb42189a794`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:09,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:16:09,611::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:09,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebfe4a04-fbeb-44e4-8a38-2eb42189a794`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:09,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebfe4a04-fbeb-44e4-8a38-2eb42189a794`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:09,612::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:09,612::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:09,612::task::993::Storage.TaskManager.Task::(_decref) Task=`ebfe4a04-fbeb-44e4-8a38-2eb42189a794`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:16:09,624::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:16:09,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`84a7fb9b-dc11-4446-8afb-a76907f64cf8`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:16:09,625::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:16:09,626::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8fa0b9f8-f5a6-4b72-ad03-176b7ea6acd3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:16:09,626::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:16:09,627::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:16:09,627::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8fa0b9f8-f5a6-4b72-ad03-176b7ea6acd3`::Granted request >Thread-6940::DEBUG::2014-07-08 16:16:09,628::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`84a7fb9b-dc11-4446-8afb-a76907f64cf8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:16:09,628::task::993::Storage.TaskManager.Task::(_decref) Task=`84a7fb9b-dc11-4446-8afb-a76907f64cf8`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:16:09,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:09,647::task::1191::Storage.TaskManager.Task::(prepare) Task=`84a7fb9b-dc11-4446-8afb-a76907f64cf8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:09,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`84a7fb9b-dc11-4446-8afb-a76907f64cf8`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:16:09,648::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:16:09,648::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:16:09,648::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:16:09,649::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:16:09,649::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:16:09,649::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:16:09,650::task::993::Storage.TaskManager.Task::(_decref) Task=`84a7fb9b-dc11-4446-8afb-a76907f64cf8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:16:10,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:10,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179298 s, 57.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:11,035::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:11,035::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:11,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:11,036::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:11,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:11,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:11,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:11,037::__init__::225::IOProcess::(_processLogs) (272549) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:11,037::__init__::225::IOProcess::(_processLogs) (272549) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:11,038::__init__::225::IOProcess::(_processLogs) (272549) Building response >Thread-18::DEBUG::2014-07-08 16:16:11,038::__init__::225::IOProcess::(_processLogs) (272549) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:11,038::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:11,038::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:16:11,040::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:16:11,194::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000660401 s, 700 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:11,199::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:11,200::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:11,201::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:11,203::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:11,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:11,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:11,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:11,208::__init__::225::IOProcess::(_processLogs) (272550) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:11,209::__init__::225::IOProcess::(_processLogs) (272550) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:11,210::__init__::225::IOProcess::(_processLogs) (272550) Building response >Thread-18::DEBUG::2014-07-08 16:16:11,212::__init__::225::IOProcess::(_processLogs) (272550) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:11,213::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:11,215::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:16:11,224::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:11,226::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:16:11,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:11,230::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:11,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:11,233::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:11,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:11,235::__init__::225::IOProcess::(_processLogs) (272551) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:11,236::__init__::225::IOProcess::(_processLogs) (272551) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:11,238::__init__::225::IOProcess::(_processLogs) (272551) Building response >Thread-18::DEBUG::2014-07-08 16:16:11,239::__init__::225::IOProcess::(_processLogs) (272551) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:11,241::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:11,242::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:11,246::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:11,248::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:16:11,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:11,251::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:11,252::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:11,254::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:11,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:11,257::__init__::225::IOProcess::(_processLogs) (272552) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:11,258::__init__::225::IOProcess::(_processLogs) (272552) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:11,260::__init__::225::IOProcess::(_processLogs) (272552) Building response >Thread-18::DEBUG::2014-07-08 16:16:11,262::__init__::225::IOProcess::(_processLogs) (272552) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:11,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:11,264::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:11,270::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:11,272::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:16:11,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:11,275::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:11,277::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:11,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:11,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:11,281::__init__::225::IOProcess::(_processLogs) (272553) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:11,282::__init__::225::IOProcess::(_processLogs) (272553) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:11,284::__init__::225::IOProcess::(_processLogs) DEBUG|(272553) Building response >Thread-18::DEBUG::2014-07-08 16:16:11,285::__init__::225::IOProcess::(_processLogs) (272553) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:11,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:11,287::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:16:13,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:13,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0923532 s, 11.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:15,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:15,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196224 s, 52.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:17,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:17,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175984 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:19,680::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:16:19,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`b854a7df-b96e-4bec-8c7f-1b2cc4a561f2`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:19,682::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:16:19,697::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:19,698::task::1191::Storage.TaskManager.Task::(prepare) Task=`b854a7df-b96e-4bec-8c7f-1b2cc4a561f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:19,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`b854a7df-b96e-4bec-8c7f-1b2cc4a561f2`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:19,698::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:19,698::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:19,699::task::993::Storage.TaskManager.Task::(_decref) Task=`b854a7df-b96e-4bec-8c7f-1b2cc4a561f2`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:16:19,711::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:16:19,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`7221002c-62ea-4152-8c76-a9aae467fe4e`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:16:19,713::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:16:19,714::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`487aa4da-bf97-49a9-a6cc-bdd43dc7e498`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:16:19,714::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:16:19,714::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:16:19,715::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`487aa4da-bf97-49a9-a6cc-bdd43dc7e498`::Granted request >Thread-6940::DEBUG::2014-07-08 16:16:19,715::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7221002c-62ea-4152-8c76-a9aae467fe4e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:16:19,716::task::993::Storage.TaskManager.Task::(_decref) Task=`7221002c-62ea-4152-8c76-a9aae467fe4e`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:16:19,734::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:19,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`7221002c-62ea-4152-8c76-a9aae467fe4e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:19,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`7221002c-62ea-4152-8c76-a9aae467fe4e`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:16:19,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:16:19,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:16:19,736::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:16:19,736::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:16:19,737::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:16:19,737::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:16:19,737::task::993::Storage.TaskManager.Task::(_decref) Task=`7221002c-62ea-4152-8c76-a9aae467fe4e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:16:19,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:20,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175666 s, 58.3 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:16:21,292::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:16:21,298::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:21,299::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:16:21,299::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,299::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,300::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,300::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,300::__init__::225::IOProcess::(_processLogs) (272554) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:16:21,300::__init__::225::IOProcess::(_processLogs) (272554) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:16:21,301::__init__::225::IOProcess::(_processLogs) (272554) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,301::__init__::225::IOProcess::(_processLogs) (272554) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,301::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,301::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:16:21,302::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:21,303::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:16:21,304::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,305::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,305::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,306::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,306::__init__::225::IOProcess::(_processLogs) (272555) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:16:21,306::__init__::225::IOProcess::(_processLogs) (272555) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:16:21,307::__init__::225::IOProcess::(_processLogs) (272555) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,307::__init__::225::IOProcess::(_processLogs) (272555) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,308::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,308::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:16:21,312::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:16:21,313::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,314::__init__::225::IOProcess::(_processLogs) (272556) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:16:21,314::__init__::225::IOProcess::(_processLogs) (272556) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:16:21,314::__init__::225::IOProcess::(_processLogs) (272556) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,314::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,315::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:16:21,315::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:21,317::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:16:21,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,320::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,327::__init__::225::IOProcess::(_processLogs) (272557) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:16:21,329::__init__::225::IOProcess::(_processLogs) (272557) Got request for method 'glob' >Thread-37::DEBUG::2014-07-08 16:16:21,329::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:16:21,331::__init__::225::IOProcess::(_processLogs) (272557) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,331::__init__::225::IOProcess::(_processLogs) (272557) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,332::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:16:21,333::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:21,333::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:16:21,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,335::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,335::__init__::225::IOProcess::(_processLogs) (272558) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:16:21,335::__init__::225::IOProcess::(_processLogs) (272558) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:16:21,335::__init__::225::IOProcess::(_processLogs) (272558) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,336::__init__::225::IOProcess::(_processLogs) (272558) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,336::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:16:21,337::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:16:21,338::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:21,339::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:16:21,339::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,339::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,340::__init__::225::IOProcess::(_processLogs) (272559) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:16:21,340::__init__::225::IOProcess::(_processLogs) (272559) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:16:21,341::__init__::225::IOProcess::(_processLogs) DEBUG|(272559) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,341::__init__::225::IOProcess::(_processLogs) (272559) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,342::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,342::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:16:21,343::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:16:21,344::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:21,344::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:16:21,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,346::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,351::__init__::225::IOProcess::(_processLogs) (272560) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:21,352::__init__::225::IOProcess::(_processLogs) (272560) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:21,353::__init__::225::IOProcess::(_processLogs) (272560) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,355::__init__::225::IOProcess::(_processLogs) (272560) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,358::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:21,363::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:16:21,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,367::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,368::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,371::__init__::225::IOProcess::(_processLogs) (272561) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:16:21,372::__init__::225::IOProcess::(_processLogs) (272561) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:16:21,374::__init__::225::IOProcess::(_processLogs) (272561) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,375::__init__::225::IOProcess::(_processLogs) (272561) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,378::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:16:21,381::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:16:21,382::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:16:21,383::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:16:21,386::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:21,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,389::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,390::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,395::__init__::225::IOProcess::(_processLogs) (272562) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:21,396::__init__::225::IOProcess::(_processLogs) (272562) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:21,397::__init__::225::IOProcess::(_processLogs) (272562) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,399::__init__::225::IOProcess::(_processLogs) (272562) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,402::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:16:21,408::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:16:21,562::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000488876 s, 945 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:21,566::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:21,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,568::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,568::__init__::225::IOProcess::(_processLogs) (272563) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:21,568::__init__::225::IOProcess::(_processLogs) (272563) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:21,569::__init__::225::IOProcess::(_processLogs) (272563) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,569::__init__::225::IOProcess::(_processLogs) (272563) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,570::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:16:21,574::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:16:21,575::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,575::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,575::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,576::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,577::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,579::__init__::225::IOProcess::(_processLogs) (272564) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:21,581::__init__::225::IOProcess::(_processLogs) (272564) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:21,582::__init__::225::IOProcess::(_processLogs) (272564) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,583::__init__::225::IOProcess::(_processLogs) (272564) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,585::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,586::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:21,591::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:21,593::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:16:21,594::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,596::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,605::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,614::__init__::225::IOProcess::(_processLogs) (272565) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:21,616::__init__::225::IOProcess::(_processLogs) (272565) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:21,617::__init__::225::IOProcess::(_processLogs) (272565) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,619::__init__::225::IOProcess::(_processLogs) (272565) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,622::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:21,626::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:21,627::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:16:21,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:21,628::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:21,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:21,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:21,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:21,629::__init__::225::IOProcess::(_processLogs) (272566) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:21,630::__init__::225::IOProcess::(_processLogs) (272566) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:21,630::__init__::225::IOProcess::(_processLogs) (272566) Building response >Thread-18::DEBUG::2014-07-08 16:16:21,631::__init__::225::IOProcess::(_processLogs) (272566) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:21,631::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:21,631::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:16:22,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:22,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172459 s, 59.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:23,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0aeae2-ad69-40b5-965e-0121958d5d34`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:23,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:16:23,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488876', 'lastCheck': '1.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:16:23,260::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa0aeae2-ad69-40b5-965e-0121958d5d34`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488876', 'lastCheck': '1.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:16:23,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0aeae2-ad69-40b5-965e-0121958d5d34`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:23,261::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:23,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:23,261::task::993::Storage.TaskManager.Task::(_decref) Task=`aa0aeae2-ad69-40b5-965e-0121958d5d34`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:16:24,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:24,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0208407 s, 49.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:26,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:27,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175808 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:29,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:29,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171526 s, 59.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:29,750::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:16:29,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`144d6525-7f08-4815-8a98-9355afd10cf9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:29,752::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:16:29,767::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:29,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`144d6525-7f08-4815-8a98-9355afd10cf9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:29,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`144d6525-7f08-4815-8a98-9355afd10cf9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:29,768::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:29,768::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:29,768::task::993::Storage.TaskManager.Task::(_decref) Task=`144d6525-7f08-4815-8a98-9355afd10cf9`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:16:29,780::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:16:29,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`f10ef11f-bdcf-428f-860b-74dcfa3d8b9c`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:16:29,781::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:16:29,782::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24a0bc49-28a5-4cf0-a7e7-dfeb4fc438e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:16:29,783::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:16:29,783::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:16:29,783::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24a0bc49-28a5-4cf0-a7e7-dfeb4fc438e1`::Granted request >Thread-6940::DEBUG::2014-07-08 16:16:29,784::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f10ef11f-bdcf-428f-860b-74dcfa3d8b9c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:16:29,784::task::993::Storage.TaskManager.Task::(_decref) Task=`f10ef11f-bdcf-428f-860b-74dcfa3d8b9c`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:16:29,803::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:29,804::task::1191::Storage.TaskManager.Task::(prepare) Task=`f10ef11f-bdcf-428f-860b-74dcfa3d8b9c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:29,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`f10ef11f-bdcf-428f-860b-74dcfa3d8b9c`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:16:29,804::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:16:29,805::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:16:29,805::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:16:29,805::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:16:29,806::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:16:29,806::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:16:29,806::task::993::Storage.TaskManager.Task::(_decref) Task=`f10ef11f-bdcf-428f-860b-74dcfa3d8b9c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:16:31,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:31,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017787 s, 57.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:31,653::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:31,655::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:31,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:31,658::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:31,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:31,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:31,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:31,662::__init__::225::IOProcess::(_processLogs) (272567) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:31,663::__init__::225::IOProcess::(_processLogs) (272567) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:31,664::__init__::225::IOProcess::(_processLogs) (272567) Building response >Thread-18::DEBUG::2014-07-08 16:16:31,665::__init__::225::IOProcess::(_processLogs) (272567) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:31,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:31,668::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:16:31,673::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:16:31,833::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000538323 s, 858 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:31,845::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:31,849::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:31,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:31,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:31,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:31,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:31,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:31,864::__init__::225::IOProcess::(_processLogs) (272568) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:31,866::__init__::225::IOProcess::(_processLogs) (272568) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:31,869::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272568) Building response >Thread-18::DEBUG::2014-07-08 16:16:31,871::__init__::225::IOProcess::(_processLogs) (272568) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:31,874::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:31,878::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:16:31,892::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:31,894::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:16:31,897::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:31,899::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:31,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:31,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:31,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:31,910::__init__::225::IOProcess::(_processLogs) (272569) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:31,912::__init__::225::IOProcess::(_processLogs) (272569) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:31,914::__init__::225::IOProcess::(_processLogs) (272569) Building response >Thread-18::DEBUG::2014-07-08 16:16:31,917::__init__::225::IOProcess::(_processLogs) (272569) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:31,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:31,922::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:31,932::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:31,934::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:16:31,937::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:31,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:31,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:31,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:31,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:31,949::__init__::225::IOProcess::(_processLogs) (272570) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:31,951::__init__::225::IOProcess::(_processLogs) (272570) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:31,955::__init__::225::IOProcess::(_processLogs) DEBUG|(272570) Building response >Thread-18::DEBUG::2014-07-08 16:16:31,957::__init__::225::IOProcess::(_processLogs) (272570) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:31,960::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:31,963::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:31,972::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:31,975::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:16:31,977::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:31,979::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:31,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:31,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:31,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:31,989::__init__::225::IOProcess::(_processLogs) (272571) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:31,991::__init__::225::IOProcess::(_processLogs) (272571) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:31,994::__init__::225::IOProcess::(_processLogs) (272571) Building response >Thread-18::DEBUG::2014-07-08 16:16:31,996::__init__::225::IOProcess::(_processLogs) (272571) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:31,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:32,001::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:16:34,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:34,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438226 s, 23.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:36,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:36,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01808 s, 56.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:38,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`e71b2954-02f6-4392-86f8-59102d8b0411`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:38,420::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:16:38,421::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538323', 'lastCheck': '6.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:16:38,421::task::1191::Storage.TaskManager.Task::(prepare) Task=`e71b2954-02f6-4392-86f8-59102d8b0411`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538323', 'lastCheck': '6.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:16:38,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`e71b2954-02f6-4392-86f8-59102d8b0411`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:38,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:38,422::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:38,422::task::993::Storage.TaskManager.Task::(_decref) Task=`e71b2954-02f6-4392-86f8-59102d8b0411`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:16:38,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:39,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173249 s, 59.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:39,821::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:16:39,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff47ecd8-930a-4180-9c9b-0188c518861a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:39,823::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:16:39,842::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:39,842::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff47ecd8-930a-4180-9c9b-0188c518861a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:39,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff47ecd8-930a-4180-9c9b-0188c518861a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:39,843::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:39,843::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:39,843::task::993::Storage.TaskManager.Task::(_decref) Task=`ff47ecd8-930a-4180-9c9b-0188c518861a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:16:39,856::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:16:39,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a4337e2-9ddc-4a06-84cf-201d1e8fc935`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:16:39,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:16:39,858::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`728bf8ed-9a33-49c5-bcf8-8cd3079a979e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:16:39,858::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:16:39,859::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:16:39,859::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`728bf8ed-9a33-49c5-bcf8-8cd3079a979e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:16:39,860::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3a4337e2-9ddc-4a06-84cf-201d1e8fc935`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:16:39,860::task::993::Storage.TaskManager.Task::(_decref) Task=`3a4337e2-9ddc-4a06-84cf-201d1e8fc935`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:16:39,879::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:39,879::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a4337e2-9ddc-4a06-84cf-201d1e8fc935`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:39,880::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a4337e2-9ddc-4a06-84cf-201d1e8fc935`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:16:39,880::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:16:39,880::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:16:39,881::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:16:39,881::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:16:39,881::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:16:39,881::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:16:39,882::task::993::Storage.TaskManager.Task::(_decref) Task=`3a4337e2-9ddc-4a06-84cf-201d1e8fc935`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:16:41,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:41,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350994 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:42,009::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:42,009::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:42,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:42,010::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:42,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:42,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:42,011::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:42,011::__init__::225::IOProcess::(_processLogs) (272572) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:42,011::__init__::225::IOProcess::(_processLogs) (272572) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:42,011::__init__::225::IOProcess::(_processLogs) (272572) Building response >Thread-18::DEBUG::2014-07-08 16:16:42,012::__init__::225::IOProcess::(_processLogs) (272572) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:42,012::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:42,012::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:16:42,014::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:16:42,168::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000521004 s, 887 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:42,172::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:42,172::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:42,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:42,173::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:42,173::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:42,174::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:42,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:42,174::__init__::225::IOProcess::(_processLogs) (272573) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:42,175::__init__::225::IOProcess::(_processLogs) (272573) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:42,175::__init__::225::IOProcess::(_processLogs) (272573) Building response >Thread-18::DEBUG::2014-07-08 16:16:42,176::__init__::225::IOProcess::(_processLogs) (272573) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:42,176::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:42,176::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:16:42,181::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:16:42,181::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:16:42,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:42,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:42,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:42,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:42,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:42,186::__init__::225::IOProcess::(_processLogs) (272574) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:42,188::__init__::225::IOProcess::(_processLogs) (272574) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:42,190::__init__::225::IOProcess::(_processLogs) (272574) Building response >Thread-18::DEBUG::2014-07-08 16:16:42,191::__init__::225::IOProcess::(_processLogs) (272574) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:42,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:42,193::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:42,198::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:16:42,200::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:42,201::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:42,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:42,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:42,206::__init__::225::IOProcess::(_processLogs) (272575) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:42,207::__init__::225::IOProcess::(_processLogs) (272575) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:42,209::__init__::225::IOProcess::(_processLogs) (272575) Building response >Thread-18::DEBUG::2014-07-08 16:16:42,210::__init__::225::IOProcess::(_processLogs) (272575) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:42,211::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:42,213::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:42,218::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:16:42,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:42,220::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:42,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:42,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:42,225::__init__::225::IOProcess::(_processLogs) (272576) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:42,226::__init__::225::IOProcess::(_processLogs) (272576) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:42,228::__init__::225::IOProcess::(_processLogs) (272576) Building response >Thread-18::DEBUG::2014-07-08 16:16:42,229::__init__::225::IOProcess::(_processLogs) (272576) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:42,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:42,232::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:16:43,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:43,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173473 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:45,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:46,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173096 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:48,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:48,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177789 s, 57.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:49,896::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:16:49,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`af2a2013-2a31-4c4d-897f-687b7568e7c3`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:49,898::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:16:49,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:49,913::task::1191::Storage.TaskManager.Task::(prepare) Task=`af2a2013-2a31-4c4d-897f-687b7568e7c3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:49,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`af2a2013-2a31-4c4d-897f-687b7568e7c3`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:49,914::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:49,914::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:49,914::task::993::Storage.TaskManager.Task::(_decref) Task=`af2a2013-2a31-4c4d-897f-687b7568e7c3`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:16:49,925::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:16:49,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0bd145f-a2ca-47ab-9cba-90a07c0ddff8`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:16:49,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:16:49,928::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`69e2cb73-3897-4fdb-b0fc-fe3785402e04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:16:49,928::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:16:49,928::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:16:49,929::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`69e2cb73-3897-4fdb-b0fc-fe3785402e04`::Granted request >Thread-6940::DEBUG::2014-07-08 16:16:49,929::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d0bd145f-a2ca-47ab-9cba-90a07c0ddff8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:16:49,930::task::993::Storage.TaskManager.Task::(_decref) Task=`d0bd145f-a2ca-47ab-9cba-90a07c0ddff8`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:16:49,949::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:49,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0bd145f-a2ca-47ab-9cba-90a07c0ddff8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:16:49,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0bd145f-a2ca-47ab-9cba-90a07c0ddff8`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:16:49,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:16:49,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:16:49,951::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:16:49,951::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:16:49,951::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:16:49,951::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:16:49,952::task::993::Storage.TaskManager.Task::(_decref) Task=`d0bd145f-a2ca-47ab-9cba-90a07c0ddff8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:16:50,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:50,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174325 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:52,237::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:52,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:52,238::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:52,238::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:52,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:52,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:52,239::__init__::225::IOProcess::(_processLogs) (272577) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:52,239::__init__::225::IOProcess::(_processLogs) (272577) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:52,240::__init__::225::IOProcess::(_processLogs) (272577) Building response >Thread-18::DEBUG::2014-07-08 16:16:52,240::__init__::225::IOProcess::(_processLogs) (272577) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:52,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:52,240::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:16:52,242::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:16:52,393::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000469881 s, 983 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:16:52,399::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:16:52,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:52,402::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:52,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:52,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:52,406::__init__::225::IOProcess::(_processLogs) (272578) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:16:52,408::__init__::225::IOProcess::(_processLogs) (272578) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:16:52,409::__init__::225::IOProcess::(_processLogs) (272578) Building response >Thread-18::DEBUG::2014-07-08 16:16:52,411::__init__::225::IOProcess::(_processLogs) (272578) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:52,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:52,414::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:16:52,422::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:16:52,424::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:52,425::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:52,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:52,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:52,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:52,432::__init__::225::IOProcess::(_processLogs) (272579) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:52,433::__init__::225::IOProcess::(_processLogs) (272579) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:52,435::__init__::225::IOProcess::(_processLogs) (272579) Building response >Thread-18::DEBUG::2014-07-08 16:16:52,436::__init__::225::IOProcess::(_processLogs) (272579) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:52,438::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:52,443::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:16:52,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:52,447::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:52,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:52,449::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:52,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:16:52,452::__init__::225::IOProcess::(_processLogs) (272580) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:52,454::__init__::225::IOProcess::(_processLogs) (272580) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:52,456::__init__::225::IOProcess::(_processLogs) (272580) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:52,462::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:52,464::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:16:52,470::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:16:52,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:16:52,473::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:16:52,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:16:52,477::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:16:52,478::__init__::225::IOProcess::(_processLogs) (272581) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:16:52,480::__init__::225::IOProcess::(_processLogs) (272581) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:16:52,482::__init__::225::IOProcess::(_processLogs) (272581) Building response >Thread-18::DEBUG::2014-07-08 16:16:52,483::__init__::225::IOProcess::(_processLogs) (272581) Queuing response >Thread-18::DEBUG::2014-07-08 16:16:52,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:16:52,486::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:16:52,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:52,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173733 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:53,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ec30133-19c2-415e-b5dd-757958a0423f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:53,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:16:53,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469881', 'lastCheck': '1.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:16:53,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ec30133-19c2-415e-b5dd-757958a0423f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469881', 'lastCheck': '1.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:16:53,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ec30133-19c2-415e-b5dd-757958a0423f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:53,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:53,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:53,602::task::993::Storage.TaskManager.Task::(_decref) Task=`9ec30133-19c2-415e-b5dd-757958a0423f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:16:54,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:55,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017525 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:57,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:57,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172724 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:16:59,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:16:59,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175942 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:16:59,969::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:16:59,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3cd94d4-0f67-425b-b322-4f200c942bb4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:16:59,971::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:16:59,986::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:59,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3cd94d4-0f67-425b-b322-4f200c942bb4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:16:59,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3cd94d4-0f67-425b-b322-4f200c942bb4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:16:59,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:16:59,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:16:59,988::task::993::Storage.TaskManager.Task::(_decref) Task=`f3cd94d4-0f67-425b-b322-4f200c942bb4`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:16:59,999::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:17:00,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`e68accf9-fbbe-4050-9532-50d62cb16919`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:17:00,000::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:17:00,001::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1c8f9987-3523-42b9-a411-0c480cd5a398`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:17:00,002::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:17:00,002::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:17:00,003::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1c8f9987-3523-42b9-a411-0c480cd5a398`::Granted request >Thread-6940::DEBUG::2014-07-08 16:17:00,003::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e68accf9-fbbe-4050-9532-50d62cb16919`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:17:00,004::task::993::Storage.TaskManager.Task::(_decref) Task=`e68accf9-fbbe-4050-9532-50d62cb16919`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:17:00,025::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:00,025::task::1191::Storage.TaskManager.Task::(prepare) Task=`e68accf9-fbbe-4050-9532-50d62cb16919`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:00,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`e68accf9-fbbe-4050-9532-50d62cb16919`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:17:00,026::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:17:00,026::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:17:00,027::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:17:00,027::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:17:00,027::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:17:00,027::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:17:00,028::task::993::Storage.TaskManager.Task::(_decref) Task=`e68accf9-fbbe-4050-9532-50d62cb16919`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:17:01,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:01,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0215321 s, 47.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:02,493::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:02,493::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:02,494::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:02,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:02,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:02,494::__init__::225::IOProcess::(_processLogs) (272582) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:02,495::__init__::225::IOProcess::(_processLogs) (272582) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:02,495::__init__::225::IOProcess::(_processLogs) (272582) Building response >Thread-18::DEBUG::2014-07-08 16:17:02,495::__init__::225::IOProcess::(_processLogs) (272582) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:02,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:02,496::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:17:02,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:17:02,649::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000697836 s, 662 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:02,653::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:02,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:02,656::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:02,657::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:02,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:02,660::__init__::225::IOProcess::(_processLogs) (272583) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:02,662::__init__::225::IOProcess::(_processLogs) (272583) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:02,663::__init__::225::IOProcess::(_processLogs) (272583) Building response >Thread-18::DEBUG::2014-07-08 16:17:02,664::__init__::225::IOProcess::(_processLogs) (272583) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:02,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:02,666::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:17:02,675::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:17:02,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:02,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:02,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:02,679::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:02,680::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:02,682::__init__::225::IOProcess::(_processLogs) (272584) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:02,684::__init__::225::IOProcess::(_processLogs) (272584) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:02,686::__init__::225::IOProcess::(_processLogs) (272584) Building response >Thread-18::DEBUG::2014-07-08 16:17:02,687::__init__::225::IOProcess::(_processLogs) (272584) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:02,689::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:02,690::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:02,696::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:17:02,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:02,699::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:02,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:02,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:02,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:02,704::__init__::225::IOProcess::(_processLogs) (272585) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:02,706::__init__::225::IOProcess::(_processLogs) (272585) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:02,707::__init__::225::IOProcess::(_processLogs) (272585) Building response >Thread-18::DEBUG::2014-07-08 16:17:02,709::__init__::225::IOProcess::(_processLogs) (272585) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:02,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:02,711::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:02,717::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:17:02,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:02,720::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:02,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:02,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:02,724::__init__::225::IOProcess::(_processLogs) (272586) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:02,725::__init__::225::IOProcess::(_processLogs) (272586) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:02,726::__init__::225::IOProcess::(_processLogs) (272586) Building response >Thread-18::DEBUG::2014-07-08 16:17:02,727::__init__::225::IOProcess::(_processLogs) (272586) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:02,728::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:02,730::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:17:04,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:04,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421364 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:06,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:06,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173585 s, 59.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:17:08,775::task::595::Storage.TaskManager.Task::(_updateState) Task=`1264b52c-5942-4d1e-aa7f-aa4378e8c8e8`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:17:08,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:17:08,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697836', 'lastCheck': '6.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:17:08,777::task::1191::Storage.TaskManager.Task::(prepare) Task=`1264b52c-5942-4d1e-aa7f-aa4378e8c8e8`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697836', 'lastCheck': '6.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:17:08,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`1264b52c-5942-4d1e-aa7f-aa4378e8c8e8`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:17:08,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:17:08,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-6860::DEBUG::2014-07-08 16:17:08,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:17:08,780::task::993::Storage.TaskManager.Task::(_decref) Task=`1264b52c-5942-4d1e-aa7f-aa4378e8c8e8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:17:09,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422839 s, 24.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:17:10,042::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:17:10,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6a709c3-0f7e-41be-8196-9bab78e7f69e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:17:10,043::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:17:10,058::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:10,059::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6a709c3-0f7e-41be-8196-9bab78e7f69e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:10,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6a709c3-0f7e-41be-8196-9bab78e7f69e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:17:10,059::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:17:10,059::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:17:10,060::task::993::Storage.TaskManager.Task::(_decref) Task=`a6a709c3-0f7e-41be-8196-9bab78e7f69e`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:17:10,071::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:17:10,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a4a7d91-f5aa-450b-bc71-887c390ed92a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:17:10,072::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:17:10,073::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0d069f39-2dd7-45c9-a158-6ef09cb8afca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:17:10,073::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:17:10,073::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:17:10,074::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0d069f39-2dd7-45c9-a158-6ef09cb8afca`::Granted request >Thread-6940::DEBUG::2014-07-08 16:17:10,074::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1a4a7d91-f5aa-450b-bc71-887c390ed92a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:17:10,075::task::993::Storage.TaskManager.Task::(_decref) Task=`1a4a7d91-f5aa-450b-bc71-887c390ed92a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:17:10,093::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:10,094::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a4a7d91-f5aa-450b-bc71-887c390ed92a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:10,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a4a7d91-f5aa-450b-bc71-887c390ed92a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:17:10,095::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:17:10,095::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:17:10,095::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:17:10,096::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:17:10,096::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:17:10,096::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:17:10,096::task::993::Storage.TaskManager.Task::(_decref) Task=`1a4a7d91-f5aa-450b-bc71-887c390ed92a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:17:11,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:11,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177281 s, 57.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:12,736::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:12,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:12,737::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:12,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:12,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:12,738::__init__::225::IOProcess::(_processLogs) (272587) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:12,738::__init__::225::IOProcess::(_processLogs) (272587) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:12,738::__init__::225::IOProcess::(_processLogs) (272587) Building response >Thread-18::DEBUG::2014-07-08 16:17:12,738::__init__::225::IOProcess::(_processLogs) (272587) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:12,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:12,739::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:17:12,741::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:17:12,900::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000740858 s, 624 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:12,906::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:12,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:12,909::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:12,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:12,912::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:12,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:12,915::__init__::225::IOProcess::(_processLogs) (272588) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:12,916::__init__::225::IOProcess::(_processLogs) (272588) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:12,918::__init__::225::IOProcess::(_processLogs) (272588) Building response >Thread-18::DEBUG::2014-07-08 16:17:12,919::__init__::225::IOProcess::(_processLogs) (272588) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:12,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:12,921::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:17:12,929::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:17:12,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:12,931::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:12,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:12,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:12,936::__init__::225::IOProcess::(_processLogs) (272589) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:12,937::__init__::225::IOProcess::(_processLogs) (272589) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:12,938::__init__::225::IOProcess::(_processLogs) (272589) Building response >Thread-18::DEBUG::2014-07-08 16:17:12,939::__init__::225::IOProcess::(_processLogs) (272589) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:12,941::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:12,943::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:12,948::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:17:12,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:12,951::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:12,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:12,954::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:12,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:12,957::__init__::225::IOProcess::(_processLogs) (272590) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:12,959::__init__::225::IOProcess::(_processLogs) (272590) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:12,960::__init__::225::IOProcess::(_processLogs) (272590) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:12,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:12,963::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:12,968::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:17:12,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:12,970::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:12,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:12,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:12,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:12,975::__init__::225::IOProcess::(_processLogs) (272591) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:12,977::__init__::225::IOProcess::(_processLogs) (272591) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:12,978::__init__::225::IOProcess::(_processLogs) (272591) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:12,979::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:12,981::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:17:13,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:13,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172579 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:15,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:15,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174345 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:17,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:18,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428356 s, 23.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:17:20,108::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:17:20,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`f99bd88d-59c9-4cfa-a3c6-f77c642cedf5`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:17:20,110::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:17:20,125::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:20,125::task::1191::Storage.TaskManager.Task::(prepare) Task=`f99bd88d-59c9-4cfa-a3c6-f77c642cedf5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:20,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`f99bd88d-59c9-4cfa-a3c6-f77c642cedf5`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:17:20,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:17:20,126::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:17:20,126::task::993::Storage.TaskManager.Task::(_decref) Task=`f99bd88d-59c9-4cfa-a3c6-f77c642cedf5`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:17:20,137::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:17:20,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f7a0a67-731b-4365-b027-a63d9418337a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:17:20,138::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:17:20,139::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c42b1dfc-d8d9-4cb4-bee0-92700c063857`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:17:20,139::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:17:20,140::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:17:20,140::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c42b1dfc-d8d9-4cb4-bee0-92700c063857`::Granted request >Thread-6940::DEBUG::2014-07-08 16:17:20,145::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8f7a0a67-731b-4365-b027-a63d9418337a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:17:20,145::task::993::Storage.TaskManager.Task::(_decref) Task=`8f7a0a67-731b-4365-b027-a63d9418337a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:17:20,164::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:20,164::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f7a0a67-731b-4365-b027-a63d9418337a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:20,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f7a0a67-731b-4365-b027-a63d9418337a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:17:20,165::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:17:20,165::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:17:20,166::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:17:20,166::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:17:20,166::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:17:20,166::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:17:20,167::task::993::Storage.TaskManager.Task::(_decref) Task=`8f7a0a67-731b-4365-b027-a63d9418337a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:17:20,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:20,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174817 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:22,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:22,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177532 s, 57.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:22,988::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:22,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:22,988::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:22,989::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:22,989::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:22,989::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:22,989::__init__::225::IOProcess::(_processLogs) (272592) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:22,990::__init__::225::IOProcess::(_processLogs) (272592) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:22,990::__init__::225::IOProcess::(_processLogs) (272592) Building response >Thread-18::DEBUG::2014-07-08 16:17:22,990::__init__::225::IOProcess::(_processLogs) (272592) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:22,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:22,991::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:17:22,992::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:17:23,145::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000438313 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:23,148::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:23,149::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:23,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:23,151::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:23,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:23,153::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:23,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:23,155::__init__::225::IOProcess::(_processLogs) (272593) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:23,157::__init__::225::IOProcess::(_processLogs) (272593) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:23,158::__init__::225::IOProcess::(_processLogs) (272593) Building response >Thread-18::DEBUG::2014-07-08 16:17:23,159::__init__::225::IOProcess::(_processLogs) (272593) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:23,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:23,162::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:17:23,173::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:23,180::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:17:23,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:23,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:23,184::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:23,186::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:23,188::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:23,189::__init__::225::IOProcess::(_processLogs) (272594) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:23,191::__init__::225::IOProcess::(_processLogs) (272594) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:23,192::__init__::225::IOProcess::(_processLogs) (272594) Building response >Thread-18::DEBUG::2014-07-08 16:17:23,194::__init__::225::IOProcess::(_processLogs) (272594) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:23,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:23,196::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:23,200::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:23,201::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:17:23,201::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:23,202::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:23,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:23,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:23,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:23,203::__init__::225::IOProcess::(_processLogs) (272595) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:23,204::__init__::225::IOProcess::(_processLogs) (272595) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:23,204::__init__::225::IOProcess::(_processLogs) (272595) Building response >Thread-18::DEBUG::2014-07-08 16:17:23,204::__init__::225::IOProcess::(_processLogs) (272595) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:23,205::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:23,205::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:23,209::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:23,209::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:17:23,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:23,210::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:23,210::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:23,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:23,211::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:23,212::__init__::225::IOProcess::(_processLogs) (272596) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:23,212::__init__::225::IOProcess::(_processLogs) (272596) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:23,212::__init__::225::IOProcess::(_processLogs) (272596) Building response >Thread-18::DEBUG::2014-07-08 16:17:23,213::__init__::225::IOProcess::(_processLogs) (272596) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:23,213::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:23,214::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:17:24,224::task::595::Storage.TaskManager.Task::(_updateState) Task=`735ea6a3-1a92-4b26-9461-eb8264958826`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:17:24,225::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:17:24,225::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438313', 'lastCheck': '1.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:17:24,226::task::1191::Storage.TaskManager.Task::(prepare) Task=`735ea6a3-1a92-4b26-9461-eb8264958826`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438313', 'lastCheck': '1.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:17:24,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`735ea6a3-1a92-4b26-9461-eb8264958826`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:17:24,226::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:17:24,226::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:17:24,227::task::993::Storage.TaskManager.Task::(_decref) Task=`735ea6a3-1a92-4b26-9461-eb8264958826`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:17:24,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:25,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024924 s, 41.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:27,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:27,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174694 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:29,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:29,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177666 s, 57.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:17:30,181::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:17:30,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`0199eec2-961f-4146-8f71-0ed32da9695a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:17:30,182::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:17:30,197::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:30,198::task::1191::Storage.TaskManager.Task::(prepare) Task=`0199eec2-961f-4146-8f71-0ed32da9695a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:30,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`0199eec2-961f-4146-8f71-0ed32da9695a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:17:30,198::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:17:30,199::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:17:30,199::task::993::Storage.TaskManager.Task::(_decref) Task=`0199eec2-961f-4146-8f71-0ed32da9695a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:17:30,211::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:17:30,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`76710f24-0170-4c91-b59c-395d14c8dcf3`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:17:30,212::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:17:30,213::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`65cf2fd1-46e6-483f-809c-23f00e5f93bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:17:30,214::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:17:30,214::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:17:30,214::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`65cf2fd1-46e6-483f-809c-23f00e5f93bd`::Granted request >Thread-6940::DEBUG::2014-07-08 16:17:30,215::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`76710f24-0170-4c91-b59c-395d14c8dcf3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:17:30,215::task::993::Storage.TaskManager.Task::(_decref) Task=`76710f24-0170-4c91-b59c-395d14c8dcf3`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:17:30,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:30,235::task::1191::Storage.TaskManager.Task::(prepare) Task=`76710f24-0170-4c91-b59c-395d14c8dcf3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:30,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`76710f24-0170-4c91-b59c-395d14c8dcf3`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:17:30,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:17:30,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:17:30,236::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:17:30,237::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:17:30,237::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:17:30,237::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:17:30,237::task::993::Storage.TaskManager.Task::(_decref) Task=`76710f24-0170-4c91-b59c-395d14c8dcf3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:17:31,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:31,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175702 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:33,218::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:33,218::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:33,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:33,219::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:33,219::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:33,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:33,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:33,220::__init__::225::IOProcess::(_processLogs) (272597) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:33,220::__init__::225::IOProcess::(_processLogs) (272597) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:33,220::__init__::225::IOProcess::(_processLogs) (272597) Building response >Thread-18::DEBUG::2014-07-08 16:17:33,220::__init__::225::IOProcess::(_processLogs) (272597) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:33,221::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:33,221::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:17:33,223::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:17:33,380::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00104452 s, 442 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:33,387::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:33,389::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:33,391::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:33,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:33,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:33,396::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:33,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:33,399::__init__::225::IOProcess::(_processLogs) (272598) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:33,400::__init__::225::IOProcess::(_processLogs) (272598) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:33,402::__init__::225::IOProcess::(_processLogs) (272598) Building response >Thread-18::DEBUG::2014-07-08 16:17:33,403::__init__::225::IOProcess::(_processLogs) (272598) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:33,405::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:33,406::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:17:33,414::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:33,416::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:17:33,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:33,422::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:33,424::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:33,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:33,428::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:33,429::__init__::225::IOProcess::(_processLogs) (272599) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:33,430::__init__::225::IOProcess::(_processLogs) (272599) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:33,431::__init__::225::IOProcess::(_processLogs) (272599) Building response >Thread-18::DEBUG::2014-07-08 16:17:33,433::__init__::225::IOProcess::(_processLogs) (272599) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:33,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:33,436::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:33,441::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:33,442::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:17:33,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:33,445::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:33,446::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:33,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:33,450::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:33,452::__init__::225::IOProcess::(_processLogs) (272600) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:33,454::__init__::225::IOProcess::(_processLogs) (272600) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:33,456::__init__::225::IOProcess::(_processLogs) DEBUG|(272600) Building response >Thread-18::DEBUG::2014-07-08 16:17:33,457::__init__::225::IOProcess::(_processLogs) (272600) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:33,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:33,460::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:33,467::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:33,468::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:17:33,470::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:33,472::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:33,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:33,475::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:33,477::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:33,479::__init__::225::IOProcess::(_processLogs) (272601) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:33,480::__init__::225::IOProcess::(_processLogs) (272601) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:33,482::__init__::225::IOProcess::(_processLogs) DEBUG|(272601) Building response >Thread-18::DEBUG::2014-07-08 16:17:33,484::__init__::225::IOProcess::(_processLogs) (272601) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:33,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:33,487::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:17:33,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:34,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037644 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:36,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:36,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386835 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:38,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:38,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173099 s, 59.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:17:39,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3d683a9-4cab-4609-9a26-77b45fe53174`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:17:39,498::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:17:39,498::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104452', 'lastCheck': '6.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:17:39,498::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3d683a9-4cab-4609-9a26-77b45fe53174`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104452', 'lastCheck': '6.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:17:39,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3d683a9-4cab-4609-9a26-77b45fe53174`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:17:39,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:17:39,499::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:17:39,500::task::993::Storage.TaskManager.Task::(_decref) Task=`a3d683a9-4cab-4609-9a26-77b45fe53174`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:17:40,250::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:17:40,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fff72be-402d-47c2-9c7d-d4ca9194cfac`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:17:40,251::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:17:40,267::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:40,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`1fff72be-402d-47c2-9c7d-d4ca9194cfac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:40,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fff72be-402d-47c2-9c7d-d4ca9194cfac`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:17:40,268::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:17:40,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:17:40,269::task::993::Storage.TaskManager.Task::(_decref) Task=`1fff72be-402d-47c2-9c7d-d4ca9194cfac`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:17:40,280::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:17:40,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4e4c3ce-fa61-463b-b43e-138379147ba1`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:17:40,281::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:17:40,282::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6386351c-4a1b-4972-9584-724125f5a439`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:17:40,282::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:17:40,283::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:17:40,283::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6386351c-4a1b-4972-9584-724125f5a439`::Granted request >Thread-6940::DEBUG::2014-07-08 16:17:40,284::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a4e4c3ce-fa61-463b-b43e-138379147ba1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:17:40,284::task::993::Storage.TaskManager.Task::(_decref) Task=`a4e4c3ce-fa61-463b-b43e-138379147ba1`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:17:40,303::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:40,303::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4e4c3ce-fa61-463b-b43e-138379147ba1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:40,303::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4e4c3ce-fa61-463b-b43e-138379147ba1`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:17:40,304::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:17:40,304::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:17:40,304::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:17:40,305::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:17:40,305::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:17:40,305::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:17:40,305::task::993::Storage.TaskManager.Task::(_decref) Task=`a4e4c3ce-fa61-463b-b43e-138379147ba1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:17:40,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:41,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173833 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:43,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:43,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179147 s, 57.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:43,493::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:43,493::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:43,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:43,494::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:43,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:43,494::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:43,495::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:43,495::__init__::225::IOProcess::(_processLogs) (272602) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:43,495::__init__::225::IOProcess::(_processLogs) (272602) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:43,495::__init__::225::IOProcess::(_processLogs) (272602) Building response >Thread-18::DEBUG::2014-07-08 16:17:43,496::__init__::225::IOProcess::(_processLogs) (272602) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:43,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:43,496::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:17:43,498::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:17:43,646::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000415126 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:43,653::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:43,654::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:43,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:43,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:43,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:43,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:43,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:43,662::__init__::225::IOProcess::(_processLogs) (272603) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:43,664::__init__::225::IOProcess::(_processLogs) (272603) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:43,665::__init__::225::IOProcess::(_processLogs) DEBUG|(272603) Building response >Thread-18::DEBUG::2014-07-08 16:17:43,666::__init__::225::IOProcess::(_processLogs) (272603) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:43,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:43,669::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:17:43,677::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:43,679::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:17:43,680::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:43,682::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:43,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:43,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:43,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:43,688::__init__::225::IOProcess::(_processLogs) (272604) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:43,690::__init__::225::IOProcess::(_processLogs) (272604) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:43,692::__init__::225::IOProcess::(_processLogs) DEBUG|(272604) Building response >Thread-18::DEBUG::2014-07-08 16:17:43,693::__init__::225::IOProcess::(_processLogs) (272604) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:43,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:43,696::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:43,702::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:43,703::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:17:43,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:43,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:43,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:43,709::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:43,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:43,712::__init__::225::IOProcess::(_processLogs) (272605) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:43,713::__init__::225::IOProcess::(_processLogs) (272605) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:43,714::__init__::225::IOProcess::(_processLogs) (272605) Building response >Thread-18::DEBUG::2014-07-08 16:17:43,716::__init__::225::IOProcess::(_processLogs) (272605) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:43,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:43,719::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:43,727::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:43,729::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:17:43,731::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:43,732::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:43,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:43,735::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:43,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:43,738::__init__::225::IOProcess::(_processLogs) (272606) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:43,739::__init__::225::IOProcess::(_processLogs) (272606) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:43,741::__init__::225::IOProcess::(_processLogs) (272606) Building response >Thread-18::DEBUG::2014-07-08 16:17:43,742::__init__::225::IOProcess::(_processLogs) (272606) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:43,744::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:43,745::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:17:45,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:45,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017209 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:47,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:47,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174744 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:49,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:50,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174722 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:17:50,319::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:17:50,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`6de428fd-941e-46c0-820c-e3715d0ec732`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:17:50,321::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:17:50,336::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:50,336::task::1191::Storage.TaskManager.Task::(prepare) Task=`6de428fd-941e-46c0-820c-e3715d0ec732`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:17:50,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`6de428fd-941e-46c0-820c-e3715d0ec732`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:17:50,337::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:17:50,337::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:17:50,337::task::993::Storage.TaskManager.Task::(_decref) Task=`6de428fd-941e-46c0-820c-e3715d0ec732`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:17:50,349::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:17:50,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`c788b0c4-e34e-4188-8fe4-a50b6e7a460e`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:17:50,351::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:17:50,352::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`551f679e-e061-4c0b-840f-00b19b0f7894`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:17:50,352::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:17:50,352::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:17:50,353::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`551f679e-e061-4c0b-840f-00b19b0f7894`::Granted request >Thread-6940::DEBUG::2014-07-08 16:17:50,353::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c788b0c4-e34e-4188-8fe4-a50b6e7a460e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:17:50,354::task::993::Storage.TaskManager.Task::(_decref) Task=`c788b0c4-e34e-4188-8fe4-a50b6e7a460e`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:17:50,373::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:50,373::task::1191::Storage.TaskManager.Task::(prepare) Task=`c788b0c4-e34e-4188-8fe4-a50b6e7a460e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:17:50,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`c788b0c4-e34e-4188-8fe4-a50b6e7a460e`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:17:50,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:17:50,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:17:50,374::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:17:50,375::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:17:50,375::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:17:50,375::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:17:50,375::task::993::Storage.TaskManager.Task::(_decref) Task=`c788b0c4-e34e-4188-8fe4-a50b6e7a460e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:17:52,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:52,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172459 s, 59.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:53,752::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:53,752::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:53,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:53,753::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:53,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:53,753::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:53,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:53,754::__init__::225::IOProcess::(_processLogs) (272607) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:53,754::__init__::225::IOProcess::(_processLogs) (272607) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:53,754::__init__::225::IOProcess::(_processLogs) (272607) Building response >Thread-18::DEBUG::2014-07-08 16:17:53,754::__init__::225::IOProcess::(_processLogs) (272607) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:53,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:53,755::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:17:53,757::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:17:53,912::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00448928 s, 103 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:17:53,917::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:53,919::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:17:53,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:53,922::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:53,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:53,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:53,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:53,928::__init__::225::IOProcess::(_processLogs) (272608) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:17:53,929::__init__::225::IOProcess::(_processLogs) (272608) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:17:53,931::__init__::225::IOProcess::(_processLogs) DEBUG|(272608) Building response >Thread-18::DEBUG::2014-07-08 16:17:53,932::__init__::225::IOProcess::(_processLogs) (272608) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:53,933::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:53,935::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:17:53,945::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:53,946::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:17:53,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:53,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:53,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:53,953::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:53,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:53,955::__init__::225::IOProcess::(_processLogs) (272609) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:53,957::__init__::225::IOProcess::(_processLogs) (272609) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:53,959::__init__::225::IOProcess::(_processLogs) DEBUG|(272609) Building response >Thread-18::DEBUG::2014-07-08 16:17:53,960::__init__::225::IOProcess::(_processLogs) (272609) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:53,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:53,963::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:53,968::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:53,970::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:17:53,971::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:53,973::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:53,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:53,976::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:53,977::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:53,979::__init__::225::IOProcess::(_processLogs) (272610) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:53,980::__init__::225::IOProcess::(_processLogs) (272610) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:53,982::__init__::225::IOProcess::(_processLogs) DEBUG|(272610) Building response >Thread-18::DEBUG::2014-07-08 16:17:53,983::__init__::225::IOProcess::(_processLogs) (272610) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:53,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:53,986::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:17:53,995::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:17:53,996::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:17:53,998::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:17:53,999::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:17:54,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:17:54,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:17:54,004::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:17:54,005::__init__::225::IOProcess::(_processLogs) (272611) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:17:54,006::__init__::225::IOProcess::(_processLogs) (272611) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:17:54,008::__init__::225::IOProcess::(_processLogs) DEBUG|(272611) Building response >Thread-18::DEBUG::2014-07-08 16:17:54,009::__init__::225::IOProcess::(_processLogs) (272611) Queuing response >Thread-18::DEBUG::2014-07-08 16:17:54,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:17:54,012::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:17:54,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:54,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173766 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:17:54,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad6aa355-5ba5-4283-9997-f67b3b24a9d9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:17:54,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:17:54,814::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00448928', 'lastCheck': '0.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:17:54,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad6aa355-5ba5-4283-9997-f67b3b24a9d9`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00448928', 'lastCheck': '0.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:17:54,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad6aa355-5ba5-4283-9997-f67b3b24a9d9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:17:54,823::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:17:54,826::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:17:54,829::task::993::Storage.TaskManager.Task::(_decref) Task=`ad6aa355-5ba5-4283-9997-f67b3b24a9d9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:17:56,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:57,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176948 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:17:59,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:17:59,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0228599 s, 44.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:18:00,389::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:18:00,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`45d0cc05-0239-44eb-b171-040e883b2a5a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:00,390::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:18:00,405::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:00,406::task::1191::Storage.TaskManager.Task::(prepare) Task=`45d0cc05-0239-44eb-b171-040e883b2a5a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:00,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`45d0cc05-0239-44eb-b171-040e883b2a5a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:00,406::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:00,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:00,407::task::993::Storage.TaskManager.Task::(_decref) Task=`45d0cc05-0239-44eb-b171-040e883b2a5a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:18:00,419::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:18:00,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c3505cc-49f1-460e-8fb2-2c695521fbbd`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:18:00,420::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:18:00,421::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b64dee3c-35b0-4fd1-94a5-d9399771d330`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:18:00,421::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:18:00,422::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:18:00,422::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b64dee3c-35b0-4fd1-94a5-d9399771d330`::Granted request >Thread-6940::DEBUG::2014-07-08 16:18:00,423::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c3505cc-49f1-460e-8fb2-2c695521fbbd`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:18:00,423::task::993::Storage.TaskManager.Task::(_decref) Task=`6c3505cc-49f1-460e-8fb2-2c695521fbbd`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:18:00,442::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:00,442::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c3505cc-49f1-460e-8fb2-2c695521fbbd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:00,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c3505cc-49f1-460e-8fb2-2c695521fbbd`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:18:00,443::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:18:00,443::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:18:00,444::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:18:00,444::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:18:00,444::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:18:00,444::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:18:00,445::task::993::Storage.TaskManager.Task::(_decref) Task=`6c3505cc-49f1-460e-8fb2-2c695521fbbd`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:18:01,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:01,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175599 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:03,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:03,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037677 s, 27.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:04,033::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:04,037::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:04,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:04,042::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:04,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:04,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:04,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:04,050::__init__::225::IOProcess::(_processLogs) (272612) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:04,052::__init__::225::IOProcess::(_processLogs) (272612) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:04,055::__init__::225::IOProcess::(_processLogs) DEBUG|(272612) Building response >Thread-18::DEBUG::2014-07-08 16:18:04,059::__init__::225::IOProcess::(_processLogs) (272612) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:04,067::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:04,073::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:18:04,092::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:18:04,251::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000520723 s, 887 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:04,261::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:04,264::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:04,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:04,271::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:04,274::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:04,279::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:04,283::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:04,287::__init__::225::IOProcess::(_processLogs) (272613) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:04,292::__init__::225::IOProcess::(_processLogs) (272613) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:04,296::__init__::225::IOProcess::(_processLogs) (272613) Building response >Thread-18::DEBUG::2014-07-08 16:18:04,300::__init__::225::IOProcess::(_processLogs) (272613) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:04,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:04,308::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:18:04,329::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:04,333::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:18:04,338::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:04,341::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:04,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:04,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:04,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:04,357::__init__::225::IOProcess::(_processLogs) (272614) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:04,361::__init__::225::IOProcess::(_processLogs) (272614) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:04,365::__init__::225::IOProcess::(_processLogs) (272614) Building response >Thread-18::DEBUG::2014-07-08 16:18:04,369::__init__::225::IOProcess::(_processLogs) (272614) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:04,372::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:04,376::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:04,389::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:04,393::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:18:04,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:04,401::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:04,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:04,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:04,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:04,418::__init__::225::IOProcess::(_processLogs) (272615) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:04,421::__init__::225::IOProcess::(_processLogs) (272615) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:04,425::__init__::225::IOProcess::(_processLogs) (272615) Building response >Thread-18::DEBUG::2014-07-08 16:18:04,429::__init__::225::IOProcess::(_processLogs) (272615) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:04,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:04,438::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:04,452::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:04,457::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:18:04,460::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:04,464::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:04,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:04,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:04,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:04,479::__init__::225::IOProcess::(_processLogs) (272616) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:04,483::__init__::225::IOProcess::(_processLogs) (272616) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:04,487::__init__::225::IOProcess::(_processLogs) (272616) Building response >Thread-18::DEBUG::2014-07-08 16:18:04,492::__init__::225::IOProcess::(_processLogs) (272616) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:04,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:04,500::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:18:06,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:06,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172682 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:09,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:09,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173604 s, 59.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:18:10,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0e48668-33e7-4138-bb8d-d1f1b6a82713`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:10,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:18:10,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520723', 'lastCheck': '5.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:18:10,064::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0e48668-33e7-4138-bb8d-d1f1b6a82713`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520723', 'lastCheck': '5.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:18:10,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0e48668-33e7-4138-bb8d-d1f1b6a82713`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:10,065::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:10,065::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:10,065::task::993::Storage.TaskManager.Task::(_decref) Task=`a0e48668-33e7-4138-bb8d-d1f1b6a82713`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:18:10,457::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:18:10,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`066954fc-6b97-4168-91cf-ed26617e69b0`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:10,458::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:18:10,473::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:10,473::task::1191::Storage.TaskManager.Task::(prepare) Task=`066954fc-6b97-4168-91cf-ed26617e69b0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:10,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`066954fc-6b97-4168-91cf-ed26617e69b0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:10,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:10,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:10,474::task::993::Storage.TaskManager.Task::(_decref) Task=`066954fc-6b97-4168-91cf-ed26617e69b0`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:18:10,486::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:18:10,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`43b1d519-92c0-436c-94f8-bbc9327cc99a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:18:10,488::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:18:10,489::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fb467f87-a0c7-48ba-8af1-f294132a5d38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:18:10,489::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:18:10,489::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:18:10,490::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fb467f87-a0c7-48ba-8af1-f294132a5d38`::Granted request >Thread-6940::DEBUG::2014-07-08 16:18:10,490::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`43b1d519-92c0-436c-94f8-bbc9327cc99a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:18:10,491::task::993::Storage.TaskManager.Task::(_decref) Task=`43b1d519-92c0-436c-94f8-bbc9327cc99a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:18:10,509::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:10,510::task::1191::Storage.TaskManager.Task::(prepare) Task=`43b1d519-92c0-436c-94f8-bbc9327cc99a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:10,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`43b1d519-92c0-436c-94f8-bbc9327cc99a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:18:10,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:18:10,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:18:10,511::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:18:10,512::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:18:10,512::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:18:10,512::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:18:10,512::task::993::Storage.TaskManager.Task::(_decref) Task=`43b1d519-92c0-436c-94f8-bbc9327cc99a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:18:11,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:11,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174096 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:13,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:13,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174886 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:14,511::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:14,512::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:14,512::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:14,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:14,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:14,513::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:14,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:14,513::__init__::225::IOProcess::(_processLogs) (272617) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:14,513::__init__::225::IOProcess::(_processLogs) (272617) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:14,514::__init__::225::IOProcess::(_processLogs) (272617) Building response >Thread-18::DEBUG::2014-07-08 16:18:14,514::__init__::225::IOProcess::(_processLogs) (272617) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:14,514::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:14,514::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:18:14,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:18:14,665::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000471837 s, 979 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:14,667::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:14,668::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:14,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:14,668::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:14,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:14,669::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:14,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:14,669::__init__::225::IOProcess::(_processLogs) (272618) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:14,669::__init__::225::IOProcess::(_processLogs) (272618) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:14,670::__init__::225::IOProcess::(_processLogs) (272618) Building response >Thread-18::DEBUG::2014-07-08 16:18:14,670::__init__::225::IOProcess::(_processLogs) (272618) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:14,670::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:14,670::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:18:14,673::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:14,673::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:18:14,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:14,673::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:14,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:14,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:14,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:14,674::__init__::225::IOProcess::(_processLogs) (272619) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:14,675::__init__::225::IOProcess::(_processLogs) (272619) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:14,675::__init__::225::IOProcess::(_processLogs) (272619) Building response >Thread-18::DEBUG::2014-07-08 16:18:14,675::__init__::225::IOProcess::(_processLogs) (272619) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:14,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:14,676::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:14,677::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:14,677::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:18:14,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:14,677::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:14,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:14,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:14,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:14,678::__init__::225::IOProcess::(_processLogs) (272620) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:14,679::__init__::225::IOProcess::(_processLogs) (272620) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:14,679::__init__::225::IOProcess::(_processLogs) (272620) Building response >Thread-18::DEBUG::2014-07-08 16:18:14,679::__init__::225::IOProcess::(_processLogs) (272620) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:14,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:14,680::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:14,681::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:14,681::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:18:14,681::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:14,682::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:14,682::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:14,682::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:14,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:14,683::__init__::225::IOProcess::(_processLogs) (272621) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:14,683::__init__::225::IOProcess::(_processLogs) (272621) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:14,683::__init__::225::IOProcess::(_processLogs) (272621) Building response >Thread-18::DEBUG::2014-07-08 16:18:14,683::__init__::225::IOProcess::(_processLogs) (272621) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:14,683::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:14,684::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:18:15,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:16,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184538 s, 55.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:18,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:18,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175353 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:20,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:18:20,661::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:18:20,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`75e7733f-e6a4-465a-a76c-ad5d88aa5958`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:20,672::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:18:20,766::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:18:20,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248916 s, 41.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:18:20,768::task::1191::Storage.TaskManager.Task::(prepare) Task=`75e7733f-e6a4-465a-a76c-ad5d88aa5958`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:20,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`75e7733f-e6a4-465a-a76c-ad5d88aa5958`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:20,770::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:20,771::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:20,772::task::993::Storage.TaskManager.Task::(_decref) Task=`75e7733f-e6a4-465a-a76c-ad5d88aa5958`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:18:20,786::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:18:20,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cdefe1a-c6c2-4d26-80a1-c503689d1d95`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:18:20,790::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:18:20,792::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`08c40faf-0364-4dcf-9dca-f7b1c6624f1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:18:20,793::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:18:20,795::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:18:20,796::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`08c40faf-0364-4dcf-9dca-f7b1c6624f1a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:18:20,798::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2cdefe1a-c6c2-4d26-80a1-c503689d1d95`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:18:20,799::task::993::Storage.TaskManager.Task::(_decref) Task=`2cdefe1a-c6c2-4d26-80a1-c503689d1d95`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:18:20,827::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:20,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`2cdefe1a-c6c2-4d26-80a1-c503689d1d95`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:20,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cdefe1a-c6c2-4d26-80a1-c503689d1d95`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:18:20,828::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:18:20,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:18:20,828::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:18:20,829::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:18:20,829::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:18:20,829::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:18:20,830::task::993::Storage.TaskManager.Task::(_decref) Task=`2cdefe1a-c6c2-4d26-80a1-c503689d1d95`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:18:22,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:23,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173752 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:24,687::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:24,687::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:24,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:24,688::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:24,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:24,688::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:24,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:24,689::__init__::225::IOProcess::(_processLogs) (272622) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:24,689::__init__::225::IOProcess::(_processLogs) (272622) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:24,689::__init__::225::IOProcess::(_processLogs) (272622) Building response >Thread-18::DEBUG::2014-07-08 16:18:24,690::__init__::225::IOProcess::(_processLogs) (272622) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:24,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:24,690::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:18:24,692::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:18:24,841::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000514578 s, 898 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:24,843::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:24,844::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:24,844::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:24,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:24,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:24,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:24,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:24,845::__init__::225::IOProcess::(_processLogs) (272623) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:24,846::__init__::225::IOProcess::(_processLogs) (272623) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:24,846::__init__::225::IOProcess::(_processLogs) (272623) Building response >Thread-18::DEBUG::2014-07-08 16:18:24,846::__init__::225::IOProcess::(_processLogs) (272623) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:24,846::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:24,846::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:18:24,849::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:18:24,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:24,849::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:24,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:24,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:24,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:24,850::__init__::225::IOProcess::(_processLogs) (272624) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:24,851::__init__::225::IOProcess::(_processLogs) (272624) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:24,851::__init__::225::IOProcess::(_processLogs) (272624) Building response >Thread-18::DEBUG::2014-07-08 16:18:24,851::__init__::225::IOProcess::(_processLogs) (272624) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:24,851::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:24,851::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:24,853::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:24,853::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:18:24,853::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:24,853::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:24,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:24,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:24,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:24,854::__init__::225::IOProcess::(_processLogs) (272625) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:24,855::__init__::225::IOProcess::(_processLogs) (272625) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:24,855::__init__::225::IOProcess::(_processLogs) (272625) Building response >Thread-18::DEBUG::2014-07-08 16:18:24,855::__init__::225::IOProcess::(_processLogs) (272625) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:24,855::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:24,856::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:24,857::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:24,857::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:18:24,857::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:24,858::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:24,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:24,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:24,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:24,858::__init__::225::IOProcess::(_processLogs) (272626) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:24,859::__init__::225::IOProcess::(_processLogs) (272626) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:24,859::__init__::225::IOProcess::(_processLogs) (272626) Building response >Thread-18::DEBUG::2014-07-08 16:18:24,859::__init__::225::IOProcess::(_processLogs) (272626) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:24,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:24,860::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:18:25,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:18:25,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a7d809a-627e-4de4-af8a-3ddc67db3829`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:25,290::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:18:25,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514578', 'lastCheck': '0.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:18:25,302::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a7d809a-627e-4de4-af8a-3ddc67db3829`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514578', 'lastCheck': '0.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:18:25,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a7d809a-627e-4de4-af8a-3ddc67db3829`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:25,309::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:25,312::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:25,315::task::993::Storage.TaskManager.Task::(_decref) Task=`9a7d809a-627e-4de4-af8a-3ddc67db3829`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:18:25,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104598 s, 9.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:27,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:27,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175599 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:29,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:29,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175247 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:18:30,845::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:18:30,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`25d5dc72-93b1-44b7-b84c-f7d3242b1575`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:30,847::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:18:30,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:30,862::task::1191::Storage.TaskManager.Task::(prepare) Task=`25d5dc72-93b1-44b7-b84c-f7d3242b1575`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:30,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`25d5dc72-93b1-44b7-b84c-f7d3242b1575`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:30,863::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:30,863::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:30,864::task::993::Storage.TaskManager.Task::(_decref) Task=`25d5dc72-93b1-44b7-b84c-f7d3242b1575`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:18:30,875::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:18:30,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`54a4c2ed-f16b-41e8-8260-d4bcb9b843c0`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:18:30,877::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:18:30,878::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`857d316c-ece7-4348-aaca-d8335d4114a7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:18:30,878::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:18:30,878::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:18:30,879::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`857d316c-ece7-4348-aaca-d8335d4114a7`::Granted request >Thread-6940::DEBUG::2014-07-08 16:18:30,879::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`54a4c2ed-f16b-41e8-8260-d4bcb9b843c0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:18:30,880::task::993::Storage.TaskManager.Task::(_decref) Task=`54a4c2ed-f16b-41e8-8260-d4bcb9b843c0`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:18:30,899::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:30,899::task::1191::Storage.TaskManager.Task::(prepare) Task=`54a4c2ed-f16b-41e8-8260-d4bcb9b843c0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:30,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`54a4c2ed-f16b-41e8-8260-d4bcb9b843c0`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:18:30,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:18:30,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:18:30,901::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:18:30,901::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:18:30,901::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:18:30,901::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:18:30,902::task::993::Storage.TaskManager.Task::(_decref) Task=`54a4c2ed-f16b-41e8-8260-d4bcb9b843c0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:18:32,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:32,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176755 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:34,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:34,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399661 s, 25.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:34,863::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:34,863::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:34,864::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:34,864::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:34,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:34,864::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:34,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:34,865::__init__::225::IOProcess::(_processLogs) (272627) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:34,865::__init__::225::IOProcess::(_processLogs) (272627) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:34,865::__init__::225::IOProcess::(_processLogs) (272627) Building response >Thread-18::DEBUG::2014-07-08 16:18:34,866::__init__::225::IOProcess::(_processLogs) (272627) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:34,866::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:34,866::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:18:34,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:18:35,016::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000490832 s, 941 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:35,021::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:35,023::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:35,025::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:35,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:35,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:35,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:35,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:35,032::__init__::225::IOProcess::(_processLogs) (272628) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:35,033::__init__::225::IOProcess::(_processLogs) (272628) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:35,035::__init__::225::IOProcess::(_processLogs) DEBUG|(272628) Building response >Thread-18::DEBUG::2014-07-08 16:18:35,036::__init__::225::IOProcess::(_processLogs) (272628) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:35,038::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:35,040::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:18:35,048::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:35,050::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:18:35,051::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:35,052::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:35,054::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:35,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:35,057::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:35,058::__init__::225::IOProcess::(_processLogs) (272629) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:35,060::__init__::225::IOProcess::(_processLogs) (272629) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:35,061::__init__::225::IOProcess::(_processLogs) (272629) Building response >Thread-18::DEBUG::2014-07-08 16:18:35,062::__init__::225::IOProcess::(_processLogs) (272629) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:35,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:35,065::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:35,069::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:35,071::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:18:35,072::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:35,074::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:35,075::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:35,076::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:35,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:35,079::__init__::225::IOProcess::(_processLogs) (272630) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:35,081::__init__::225::IOProcess::(_processLogs) (272630) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:35,082::__init__::225::IOProcess::(_processLogs) (272630) Building response >Thread-18::DEBUG::2014-07-08 16:18:35,084::__init__::225::IOProcess::(_processLogs) (272630) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:35,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:35,086::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:35,091::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:18:35,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:35,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:35,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:35,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:35,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:35,099::__init__::225::IOProcess::(_processLogs) (272631) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:35,100::__init__::225::IOProcess::(_processLogs) (272631) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:35,102::__init__::225::IOProcess::(_processLogs) (272631) Building response >Thread-18::DEBUG::2014-07-08 16:18:35,103::__init__::225::IOProcess::(_processLogs) (272631) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:35,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:35,106::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:18:36,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:37,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173121 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:39,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:39,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174107 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:18:40,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`c894ea6e-e25b-4f3f-bf14-89902efc9513`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:40,604::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:18:40,605::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490832', 'lastCheck': '5.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:18:40,605::task::1191::Storage.TaskManager.Task::(prepare) Task=`c894ea6e-e25b-4f3f-bf14-89902efc9513`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490832', 'lastCheck': '5.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:18:40,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`c894ea6e-e25b-4f3f-bf14-89902efc9513`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:40,606::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:40,606::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:40,606::task::993::Storage.TaskManager.Task::(_decref) Task=`c894ea6e-e25b-4f3f-bf14-89902efc9513`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:18:40,914::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:18:40,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d4a5dc9-c012-40e1-834a-bb345770b22c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:40,915::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:18:40,931::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:40,932::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d4a5dc9-c012-40e1-834a-bb345770b22c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:40,932::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d4a5dc9-c012-40e1-834a-bb345770b22c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:40,932::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:40,932::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:40,933::task::993::Storage.TaskManager.Task::(_decref) Task=`4d4a5dc9-c012-40e1-834a-bb345770b22c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:18:40,944::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:18:40,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`870ef5d2-9afb-4a27-be64-5aeea1c478cf`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:18:40,946::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:18:40,946::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`98975fef-4248-4e19-a096-41f69e5ae34a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:18:40,947::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:18:40,947::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:18:40,947::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`98975fef-4248-4e19-a096-41f69e5ae34a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:18:40,948::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`870ef5d2-9afb-4a27-be64-5aeea1c478cf`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:18:40,948::task::993::Storage.TaskManager.Task::(_decref) Task=`870ef5d2-9afb-4a27-be64-5aeea1c478cf`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:18:40,967::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:40,968::task::1191::Storage.TaskManager.Task::(prepare) Task=`870ef5d2-9afb-4a27-be64-5aeea1c478cf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:40,968::task::595::Storage.TaskManager.Task::(_updateState) Task=`870ef5d2-9afb-4a27-be64-5aeea1c478cf`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:18:40,968::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:18:40,968::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:18:40,969::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:18:40,969::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:18:40,969::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:18:40,970::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:18:40,970::task::993::Storage.TaskManager.Task::(_decref) Task=`870ef5d2-9afb-4a27-be64-5aeea1c478cf`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:18:41,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:41,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174236 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:43,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:43,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017161 s, 59.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:45,112::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:45,113::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:45,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:45,113::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:45,113::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:45,114::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:45,114::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:45,114::__init__::225::IOProcess::(_processLogs) (272632) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:45,114::__init__::225::IOProcess::(_processLogs) (272632) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:45,115::__init__::225::IOProcess::(_processLogs) (272632) Building response >Thread-18::DEBUG::2014-07-08 16:18:45,115::__init__::225::IOProcess::(_processLogs) (272632) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:45,115::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:45,115::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:18:45,117::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:18:45,280::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00472339 s, 97.8 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:45,286::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:45,287::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:45,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:45,289::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:45,290::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:45,292::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:45,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:45,295::__init__::225::IOProcess::(_processLogs) (272633) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:45,296::__init__::225::IOProcess::(_processLogs) (272633) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:45,298::__init__::225::IOProcess::(_processLogs) (272633) Building response >Thread-18::DEBUG::2014-07-08 16:18:45,299::__init__::225::IOProcess::(_processLogs) (272633) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:45,300::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:45,301::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:18:45,308::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:45,309::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:18:45,309::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:45,310::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:45,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:45,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:45,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:45,312::__init__::225::IOProcess::(_processLogs) (272634) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:45,312::__init__::225::IOProcess::(_processLogs) (272634) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:45,313::__init__::225::IOProcess::(_processLogs) (272634) Building response >Thread-18::DEBUG::2014-07-08 16:18:45,313::__init__::225::IOProcess::(_processLogs) (272634) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:45,314::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:45,314::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:45,326::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:45,327::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:18:45,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:45,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:45,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:45,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:45,335::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:45,336::__init__::225::IOProcess::(_processLogs) (272635) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:45,338::__init__::225::IOProcess::(_processLogs) (272635) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:45,339::__init__::225::IOProcess::(_processLogs) (272635) Building response >Thread-18::DEBUG::2014-07-08 16:18:45,341::__init__::225::IOProcess::(_processLogs) (272635) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:45,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:45,344::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:45,349::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:45,350::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:18:45,352::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:45,353::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:45,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:45,356::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:45,358::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:45,359::__init__::225::IOProcess::(_processLogs) (272636) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:45,360::__init__::225::IOProcess::(_processLogs) (272636) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:45,362::__init__::225::IOProcess::(_processLogs) (272636) Building response >Thread-18::DEBUG::2014-07-08 16:18:45,363::__init__::225::IOProcess::(_processLogs) (272636) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:45,364::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:45,365::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:18:45,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:46,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181203 s, 56.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:48,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:48,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180666 s, 56.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:50,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:50,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175705 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:18:50,983::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:18:50,985::task::595::Storage.TaskManager.Task::(_updateState) Task=`8404235a-1bff-48ee-9c77-7ff507594f13`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:50,986::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:18:51,001::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:51,001::task::1191::Storage.TaskManager.Task::(prepare) Task=`8404235a-1bff-48ee-9c77-7ff507594f13`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:18:51,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`8404235a-1bff-48ee-9c77-7ff507594f13`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:51,002::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:51,002::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:51,002::task::993::Storage.TaskManager.Task::(_decref) Task=`8404235a-1bff-48ee-9c77-7ff507594f13`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:18:51,013::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:18:51,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3c27b5b-c327-49ca-9a53-88fc0b87dc01`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:18:51,015::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:18:51,016::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3ce05470-1100-4f2f-bb10-506ba6ebdc38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:18:51,016::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:18:51,016::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:18:51,017::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3ce05470-1100-4f2f-bb10-506ba6ebdc38`::Granted request >Thread-6940::DEBUG::2014-07-08 16:18:51,017::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e3c27b5b-c327-49ca-9a53-88fc0b87dc01`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:18:51,018::task::993::Storage.TaskManager.Task::(_decref) Task=`e3c27b5b-c327-49ca-9a53-88fc0b87dc01`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:18:51,037::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:51,037::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3c27b5b-c327-49ca-9a53-88fc0b87dc01`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:18:51,038::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3c27b5b-c327-49ca-9a53-88fc0b87dc01`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:18:51,038::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:18:51,038::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:18:51,039::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:18:51,039::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:18:51,039::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:18:51,039::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:18:51,040::task::993::Storage.TaskManager.Task::(_decref) Task=`e3c27b5b-c327-49ca-9a53-88fc0b87dc01`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:18:52,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:53,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018077 s, 56.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:55,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:55,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172029 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:55,371::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:55,371::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:55,371::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:55,372::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:55,372::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:55,372::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:55,372::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:55,373::__init__::225::IOProcess::(_processLogs) (272637) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:55,373::__init__::225::IOProcess::(_processLogs) (272637) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:55,373::__init__::225::IOProcess::(_processLogs) (272637) Building response >Thread-18::DEBUG::2014-07-08 16:18:55,373::__init__::225::IOProcess::(_processLogs) (272637) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:55,374::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:55,374::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:18:55,376::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:18:55,529::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000595032 s, 776 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:18:55,534::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:55,536::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:18:55,538::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:55,539::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:55,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:55,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:55,549::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:55,551::__init__::225::IOProcess::(_processLogs) (272638) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:18:55,553::__init__::225::IOProcess::(_processLogs) (272638) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:18:55,554::__init__::225::IOProcess::(_processLogs) (272638) Building response >Thread-18::DEBUG::2014-07-08 16:18:55,555::__init__::225::IOProcess::(_processLogs) (272638) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:55,557::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:55,559::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:18:55,568::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:55,570::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:18:55,571::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:55,573::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:55,575::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:55,577::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:55,578::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:55,580::__init__::225::IOProcess::(_processLogs) (272639) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:55,582::__init__::225::IOProcess::(_processLogs) (272639) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:55,583::__init__::225::IOProcess::(_processLogs) (272639) Building response >Thread-18::DEBUG::2014-07-08 16:18:55,585::__init__::225::IOProcess::(_processLogs) (272639) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:55,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:55,588::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:55,594::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:55,595::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:18:55,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:55,598::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:55,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:55,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:55,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:55,604::__init__::225::IOProcess::(_processLogs) (272640) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:55,606::__init__::225::IOProcess::(_processLogs) (272640) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:55,608::__init__::225::IOProcess::(_processLogs) (272640) Building response >Thread-18::DEBUG::2014-07-08 16:18:55,610::__init__::225::IOProcess::(_processLogs) (272640) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:55,611::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:18:55,613::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:18:55,618::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:18:55,620::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:18:55,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:18:55,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:18:55,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:18:55,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:18:55,628::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:18:55,630::__init__::225::IOProcess::(_processLogs) (272641) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:18:55,631::__init__::225::IOProcess::(_processLogs) (272641) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:18:55,633::__init__::225::IOProcess::(_processLogs) (272641) Building response >Thread-18::DEBUG::2014-07-08 16:18:55,634::__init__::225::IOProcess::(_processLogs) (272641) Queuing response >Thread-18::DEBUG::2014-07-08 16:18:55,635::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:18:55,637::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:18:55,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad7280a2-9b05-4db4-b00b-eae7b715f2a2`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:18:55,974::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:18:55,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595032', 'lastCheck': '0.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:18:55,975::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad7280a2-9b05-4db4-b00b-eae7b715f2a2`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595032', 'lastCheck': '0.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:18:55,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad7280a2-9b05-4db4-b00b-eae7b715f2a2`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:18:55,975::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:18:55,976::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:18:55,976::task::993::Storage.TaskManager.Task::(_decref) Task=`ad7280a2-9b05-4db4-b00b-eae7b715f2a2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:18:57,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:57,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017561 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:18:59,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:18:59,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175725 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:19:01,058::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:19:01,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`752605c6-4da0-4f21-83f8-05b8ac514c5a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:01,059::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:19:01,075::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:01,076::task::1191::Storage.TaskManager.Task::(prepare) Task=`752605c6-4da0-4f21-83f8-05b8ac514c5a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:01,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`752605c6-4da0-4f21-83f8-05b8ac514c5a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:01,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:01,076::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:01,077::task::993::Storage.TaskManager.Task::(_decref) Task=`752605c6-4da0-4f21-83f8-05b8ac514c5a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:19:01,088::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:19:01,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf2f209c-b544-4977-935e-bd83a275ad7f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:19:01,089::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:19:01,090::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`efb4105e-3f4c-4f2a-a173-1f4eb9764f8f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:19:01,090::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:19:01,091::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:19:01,091::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`efb4105e-3f4c-4f2a-a173-1f4eb9764f8f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:19:01,092::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bf2f209c-b544-4977-935e-bd83a275ad7f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:19:01,092::task::993::Storage.TaskManager.Task::(_decref) Task=`bf2f209c-b544-4977-935e-bd83a275ad7f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:19:01,111::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:01,112::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf2f209c-b544-4977-935e-bd83a275ad7f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:01,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf2f209c-b544-4977-935e-bd83a275ad7f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:19:01,112::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:19:01,112::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:19:01,113::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:19:01,113::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:19:01,113::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:19:01,114::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:19:01,114::task::993::Storage.TaskManager.Task::(_decref) Task=`bf2f209c-b544-4977-935e-bd83a275ad7f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:19:01,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:02,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382771 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:04,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:04,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461368 s, 22.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:05,642::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:05,643::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:05,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:05,644::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:05,644::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:05,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:05,644::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:05,645::__init__::225::IOProcess::(_processLogs) (272642) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:05,645::__init__::225::IOProcess::(_processLogs) (272642) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:05,645::__init__::225::IOProcess::(_processLogs) (272642) Building response >Thread-18::DEBUG::2014-07-08 16:19:05,645::__init__::225::IOProcess::(_processLogs) (272642) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:05,646::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:05,646::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:19:05,647::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:19:05,804::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00425155 s, 109 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:05,809::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:05,811::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:05,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:05,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:05,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:05,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:05,817::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:05,818::__init__::225::IOProcess::(_processLogs) (272643) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:05,819::__init__::225::IOProcess::(_processLogs) (272643) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:05,820::__init__::225::IOProcess::(_processLogs) (272643) Building response >Thread-18::DEBUG::2014-07-08 16:19:05,822::__init__::225::IOProcess::(_processLogs) (272643) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:05,823::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:05,824::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:19:05,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:05,837::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:19:05,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:05,840::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:05,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:05,842::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:05,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:05,845::__init__::225::IOProcess::(_processLogs) (272644) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:05,846::__init__::225::IOProcess::(_processLogs) (272644) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:05,847::__init__::225::IOProcess::(_processLogs) (272644) Building response >Thread-18::DEBUG::2014-07-08 16:19:05,849::__init__::225::IOProcess::(_processLogs) (272644) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:05,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:05,851::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:05,858::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:05,860::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:19:05,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:05,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:05,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:05,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:05,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:05,869::__init__::225::IOProcess::(_processLogs) (272645) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:05,870::__init__::225::IOProcess::(_processLogs) (272645) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:05,872::__init__::225::IOProcess::(_processLogs) DEBUG|(272645) Building response >Thread-18::DEBUG::2014-07-08 16:19:05,873::__init__::225::IOProcess::(_processLogs) (272645) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:05,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:05,876::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:05,883::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:05,884::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:19:05,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:05,887::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:05,889::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:05,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:05,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:05,894::__init__::225::IOProcess::(_processLogs) (272646) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:05,895::__init__::225::IOProcess::(_processLogs) DEBUG|(272646) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:05,897::__init__::225::IOProcess::(_processLogs) (272646) Building response >Thread-18::DEBUG::2014-07-08 16:19:05,898::__init__::225::IOProcess::(_processLogs) (272646) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:05,900::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:05,901::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:19:06,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:06,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176311 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:08,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:09,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172923 s, 59.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:19:11,128::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:19:11,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`b814270c-15a1-494c-88b1-0a977cfe010a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:11,130::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:19:11,145::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:11,146::task::1191::Storage.TaskManager.Task::(prepare) Task=`b814270c-15a1-494c-88b1-0a977cfe010a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:11,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`b814270c-15a1-494c-88b1-0a977cfe010a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:11,146::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:11,146::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:11,147::task::993::Storage.TaskManager.Task::(_decref) Task=`b814270c-15a1-494c-88b1-0a977cfe010a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:19:11,158::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:19:11,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`043d2f84-e2f8-4ea6-add4-12bbc42dccd8`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:19:11,159::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:19:11,160::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`38b81559-caac-44a9-a3f4-8af2308aba74`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:19:11,161::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:19:11,161::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:19:11,161::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`38b81559-caac-44a9-a3f4-8af2308aba74`::Granted request >Thread-6940::DEBUG::2014-07-08 16:19:11,162::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`043d2f84-e2f8-4ea6-add4-12bbc42dccd8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:19:11,162::task::993::Storage.TaskManager.Task::(_decref) Task=`043d2f84-e2f8-4ea6-add4-12bbc42dccd8`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:19:11,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:11,182::task::1191::Storage.TaskManager.Task::(prepare) Task=`043d2f84-e2f8-4ea6-add4-12bbc42dccd8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:11,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`043d2f84-e2f8-4ea6-add4-12bbc42dccd8`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:19:11,182::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:19:11,182::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:19:11,183::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:19:11,183::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:19:11,183::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:19:11,184::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:19:11,184::task::993::Storage.TaskManager.Task::(_decref) Task=`043d2f84-e2f8-4ea6-add4-12bbc42dccd8`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:19:11,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`e047625e-f2de-4ae5-a899-00c41f04cb1b`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:11,204::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:19:11,204::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00425155', 'lastCheck': '5.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:19:11,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`e047625e-f2de-4ae5-a899-00c41f04cb1b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00425155', 'lastCheck': '5.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:19:11,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`e047625e-f2de-4ae5-a899-00c41f04cb1b`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:11,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:11,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:11,205::task::993::Storage.TaskManager.Task::(_decref) Task=`e047625e-f2de-4ae5-a899-00c41f04cb1b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:19:11,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:11,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173716 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:13,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:13,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173615 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:15,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:19:15,965::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:15,971::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:15,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:15,981::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:15,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:15,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:15,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:15,997::__init__::225::IOProcess::(_processLogs) (272647) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:16,000::__init__::225::IOProcess::(_processLogs) (272647) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:16,003::__init__::225::IOProcess::(_processLogs) (272647) Building response >Thread-18::DEBUG::2014-07-08 16:19:16,007::__init__::225::IOProcess::(_processLogs) (272647) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:16,010::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:16,012::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:19:16,026::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:19:16,177::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000702864 s, 657 kB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:16,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.07322 s, 14.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:16,274::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:16,283::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:16,290::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:16,297::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:16,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:16,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:16,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:16,324::__init__::225::IOProcess::(_processLogs) DEBUG|(272648) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:16,331::__init__::225::IOProcess::(_processLogs) (272648) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:16,338::__init__::225::IOProcess::(_processLogs) (272648) Building response >Thread-18::DEBUG::2014-07-08 16:19:16,343::__init__::225::IOProcess::(_processLogs) (272648) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:16,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:16,362::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:19:16,391::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:16,399::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:19:16,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:16,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:16,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:16,417::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:16,420::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:16,422::__init__::225::IOProcess::(_processLogs) (272649) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:16,425::__init__::225::IOProcess::(_processLogs) (272649) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:16,429::__init__::225::IOProcess::(_processLogs) DEBUG|(272649) Building response >Thread-18::DEBUG::2014-07-08 16:19:16,432::__init__::225::IOProcess::(_processLogs) (272649) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:16,435::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:16,439::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:16,449::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:16,451::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:19:16,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:16,456::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:16,459::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:16,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:16,465::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:16,468::__init__::225::IOProcess::(_processLogs) (272650) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:16,470::__init__::225::IOProcess::(_processLogs) (272650) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:16,472::__init__::225::IOProcess::(_processLogs) (272650) Building response >Thread-18::DEBUG::2014-07-08 16:19:16,474::__init__::225::IOProcess::(_processLogs) (272650) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:16,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:16,479::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:16,491::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:16,493::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:19:16,495::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:16,498::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:16,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:16,503::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:16,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:16,507::__init__::225::IOProcess::(_processLogs) (272651) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:16,509::__init__::225::IOProcess::(_processLogs) (272651) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:16,512::__init__::225::IOProcess::(_processLogs) (272651) Building response >Thread-18::DEBUG::2014-07-08 16:19:16,515::__init__::225::IOProcess::(_processLogs) (272651) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:16,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:16,520::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:19:18,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:18,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177795 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:20,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:21,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176412 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:19:21,207::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:19:21,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0196429-638b-4493-bade-0285187a8e0e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:21,209::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:19:21,224::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:21,224::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0196429-638b-4493-bade-0285187a8e0e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:21,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0196429-638b-4493-bade-0285187a8e0e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:21,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:21,225::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:21,226::task::993::Storage.TaskManager.Task::(_decref) Task=`a0196429-638b-4493-bade-0285187a8e0e`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:19:21,237::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:19:21,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`d28eefe0-a31e-41cc-8f02-98c5e3adad08`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:19:21,238::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:19:21,239::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8207f03f-9f54-4ef2-81ea-c538b5ee8deb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:19:21,239::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:19:21,240::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:19:21,240::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8207f03f-9f54-4ef2-81ea-c538b5ee8deb`::Granted request >Thread-6940::DEBUG::2014-07-08 16:19:21,241::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d28eefe0-a31e-41cc-8f02-98c5e3adad08`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:19:21,241::task::993::Storage.TaskManager.Task::(_decref) Task=`d28eefe0-a31e-41cc-8f02-98c5e3adad08`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:19:21,261::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:21,261::task::1191::Storage.TaskManager.Task::(prepare) Task=`d28eefe0-a31e-41cc-8f02-98c5e3adad08`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:21,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`d28eefe0-a31e-41cc-8f02-98c5e3adad08`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:19:21,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:19:21,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:19:21,263::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:19:21,263::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:19:21,263::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:19:21,263::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:19:21,264::task::993::Storage.TaskManager.Task::(_decref) Task=`d28eefe0-a31e-41cc-8f02-98c5e3adad08`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:19:23,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:23,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.023789 s, 43.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:25,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:25,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017597 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:19:26,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a7d7bea-5f35-4208-82fb-210eaf72912d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:26,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:19:26,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702864', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:19:26,369::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a7d7bea-5f35-4208-82fb-210eaf72912d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702864', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:19:26,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a7d7bea-5f35-4208-82fb-210eaf72912d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:26,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:26,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:26,370::task::993::Storage.TaskManager.Task::(_decref) Task=`1a7d7bea-5f35-4208-82fb-210eaf72912d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:19:26,529::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:26,529::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:26,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:26,530::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:26,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:26,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:26,531::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:26,531::__init__::225::IOProcess::(_processLogs) (272652) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:26,531::__init__::225::IOProcess::(_processLogs) (272652) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:26,531::__init__::225::IOProcess::(_processLogs) (272652) Building response >Thread-18::DEBUG::2014-07-08 16:19:26,532::__init__::225::IOProcess::(_processLogs) (272652) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:26,532::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:26,532::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:19:26,534::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:19:26,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000491112 s, 941 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:26,687::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:26,688::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:26,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:26,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:26,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:26,695::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:26,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:26,698::__init__::225::IOProcess::(_processLogs) (272653) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:26,699::__init__::225::IOProcess::(_processLogs) (272653) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:26,701::__init__::225::IOProcess::(_processLogs) (272653) Building response >Thread-18::DEBUG::2014-07-08 16:19:26,702::__init__::225::IOProcess::(_processLogs) (272653) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:26,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:26,705::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:19:26,713::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:26,715::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:19:26,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:26,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:26,719::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:26,720::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:26,722::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:26,723::__init__::225::IOProcess::(_processLogs) (272654) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:26,725::__init__::225::IOProcess::(_processLogs) (272654) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:26,726::__init__::225::IOProcess::(_processLogs) (272654) Building response >Thread-18::DEBUG::2014-07-08 16:19:26,727::__init__::225::IOProcess::(_processLogs) (272654) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:26,729::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:26,730::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:26,735::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:26,736::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:19:26,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:26,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:26,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:26,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:26,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:26,745::__init__::225::IOProcess::(_processLogs) (272655) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:26,747::__init__::225::IOProcess::(_processLogs) (272655) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:26,748::__init__::225::IOProcess::(_processLogs) (272655) Building response >Thread-18::DEBUG::2014-07-08 16:19:26,749::__init__::225::IOProcess::(_processLogs) (272655) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:26,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:26,752::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:26,757::__init__::225::IOProcess::(_processLogs) (272655) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:26,758::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:19:26,759::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:26,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:26,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:26,764::__init__::225::IOProcess::(_processLogs) (272655) Finding callback 'access'...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:26,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:26,766::__init__::225::IOProcess::(_processLogs) (272656) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:26,767::__init__::225::IOProcess::(_processLogs) (272656) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:26,769::__init__::225::IOProcess::(_processLogs) (272656) Building response >Thread-18::DEBUG::2014-07-08 16:19:26,771::__init__::225::IOProcess::(_processLogs) (272656) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:26,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:26,773::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:19:27,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:27,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179471 s, 57.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:30,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:30,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173981 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:19:31,279::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:19:31,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`933cef34-1a26-422c-8ca8-e93a5acf0f6d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:31,281::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:19:31,296::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:31,296::task::1191::Storage.TaskManager.Task::(prepare) Task=`933cef34-1a26-422c-8ca8-e93a5acf0f6d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:31,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`933cef34-1a26-422c-8ca8-e93a5acf0f6d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:31,297::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:31,297::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:31,297::task::993::Storage.TaskManager.Task::(_decref) Task=`933cef34-1a26-422c-8ca8-e93a5acf0f6d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:19:31,308::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:19:31,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`91bb3544-b8d7-4a51-b22c-328e9c4e321f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:19:31,310::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:19:31,311::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bc6180ce-4558-42dc-a4fb-2fe8c711f378`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:19:31,311::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:19:31,311::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:19:31,312::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bc6180ce-4558-42dc-a4fb-2fe8c711f378`::Granted request >Thread-6940::DEBUG::2014-07-08 16:19:31,312::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`91bb3544-b8d7-4a51-b22c-328e9c4e321f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:19:31,313::task::993::Storage.TaskManager.Task::(_decref) Task=`91bb3544-b8d7-4a51-b22c-328e9c4e321f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:19:31,332::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:31,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`91bb3544-b8d7-4a51-b22c-328e9c4e321f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:31,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`91bb3544-b8d7-4a51-b22c-328e9c4e321f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:19:31,333::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:19:31,333::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:19:31,334::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:19:31,334::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:19:31,334::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:19:31,334::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:19:31,335::task::993::Storage.TaskManager.Task::(_decref) Task=`91bb3544-b8d7-4a51-b22c-328e9c4e321f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:19:32,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:32,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175487 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:34,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:34,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0692299 s, 14.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:36,779::__init__::225::IOProcess::(_processLogs) (272655) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:36,779::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:36,781::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:36,781::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:36,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:36,781::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:36,782::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:36,782::__init__::225::IOProcess::(_processLogs) (272657) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:36,782::__init__::225::IOProcess::(_processLogs) (272657) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:36,782::__init__::225::IOProcess::(_processLogs) (272657) Building response >Thread-18::DEBUG::2014-07-08 16:19:36,783::__init__::225::IOProcess::(_processLogs) (272657) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:36,783::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:36,783::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:19:36,785::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:36,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:19:36,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000534692 s, 864 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:37,107::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:37,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:37,121::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:37,129::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:37,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:37,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:37,149::__init__::225::IOProcess::(_processLogs) (272658) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:37,156::__init__::225::IOProcess::(_processLogs) (272658) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:37,164::__init__::225::IOProcess::(_processLogs) (272658) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:37,170::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:37,177::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:19:37,214::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:19:37,223::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:37,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:37,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:37,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:37,237::__init__::225::IOProcess::(_processLogs) (272659) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:37,320::__init__::225::IOProcess::(_processLogs) (272659) Got request for method 'access' >Dummy-6860::DEBUG::2014-07-08 16:19:37,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.142706 s, 7.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:37,323::__init__::225::IOProcess::(_processLogs) (272659) Building response >Thread-18::DEBUG::2014-07-08 16:19:37,325::__init__::225::IOProcess::(_processLogs) (272659) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:37,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:37,330::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:37,339::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:19:37,342::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:37,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:37,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:37,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:37,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:37,365::__init__::225::IOProcess::(_processLogs) (272660) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:37,369::__init__::225::IOProcess::(_processLogs) (272660) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:37,372::__init__::225::IOProcess::(_processLogs) (272660) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:37,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:37,378::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:37,387::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:19:37,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:37,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:37,393::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:37,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:37,397::__init__::225::IOProcess::(_processLogs) (272661) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:37,400::__init__::225::IOProcess::(_processLogs) (272661) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:37,403::__init__::225::IOProcess::(_processLogs) (272661) Building response >Thread-18::DEBUG::2014-07-08 16:19:37,405::__init__::225::IOProcess::(_processLogs) (272661) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:37,408::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:37,411::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:19:39,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:39,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017268 s, 59.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:19:41,349::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:19:41,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`df8850f2-7237-4e2f-8eb4-234a637f68a7`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:41,351::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:19:41,367::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:41,367::task::1191::Storage.TaskManager.Task::(prepare) Task=`df8850f2-7237-4e2f-8eb4-234a637f68a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:41,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`df8850f2-7237-4e2f-8eb4-234a637f68a7`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:41,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:41,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:41,368::task::993::Storage.TaskManager.Task::(_decref) Task=`df8850f2-7237-4e2f-8eb4-234a637f68a7`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:19:41,380::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:19:41,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`147a0c60-95a5-4b1d-bba4-d198bca5191b`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:19:41,381::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:19:41,382::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c1b2ae3b-c6f9-4e1f-8836-007e8edf506a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:19:41,382::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:19:41,383::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:19:41,383::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c1b2ae3b-c6f9-4e1f-8836-007e8edf506a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:19:41,384::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`147a0c60-95a5-4b1d-bba4-d198bca5191b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:19:41,384::task::993::Storage.TaskManager.Task::(_decref) Task=`147a0c60-95a5-4b1d-bba4-d198bca5191b`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:19:41,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:41,404::task::1191::Storage.TaskManager.Task::(prepare) Task=`147a0c60-95a5-4b1d-bba4-d198bca5191b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:41,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`147a0c60-95a5-4b1d-bba4-d198bca5191b`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:19:41,404::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:19:41,405::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:19:41,405::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:19:41,405::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:19:41,406::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:19:41,406::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:19:41,406::task::993::Storage.TaskManager.Task::(_decref) Task=`147a0c60-95a5-4b1d-bba4-d198bca5191b`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:19:41,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`52246bed-6264-4a77-aff7-6232f678f1df`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:41,573::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:19:41,574::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534692', 'lastCheck': '4.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:19:41,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`52246bed-6264-4a77-aff7-6232f678f1df`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534692', 'lastCheck': '4.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:19:41,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`52246bed-6264-4a77-aff7-6232f678f1df`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:41,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:41,575::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:41,575::task::993::Storage.TaskManager.Task::(_decref) Task=`52246bed-6264-4a77-aff7-6232f678f1df`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:19:41,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:42,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017844 s, 57.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:44,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:44,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173261 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:46,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:46,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200565 s, 51.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:47,420::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:47,420::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:47,420::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:47,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:47,421::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:47,422::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:47,422::__init__::225::IOProcess::(_processLogs) (272662) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:47,422::__init__::225::IOProcess::(_processLogs) (272662) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:47,422::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(272662) Building response >Thread-18::DEBUG::2014-07-08 16:19:47,423::__init__::225::IOProcess::(_processLogs) (272662) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:47,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:47,423::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:19:47,425::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:19:47,573::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000435519 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:47,575::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:47,575::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:47,575::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:47,576::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:47,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:47,576::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:47,577::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:47,577::__init__::225::IOProcess::(_processLogs) (272663) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:47,577::__init__::225::IOProcess::(_processLogs) (272663) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:47,577::__init__::225::IOProcess::(_processLogs) (272663) Building response >Thread-18::DEBUG::2014-07-08 16:19:47,577::__init__::225::IOProcess::(_processLogs) (272663) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:47,578::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:19:47,578::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:19:47,580::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:47,580::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:19:47,581::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:47,581::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:47,581::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:47,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:47,582::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:47,582::__init__::225::IOProcess::(_processLogs) (272664) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:47,582::__init__::225::IOProcess::(_processLogs) (272664) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:47,582::__init__::225::IOProcess::(_processLogs) (272664) Building response >Thread-18::DEBUG::2014-07-08 16:19:47,583::__init__::225::IOProcess::(_processLogs) (272664) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:47,583::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:47,583::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:47,584::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:47,585::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:19:47,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:47,585::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:47,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:47,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:47,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:47,586::__init__::225::IOProcess::(_processLogs) (272665) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:47,586::__init__::225::IOProcess::(_processLogs) (272665) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:47,587::__init__::225::IOProcess::(_processLogs) (272665) Building response >Thread-18::DEBUG::2014-07-08 16:19:47,587::__init__::225::IOProcess::(_processLogs) (272665) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:47,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:47,587::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:47,588::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:47,589::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:19:47,589::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:47,589::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:47,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:47,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:47,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:47,590::__init__::225::IOProcess::(_processLogs) (272666) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:47,591::__init__::225::IOProcess::(_processLogs) (272666) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:47,591::__init__::225::IOProcess::(_processLogs) (272666) Building response >Thread-18::DEBUG::2014-07-08 16:19:47,591::__init__::225::IOProcess::(_processLogs) (272666) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:47,591::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:47,591::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:19:48,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:48,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175093 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:50,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:51,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175353 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:19:51,420::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:19:51,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`48efbb59-4d2a-4a5d-80fd-3416f846a138`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:51,422::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:19:51,436::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:51,437::task::1191::Storage.TaskManager.Task::(prepare) Task=`48efbb59-4d2a-4a5d-80fd-3416f846a138`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:19:51,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`48efbb59-4d2a-4a5d-80fd-3416f846a138`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:51,437::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:51,438::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:51,438::task::993::Storage.TaskManager.Task::(_decref) Task=`48efbb59-4d2a-4a5d-80fd-3416f846a138`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:19:51,449::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:19:51,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`febeb791-078c-4ff6-bfa9-ebc1cc88ef41`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:19:51,451::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:19:51,452::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`90f4edf3-9a9e-4a4e-b713-ed09c1c28263`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:19:51,452::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:19:51,452::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:19:51,453::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`90f4edf3-9a9e-4a4e-b713-ed09c1c28263`::Granted request >Thread-6940::DEBUG::2014-07-08 16:19:51,453::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`febeb791-078c-4ff6-bfa9-ebc1cc88ef41`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:19:51,454::task::993::Storage.TaskManager.Task::(_decref) Task=`febeb791-078c-4ff6-bfa9-ebc1cc88ef41`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:19:51,473::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:51,473::task::1191::Storage.TaskManager.Task::(prepare) Task=`febeb791-078c-4ff6-bfa9-ebc1cc88ef41`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:19:51,473::task::595::Storage.TaskManager.Task::(_updateState) Task=`febeb791-078c-4ff6-bfa9-ebc1cc88ef41`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:19:51,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:19:51,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:19:51,474::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:19:51,475::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:19:51,475::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:19:51,475::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:19:51,475::task::993::Storage.TaskManager.Task::(_decref) Task=`febeb791-078c-4ff6-bfa9-ebc1cc88ef41`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:19:53,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:53,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041017 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:19:55,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:19:55,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0216307 s, 47.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:19:56,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`588f2b93-db50-40ef-af19-291838f12233`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:19:56,788::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:19:56,789::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435519', 'lastCheck': '9.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:19:56,789::task::1191::Storage.TaskManager.Task::(prepare) Task=`588f2b93-db50-40ef-af19-291838f12233`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435519', 'lastCheck': '9.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:19:56,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`588f2b93-db50-40ef-af19-291838f12233`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:19:56,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:19:56,790::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:19:56,790::task::993::Storage.TaskManager.Task::(_decref) Task=`588f2b93-db50-40ef-af19-291838f12233`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:19:57,594::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:57,595::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:57,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:57,595::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:57,595::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:57,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:57,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:57,596::__init__::225::IOProcess::(_processLogs) (272667) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:57,596::__init__::225::IOProcess::(_processLogs) (272667) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:57,597::__init__::225::IOProcess::(_processLogs) (272667) Building response >Thread-18::DEBUG::2014-07-08 16:19:57,597::__init__::225::IOProcess::(_processLogs) (272667) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:57,597::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:57,597::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:19:57,599::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:19:57,747::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000505638 s, 914 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:57,754::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:57,756::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:19:57,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:57,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:57,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:57,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:57,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:57,766::__init__::225::IOProcess::(_processLogs) (272668) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:19:57,768::__init__::225::IOProcess::(_processLogs) (272668) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:19:57,770::__init__::225::IOProcess::(_processLogs) DEBUG|(272668) Building response >Thread-18::DEBUG::2014-07-08 16:19:57,771::__init__::225::IOProcess::(_processLogs) (272668) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:57,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:57,774::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:19:57,784::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:57,786::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:19:57,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:57,790::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:57,791::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:57,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:57,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:57,795::__init__::225::IOProcess::(_processLogs) (272669) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:57,797::__init__::225::IOProcess::(_processLogs) (272669) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:57,799::__init__::225::IOProcess::(_processLogs) (272669) Building response >Thread-18::DEBUG::2014-07-08 16:19:57,800::__init__::225::IOProcess::(_processLogs) (272669) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:19:57,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:19:57,804::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:57,954::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:57,971::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:57,976::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:19:57,979::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:57,982::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:57,986::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:57,989::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:19:57,992::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:57,994::__init__::225::IOProcess::(_processLogs) (272670) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:57,997::__init__::225::IOProcess::(_processLogs) (272670) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:58,000::__init__::225::IOProcess::(_processLogs) (272670) Building response >Thread-18::DEBUG::2014-07-08 16:19:58,003::__init__::225::IOProcess::(_processLogs) (272670) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:58,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:58,009::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:19:58,018::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:19:58,022::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:19:58,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:19:58,027::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:19:58,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:19:58,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-6860::DEBUG::2014-07-08 16:19:58,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0753308 s, 13.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:19:58,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:19:58,120::__init__::225::IOProcess::(_processLogs) (272671) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:19:58,123::__init__::225::IOProcess::(_processLogs) (272671) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:19:58,127::__init__::225::IOProcess::(_processLogs) DEBUG|(272671) Building response >Thread-18::DEBUG::2014-07-08 16:19:58,129::__init__::225::IOProcess::(_processLogs) (272671) Queuing response >Thread-18::DEBUG::2014-07-08 16:19:58,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:19:58,134::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:20:00,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:00,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175674 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:20:01,490::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:20:01,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a011b4e-c561-4b55-8a86-26188f85de3e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:01,492::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:20:01,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:01,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a011b4e-c561-4b55-8a86-26188f85de3e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:01,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a011b4e-c561-4b55-8a86-26188f85de3e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:01,509::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:01,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:01,509::task::993::Storage.TaskManager.Task::(_decref) Task=`1a011b4e-c561-4b55-8a86-26188f85de3e`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:20:01,522::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:20:01,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`00ad03ce-60e6-443f-9ee9-351fef2e4163`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:20:01,523::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:20:01,524::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0162b4ec-8142-4946-b2f9-7d668cf411ea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:20:01,525::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:20:01,525::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:20:01,526::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0162b4ec-8142-4946-b2f9-7d668cf411ea`::Granted request >Thread-6940::DEBUG::2014-07-08 16:20:01,526::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`00ad03ce-60e6-443f-9ee9-351fef2e4163`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:20:01,527::task::993::Storage.TaskManager.Task::(_decref) Task=`00ad03ce-60e6-443f-9ee9-351fef2e4163`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:20:01,546::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:01,547::task::1191::Storage.TaskManager.Task::(prepare) Task=`00ad03ce-60e6-443f-9ee9-351fef2e4163`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579770880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:01,547::task::595::Storage.TaskManager.Task::(_updateState) Task=`00ad03ce-60e6-443f-9ee9-351fef2e4163`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:20:01,547::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:20:01,547::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:20:01,548::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:20:01,548::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:20:01,548::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:20:01,549::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:20:01,549::task::993::Storage.TaskManager.Task::(_decref) Task=`00ad03ce-60e6-443f-9ee9-351fef2e4163`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:20:02,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:02,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180868 s, 56.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:04,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:05,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172096 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:07,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:07,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174224 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:08,144::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:08,144::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:08,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:08,146::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:08,146::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:08,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:08,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:08,147::__init__::225::IOProcess::(_processLogs) (272672) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:08,147::__init__::225::IOProcess::(_processLogs) (272672) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:08,147::__init__::225::IOProcess::(_processLogs) (272672) Building response >Thread-18::DEBUG::2014-07-08 16:20:08,147::__init__::225::IOProcess::(_processLogs) (272672) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:08,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:08,148::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:20:08,149::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:20:08,299::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000451443 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:08,301::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:08,302::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:08,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:08,302::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:08,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:08,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:08,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:08,303::__init__::225::IOProcess::(_processLogs) (272673) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:08,304::__init__::225::IOProcess::(_processLogs) (272673) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:08,304::__init__::225::IOProcess::(_processLogs) (272673) Building response >Thread-18::DEBUG::2014-07-08 16:20:08,304::__init__::225::IOProcess::(_processLogs) (272673) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:08,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:08,305::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:20:08,307::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:08,307::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:20:08,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:08,308::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:08,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:08,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:08,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:08,309::__init__::225::IOProcess::(_processLogs) (272674) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:08,309::__init__::225::IOProcess::(_processLogs) (272674) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:08,309::__init__::225::IOProcess::(_processLogs) (272674) Building response >Thread-18::DEBUG::2014-07-08 16:20:08,309::__init__::225::IOProcess::(_processLogs) (272674) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:08,309::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:08,310::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:08,311::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:08,311::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:20:08,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:08,312::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:08,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:08,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:08,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:08,313::__init__::225::IOProcess::(_processLogs) (272675) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:08,313::__init__::225::IOProcess::(_processLogs) (272675) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:08,313::__init__::225::IOProcess::(_processLogs) (272675) Building response >Thread-18::DEBUG::2014-07-08 16:20:08,313::__init__::225::IOProcess::(_processLogs) (272675) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:08,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:08,314::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:08,315::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:08,315::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:20:08,315::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:08,316::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:08,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:08,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:08,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:08,317::__init__::225::IOProcess::(_processLogs) (272676) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:08,317::__init__::225::IOProcess::(_processLogs) (272676) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:08,317::__init__::225::IOProcess::(_processLogs) (272676) Building response >Thread-18::DEBUG::2014-07-08 16:20:08,317::__init__::225::IOProcess::(_processLogs) (272676) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:08,318::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:08,318::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:20:09,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:09,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175445 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:20:11,563::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:20:11,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b26b7bc-11e6-4225-8687-91930fb53a57`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:11,565::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:20:11,588::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:11,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b26b7bc-11e6-4225-8687-91930fb53a57`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:11,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b26b7bc-11e6-4225-8687-91930fb53a57`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:11,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:11,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:11,590::task::993::Storage.TaskManager.Task::(_decref) Task=`0b26b7bc-11e6-4225-8687-91930fb53a57`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:20:11,601::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:20:11,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`16478f4a-334c-41ba-8a8a-ba979cc25faf`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:20:11,602::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:20:11,604::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`14ebb639-3036-428e-abc9-b5b0f36fc1b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:20:11,604::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:20:11,604::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:20:11,605::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`14ebb639-3036-428e-abc9-b5b0f36fc1b8`::Granted request >Thread-6940::DEBUG::2014-07-08 16:20:11,605::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`16478f4a-334c-41ba-8a8a-ba979cc25faf`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:20:11,606::task::993::Storage.TaskManager.Task::(_decref) Task=`16478f4a-334c-41ba-8a8a-ba979cc25faf`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:20:11,624::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579738112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:11,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`16478f4a-334c-41ba-8a8a-ba979cc25faf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579738112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:11,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`16478f4a-334c-41ba-8a8a-ba979cc25faf`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:20:11,625::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:20:11,626::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:20:11,626::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:20:11,626::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:20:11,627::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:20:11,627::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:20:11,627::task::993::Storage.TaskManager.Task::(_decref) Task=`16478f4a-334c-41ba-8a8a-ba979cc25faf`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:20:11,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:11,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173797 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:20:11,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`b71f2649-79bf-4269-ae9a-d0653766709a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:11,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:20:11,974::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451443', 'lastCheck': '3.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:20:11,975::task::1191::Storage.TaskManager.Task::(prepare) Task=`b71f2649-79bf-4269-ae9a-d0653766709a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451443', 'lastCheck': '3.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:20:11,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`b71f2649-79bf-4269-ae9a-d0653766709a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:11,976::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:11,977::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:11,978::task::993::Storage.TaskManager.Task::(_decref) Task=`b71f2649-79bf-4269-ae9a-d0653766709a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:20:14,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:14,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171925 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:16,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:16,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181806 s, 56.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:18,321::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:18,321::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:18,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:18,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:18,322::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:18,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:18,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:18,323::__init__::225::IOProcess::(_processLogs) (272677) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:18,323::__init__::225::IOProcess::(_processLogs) (272677) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:18,323::__init__::225::IOProcess::(_processLogs) (272677) Building response >Thread-18::DEBUG::2014-07-08 16:20:18,324::__init__::225::IOProcess::(_processLogs) (272677) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:18,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:18,324::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:20:18,326::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:20:18,480::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000524634 s, 881 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:18,486::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:18,488::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:18,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:18,492::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:18,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:18,496::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:18,498::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:18,499::__init__::225::IOProcess::(_processLogs) (272678) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:18,501::__init__::225::IOProcess::(_processLogs) (272678) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:18,502::__init__::225::IOProcess::(_processLogs) (272678) Building response >Thread-18::DEBUG::2014-07-08 16:20:18,503::__init__::225::IOProcess::(_processLogs) (272678) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:18,505::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:18,506::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:20:18,515::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:20:18,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:18,518::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:18,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:18,521::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:18,522::__init__::225::IOProcess::(_processLogs) (272679) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:18,523::__init__::225::IOProcess::(_processLogs) (272679) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:18,525::__init__::225::IOProcess::(_processLogs) (272679) Building response >Thread-18::DEBUG::2014-07-08 16:20:18,526::__init__::225::IOProcess::(_processLogs) (272679) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:18,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:18,529::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:18,535::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:20:18,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:18,538::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:18,540::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:18,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:18,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:18,544::__init__::225::IOProcess::(_processLogs) (272680) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:18,546::__init__::225::IOProcess::(_processLogs) (272680) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:18,548::__init__::225::IOProcess::(_processLogs) (272680) Building response >Thread-18::DEBUG::2014-07-08 16:20:18,549::__init__::225::IOProcess::(_processLogs) (272680) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:18,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:18,552::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:18,557::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:18,558::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:20:18,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:18,561::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:18,563::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:18,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:18,566::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:18,567::__init__::225::IOProcess::(_processLogs) (272681) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:18,569::__init__::225::IOProcess::(_processLogs) (272681) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:18,571::__init__::225::IOProcess::(_processLogs) (272681) Building response >Thread-18::DEBUG::2014-07-08 16:20:18,572::__init__::225::IOProcess::(_processLogs) (272681) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:18,573::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:18,575::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:20:18,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:18,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174445 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:20,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:21,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176618 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:20:21,641::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:20:21,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`b025f69c-f931-4007-be7b-111cf726eb52`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:21,643::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:20:21,658::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:21,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`b025f69c-f931-4007-be7b-111cf726eb52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:21,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`b025f69c-f931-4007-be7b-111cf726eb52`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:21,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:21,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:21,659::task::993::Storage.TaskManager.Task::(_decref) Task=`b025f69c-f931-4007-be7b-111cf726eb52`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:20:21,673::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:20:21,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`07ced7da-aa63-4cdf-9951-6ac25326e0f4`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:20:21,674::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:20:21,675::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bafa5972-de48-4a5e-843b-bed126771cce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:20:21,675::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:20:21,676::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:20:21,676::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bafa5972-de48-4a5e-843b-bed126771cce`::Granted request >Thread-6940::DEBUG::2014-07-08 16:20:21,677::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`07ced7da-aa63-4cdf-9951-6ac25326e0f4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:20:21,677::task::993::Storage.TaskManager.Task::(_decref) Task=`07ced7da-aa63-4cdf-9951-6ac25326e0f4`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:20:21,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:21,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`07ced7da-aa63-4cdf-9951-6ac25326e0f4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:21,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`07ced7da-aa63-4cdf-9951-6ac25326e0f4`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:20:21,697::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:20:21,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:20:21,698::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:20:21,698::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:20:21,698::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:20:21,698::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:20:21,699::task::993::Storage.TaskManager.Task::(_decref) Task=`07ced7da-aa63-4cdf-9951-6ac25326e0f4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:20:23,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:23,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175113 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:25,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:25,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173769 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:20:27,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ed092ee-f477-4fe8-a2da-0de320281ee7`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:27,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:20:27,198::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524634', 'lastCheck': '8.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:20:27,198::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ed092ee-f477-4fe8-a2da-0de320281ee7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524634', 'lastCheck': '8.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:20:27,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ed092ee-f477-4fe8-a2da-0de320281ee7`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:27,199::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:27,199::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:27,199::task::993::Storage.TaskManager.Task::(_decref) Task=`4ed092ee-f477-4fe8-a2da-0de320281ee7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:20:27,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:27,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182303 s, 56.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:28,581::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:28,581::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:28,582::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:28,582::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:28,582::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:28,582::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:28,583::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:28,583::__init__::225::IOProcess::(_processLogs) (272682) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:28,583::__init__::225::IOProcess::(_processLogs) (272682) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:28,583::__init__::225::IOProcess::(_processLogs) (272682) Building response >Thread-18::DEBUG::2014-07-08 16:20:28,584::__init__::225::IOProcess::(_processLogs) (272682) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:28,584::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:28,584::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:20:28,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:20:28,751::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000546145 s, 846 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:28,758::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:28,760::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:28,762::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:28,763::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:28,765::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:28,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:28,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:28,773::__init__::225::IOProcess::(_processLogs) (272683) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:28,774::__init__::225::IOProcess::(_processLogs) (272683) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:28,776::__init__::225::IOProcess::(_processLogs) DEBUG|(272683) Building response >Thread-18::DEBUG::2014-07-08 16:20:28,777::__init__::225::IOProcess::(_processLogs) (272683) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:28,778::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:28,779::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:20:28,787::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:28,789::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:20:28,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:28,791::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:28,793::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:28,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:28,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:28,796::__init__::225::IOProcess::(_processLogs) (272684) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:28,798::__init__::225::IOProcess::(_processLogs) (272684) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:28,800::__init__::225::IOProcess::(_processLogs) (272684) Building response >Thread-18::DEBUG::2014-07-08 16:20:28,801::__init__::225::IOProcess::(_processLogs) (272684) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:28,802::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:28,804::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:28,810::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:28,811::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:20:28,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:28,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:28,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:28,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:28,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:28,820::__init__::225::IOProcess::(_processLogs) DEBUG|(272685) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:28,822::__init__::225::IOProcess::(_processLogs) (272685) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:28,823::__init__::225::IOProcess::(_processLogs) (272685) Building response >Thread-18::DEBUG::2014-07-08 16:20:28,825::__init__::225::IOProcess::(_processLogs) (272685) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:28,826::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:28,827::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:28,833::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:28,835::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:20:28,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:28,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:28,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:28,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:28,843::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:28,844::__init__::225::IOProcess::(_processLogs) (272686) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:28,846::__init__::225::IOProcess::(_processLogs) (272686) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:28,848::__init__::225::IOProcess::(_processLogs) (272686) Building response >Thread-18::DEBUG::2014-07-08 16:20:28,849::__init__::225::IOProcess::(_processLogs) (272686) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:28,851::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:28,853::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:20:30,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:30,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175152 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:20:31,713::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:20:31,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`b77db2b7-a1bf-48ce-abb1-89a57c1aafbd`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:31,715::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:20:31,730::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:31,730::task::1191::Storage.TaskManager.Task::(prepare) Task=`b77db2b7-a1bf-48ce-abb1-89a57c1aafbd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:31,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`b77db2b7-a1bf-48ce-abb1-89a57c1aafbd`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:31,731::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:31,731::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:31,731::task::993::Storage.TaskManager.Task::(_decref) Task=`b77db2b7-a1bf-48ce-abb1-89a57c1aafbd`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:20:31,749::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:20:31,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`a07869ef-5d75-476a-826f-7fb3448e6dc4`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:20:31,753::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:20:31,754::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9bc7fddf-0e67-459c-8131-b6d5b27af2f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:20:31,755::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:20:31,755::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:20:31,755::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9bc7fddf-0e67-459c-8131-b6d5b27af2f0`::Granted request >Thread-6940::DEBUG::2014-07-08 16:20:31,756::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a07869ef-5d75-476a-826f-7fb3448e6dc4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:20:31,756::task::993::Storage.TaskManager.Task::(_decref) Task=`a07869ef-5d75-476a-826f-7fb3448e6dc4`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:20:31,776::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:31,776::task::1191::Storage.TaskManager.Task::(prepare) Task=`a07869ef-5d75-476a-826f-7fb3448e6dc4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:31,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`a07869ef-5d75-476a-826f-7fb3448e6dc4`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:20:31,777::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:20:31,777::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:20:31,777::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:20:31,778::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:20:31,778::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:20:31,778::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:20:31,778::task::993::Storage.TaskManager.Task::(_decref) Task=`a07869ef-5d75-476a-826f-7fb3448e6dc4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:20:32,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:32,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175116 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:34,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:34,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323865 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:36,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:37,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173789 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:38,859::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:38,859::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:38,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:38,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:38,860::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:38,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:38,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:38,861::__init__::225::IOProcess::(_processLogs) (272687) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:38,861::__init__::225::IOProcess::(_processLogs) (272687) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:38,862::__init__::225::IOProcess::(_processLogs) (272687) Building response >Thread-18::DEBUG::2014-07-08 16:20:38,862::__init__::225::IOProcess::(_processLogs) (272687) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:38,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:38,862::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:20:38,864::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:20:39,013::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000485245 s, 952 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:39,018::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:20:39,020::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:39,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:39,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:39,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:39,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:39,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:39,027::__init__::225::IOProcess::(_processLogs) (272688) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:39,028::__init__::225::IOProcess::(_processLogs) (272688) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:39,029::__init__::225::IOProcess::(_processLogs) (272688) Building response >Thread-18::DEBUG::2014-07-08 16:20:39,031::__init__::225::IOProcess::(_processLogs) (272688) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:39,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:39,034::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:20:39,042::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:20:39,043::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:39,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:39,046::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:39,047::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:39,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:39,050::__init__::225::IOProcess::(_processLogs) (272689) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:39,051::__init__::225::IOProcess::(_processLogs) (272689) Building response >Thread-18::DEBUG::2014-07-08 16:20:39,052::__init__::225::IOProcess::(_processLogs) (272689) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:39,053::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:39,055::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:39,060::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:20:39,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:39,062::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:39,064::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:39,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:39,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:39,072::__init__::225::IOProcess::(_processLogs) (272690) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:39,073::__init__::225::IOProcess::(_processLogs) (272690) Building response >Thread-18::DEBUG::2014-07-08 16:20:39,075::__init__::225::IOProcess::(_processLogs) (272690) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:39,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:39,078::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:39,083::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:20:39,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:39,086::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:39,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:39,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:39,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:39,091::__init__::225::IOProcess::(_processLogs) (272691) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:39,092::__init__::225::IOProcess::(_processLogs) (272691) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:39,093::__init__::225::IOProcess::(_processLogs) (272691) Building response >Thread-18::DEBUG::2014-07-08 16:20:39,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:39,096::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:20:39,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:39,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017333 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:41,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:41,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175959 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:20:41,791::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:20:41,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca6ee80-8059-427b-92f6-89beaae400a7`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:41,793::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:20:41,809::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:41,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ca6ee80-8059-427b-92f6-89beaae400a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:41,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca6ee80-8059-427b-92f6-89beaae400a7`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:41,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:41,811::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:41,811::task::993::Storage.TaskManager.Task::(_decref) Task=`2ca6ee80-8059-427b-92f6-89beaae400a7`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:20:41,827::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:20:41,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7407b2d-24d0-4723-8e21-eeea2e60c2c6`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:20:41,828::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:20:41,829::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c8df6f42-5e2d-4ba0-98b4-64b7acdfcab8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:20:41,829::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:20:41,830::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:20:41,830::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c8df6f42-5e2d-4ba0-98b4-64b7acdfcab8`::Granted request >Thread-6940::DEBUG::2014-07-08 16:20:41,831::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e7407b2d-24d0-4723-8e21-eeea2e60c2c6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:20:41,831::task::993::Storage.TaskManager.Task::(_decref) Task=`e7407b2d-24d0-4723-8e21-eeea2e60c2c6`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:20:41,850::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:41,850::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7407b2d-24d0-4723-8e21-eeea2e60c2c6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:41,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7407b2d-24d0-4723-8e21-eeea2e60c2c6`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:20:41,851::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:20:41,851::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:20:41,852::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:20:41,852::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:20:41,852::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:20:41,852::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:20:41,853::task::993::Storage.TaskManager.Task::(_decref) Task=`e7407b2d-24d0-4723-8e21-eeea2e60c2c6`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:20:42,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`ddb26497-8b6d-426e-ab38-6164f2144f47`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:42,494::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:20:42,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485245', 'lastCheck': '3.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:20:42,501::task::1191::Storage.TaskManager.Task::(prepare) Task=`ddb26497-8b6d-426e-ab38-6164f2144f47`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485245', 'lastCheck': '3.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:20:42,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`ddb26497-8b6d-426e-ab38-6164f2144f47`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:42,502::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:42,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:42,503::task::993::Storage.TaskManager.Task::(_decref) Task=`ddb26497-8b6d-426e-ab38-6164f2144f47`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:20:43,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:43,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211879 s, 48.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:45,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:46,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171984 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:48,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:48,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0443481 s, 23.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:49,101::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:49,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:49,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:49,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:49,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:49,103::__init__::225::IOProcess::(_processLogs) (272692) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:49,103::__init__::225::IOProcess::(_processLogs) (272692) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:49,104::__init__::225::IOProcess::(_processLogs) (272692) Building response >Thread-18::DEBUG::2014-07-08 16:20:49,104::__init__::225::IOProcess::(_processLogs) (272692) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:49,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:49,104::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:20:49,106::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:20:49,258::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000425182 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:49,262::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:49,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:49,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:49,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:49,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:49,267::__init__::225::IOProcess::(_processLogs) (272693) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:49,268::__init__::225::IOProcess::(_processLogs) (272693) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:49,270::__init__::225::IOProcess::(_processLogs) (272693) Building response >Thread-18::DEBUG::2014-07-08 16:20:49,272::__init__::225::IOProcess::(_processLogs) (272693) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:49,273::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:49,275::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:20:49,284::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:20:49,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:49,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:49,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:49,290::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:49,292::__init__::225::IOProcess::(_processLogs) (272694) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:49,293::__init__::225::IOProcess::(_processLogs) (272694) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:49,295::__init__::225::IOProcess::(_processLogs) (272694) Building response >Thread-18::DEBUG::2014-07-08 16:20:49,296::__init__::225::IOProcess::(_processLogs) (272694) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:49,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:49,300::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:49,305::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:20:49,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:49,308::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:49,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:49,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:49,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:49,315::__init__::225::IOProcess::(_processLogs) (272695) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:49,316::__init__::225::IOProcess::(_processLogs) (272695) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:49,318::__init__::225::IOProcess::(_processLogs) (272695) Building response >Thread-18::DEBUG::2014-07-08 16:20:49,319::__init__::225::IOProcess::(_processLogs) (272695) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:49,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:49,322::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:49,327::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:20:49,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:49,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:49,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:49,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:49,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:49,339::__init__::225::IOProcess::(_processLogs) (272696) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:49,341::__init__::225::IOProcess::(_processLogs) (272696) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:49,343::__init__::225::IOProcess::(_processLogs) (272696) Building response >Thread-18::DEBUG::2014-07-08 16:20:49,344::__init__::225::IOProcess::(_processLogs) (272696) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:49,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:49,347::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:20:50,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:50,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176191 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:20:51,865::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:20:51,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee8bfc73-9a08-465d-b5d0-e3634239d3d8`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:51,867::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:20:51,882::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:51,882::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee8bfc73-9a08-465d-b5d0-e3634239d3d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:20:51,883::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee8bfc73-9a08-465d-b5d0-e3634239d3d8`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:51,883::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:51,883::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:51,883::task::993::Storage.TaskManager.Task::(_decref) Task=`ee8bfc73-9a08-465d-b5d0-e3634239d3d8`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:20:51,895::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:20:51,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`554c06c5-7d94-438e-a570-a3efab50a8aa`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:20:51,896::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:20:51,897::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2bf4f0d8-1487-4483-ae09-a5e4b4b260dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:20:51,897::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:20:51,898::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:20:51,898::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2bf4f0d8-1487-4483-ae09-a5e4b4b260dc`::Granted request >Thread-6940::DEBUG::2014-07-08 16:20:51,899::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`554c06c5-7d94-438e-a570-a3efab50a8aa`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:20:51,899::task::993::Storage.TaskManager.Task::(_decref) Task=`554c06c5-7d94-438e-a570-a3efab50a8aa`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:20:51,923::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:51,923::task::1191::Storage.TaskManager.Task::(prepare) Task=`554c06c5-7d94-438e-a570-a3efab50a8aa`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:20:51,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`554c06c5-7d94-438e-a570-a3efab50a8aa`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:20:51,924::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:20:51,924::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:20:51,924::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:20:51,925::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:20:51,925::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:20:51,925::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:20:51,926::task::993::Storage.TaskManager.Task::(_decref) Task=`554c06c5-7d94-438e-a570-a3efab50a8aa`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:20:52,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:53,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0221383 s, 46.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:55,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:55,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175384 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:20:57,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:57,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175778 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:20:57,653::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee665bf9-02db-4c70-8c0a-1cdec9c98534`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:20:57,653::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:20:57,654::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425182', 'lastCheck': '8.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:20:57,654::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee665bf9-02db-4c70-8c0a-1cdec9c98534`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425182', 'lastCheck': '8.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:20:57,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee665bf9-02db-4c70-8c0a-1cdec9c98534`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:20:57,654::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:20:57,655::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:20:57,655::task::993::Storage.TaskManager.Task::(_decref) Task=`ee665bf9-02db-4c70-8c0a-1cdec9c98534`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:20:59,353::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:59,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:59,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:59,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:59,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:59,355::__init__::225::IOProcess::(_processLogs) (272697) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:59,355::__init__::225::IOProcess::(_processLogs) (272697) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:59,356::__init__::225::IOProcess::(_processLogs) (272697) Building response >Thread-18::DEBUG::2014-07-08 16:20:59,356::__init__::225::IOProcess::(_processLogs) (272697) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:59,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:59,356::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:20:59,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:20:59,509::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00539888 s, 85.6 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:20:59,514::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:20:59,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:59,518::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:59,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:59,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:59,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:59,523::__init__::225::IOProcess::(_processLogs) (272698) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:20:59,524::__init__::225::IOProcess::(_processLogs) (272698) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:20:59,525::__init__::225::IOProcess::(_processLogs) (272698) Building response >Thread-18::DEBUG::2014-07-08 16:20:59,527::__init__::225::IOProcess::(_processLogs) (272698) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:59,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:59,530::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:20:59,539::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:20:59,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:59,542::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:59,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:59,546::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:59,547::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:59,549::__init__::225::IOProcess::(_processLogs) (272699) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:59,551::__init__::225::IOProcess::(_processLogs) (272699) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:59,552::__init__::225::IOProcess::(_processLogs) (272699) Building response >Thread-18::DEBUG::2014-07-08 16:20:59,554::__init__::225::IOProcess::(_processLogs) (272699) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:59,555::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:59,561::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:20:59,563::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:59,564::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:20:59,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:59,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:59,570::__init__::225::IOProcess::(_processLogs) (272700) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:59,571::__init__::225::IOProcess::(_processLogs) (272700) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:59,572::__init__::225::IOProcess::(_processLogs) (272700) Building response >Thread-18::DEBUG::2014-07-08 16:20:59,574::__init__::225::IOProcess::(_processLogs) (272700) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:59,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:59,577::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:20:59,581::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:20:59,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:20:59,584::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:20:59,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:20:59,587::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:20:59,588::__init__::225::IOProcess::(_processLogs) (272701) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:20:59,590::__init__::225::IOProcess::(_processLogs) (272701) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:20:59,591::__init__::225::IOProcess::(_processLogs) (272701) Building response >Thread-18::DEBUG::2014-07-08 16:20:59,593::__init__::225::IOProcess::(_processLogs) (272701) Queuing response >Thread-18::DEBUG::2014-07-08 16:20:59,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:20:59,596::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:20:59,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:20:59,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174406 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:01,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:21:02,090::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:21:02,095::task::595::Storage.TaskManager.Task::(_updateState) Task=`b42e3ded-b9e1-4ec8-a590-9f0447d333cd`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:02,097::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:21:02,192::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:21:02,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456393 s, 22.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:21:02,194::task::1191::Storage.TaskManager.Task::(prepare) Task=`b42e3ded-b9e1-4ec8-a590-9f0447d333cd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:02,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`b42e3ded-b9e1-4ec8-a590-9f0447d333cd`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:02,196::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:02,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:02,198::task::993::Storage.TaskManager.Task::(_decref) Task=`b42e3ded-b9e1-4ec8-a590-9f0447d333cd`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:21:02,213::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:21:02,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdb21b68-c1c0-42a7-b7ca-b2346d511f6a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:21:02,216::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:21:02,223::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b396a1b9-aa24-4dc6-9628-9e93a4f54a7f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:21:02,224::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:21:02,226::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:21:02,227::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b396a1b9-aa24-4dc6-9628-9e93a4f54a7f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:21:02,230::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cdb21b68-c1c0-42a7-b7ca-b2346d511f6a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:21:02,231::task::993::Storage.TaskManager.Task::(_decref) Task=`cdb21b68-c1c0-42a7-b7ca-b2346d511f6a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:21:02,259::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:02,260::task::1191::Storage.TaskManager.Task::(prepare) Task=`cdb21b68-c1c0-42a7-b7ca-b2346d511f6a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:02,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdb21b68-c1c0-42a7-b7ca-b2346d511f6a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:21:02,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:21:02,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:21:02,261::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:21:02,261::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:21:02,262::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:21:02,262::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:21:02,262::task::993::Storage.TaskManager.Task::(_decref) Task=`cdb21b68-c1c0-42a7-b7ca-b2346d511f6a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:21:04,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:04,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410125 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:06,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:07,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172339 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:09,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:09,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174174 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:21:09,602::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:09,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:09,603::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:09,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:09,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:09,604::__init__::225::IOProcess::(_processLogs) (272702) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:09,604::__init__::225::IOProcess::(_processLogs) (272702) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:09,604::__init__::225::IOProcess::(_processLogs) (272702) Building response >Thread-18::DEBUG::2014-07-08 16:21:09,605::__init__::225::IOProcess::(_processLogs) (272702) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:09,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:09,605::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:21:09,607::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:21:09,754::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000464851 s, 994 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:21:09,760::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:09,762::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:09,763::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:09,764::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:09,765::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:09,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:09,768::__init__::225::IOProcess::(_processLogs) (272703) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:09,770::__init__::225::IOProcess::(_processLogs) (272703) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:09,771::__init__::225::IOProcess::(_processLogs) (272703) Building response >Thread-18::DEBUG::2014-07-08 16:21:09,773::__init__::225::IOProcess::(_processLogs) (272703) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:09,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:09,775::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:21:09,783::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:21:09,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:09,787::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:09,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:09,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:09,791::__init__::225::IOProcess::(_processLogs) (272704) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:09,792::__init__::225::IOProcess::(_processLogs) (272704) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:09,793::__init__::225::IOProcess::(_processLogs) (272704) Building response >Thread-18::DEBUG::2014-07-08 16:21:09,795::__init__::225::IOProcess::(_processLogs) (272704) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:09,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:09,798::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:09,803::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:21:09,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:09,806::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:09,807::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:09,809::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:09,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:09,812::__init__::225::IOProcess::(_processLogs) (272705) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:09,813::__init__::225::IOProcess::(_processLogs) (272705) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:09,814::__init__::225::IOProcess::(_processLogs) (272705) Building response >Thread-18::DEBUG::2014-07-08 16:21:09,816::__init__::225::IOProcess::(_processLogs) (272705) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:09,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:09,823::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:21:09,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:09,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:09,828::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:09,829::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:09,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:09,833::__init__::225::IOProcess::(_processLogs) (272706) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:09,834::__init__::225::IOProcess::(_processLogs) (272706) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:09,835::__init__::225::IOProcess::(_processLogs) (272706) Building response >Thread-18::DEBUG::2014-07-08 16:21:09,837::__init__::225::IOProcess::(_processLogs) (272706) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:09,839::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:21:11,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:11,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174984 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:21:12,276::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:21:12,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f94e616-dfa5-4082-91df-e52d1e76c463`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:12,278::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:21:12,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:12,294::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f94e616-dfa5-4082-91df-e52d1e76c463`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:12,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f94e616-dfa5-4082-91df-e52d1e76c463`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:12,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:12,294::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:12,295::task::993::Storage.TaskManager.Task::(_decref) Task=`0f94e616-dfa5-4082-91df-e52d1e76c463`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:21:12,305::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:21:12,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`68caf50e-5c8d-41b9-b5ca-f8f448e80c35`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:21:12,307::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:21:12,308::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f9d6ed1d-150d-4f7c-97d8-2a939397e441`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:21:12,308::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:21:12,309::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:21:12,309::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f9d6ed1d-150d-4f7c-97d8-2a939397e441`::Granted request >Thread-6940::DEBUG::2014-07-08 16:21:12,310::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`68caf50e-5c8d-41b9-b5ca-f8f448e80c35`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:21:12,310::task::993::Storage.TaskManager.Task::(_decref) Task=`68caf50e-5c8d-41b9-b5ca-f8f448e80c35`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:21:12,329::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:12,330::task::1191::Storage.TaskManager.Task::(prepare) Task=`68caf50e-5c8d-41b9-b5ca-f8f448e80c35`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:12,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`68caf50e-5c8d-41b9-b5ca-f8f448e80c35`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:21:12,330::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:21:12,330::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:21:12,331::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:21:12,331::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:21:12,331::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:21:12,332::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:21:12,332::task::993::Storage.TaskManager.Task::(_decref) Task=`68caf50e-5c8d-41b9-b5ca-f8f448e80c35`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:21:12,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`27e8d657-e5b8-4bfa-a7b1-c9cfb80a914d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:12,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:21:12,960::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464851', 'lastCheck': '3.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:21:12,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`27e8d657-e5b8-4bfa-a7b1-c9cfb80a914d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464851', 'lastCheck': '3.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:21:12,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`27e8d657-e5b8-4bfa-a7b1-c9cfb80a914d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:12,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:12,961::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:12,962::task::993::Storage.TaskManager.Task::(_decref) Task=`27e8d657-e5b8-4bfa-a7b1-c9cfb80a914d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:21:13,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:13,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172601 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:15,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:16,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174892 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:18,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:18,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177099 s, 57.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:21:19,845::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:19,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:19,846::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:19,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:19,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:19,847::__init__::225::IOProcess::(_processLogs) (272707) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:19,847::__init__::225::IOProcess::(_processLogs) (272707) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:19,847::__init__::225::IOProcess::(_processLogs) (272707) Building response >Thread-18::DEBUG::2014-07-08 16:21:19,847::__init__::225::IOProcess::(_processLogs) (272707) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:19,847::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:19,848::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:21:19,849::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:21:19,997::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000585255 s, 789 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:21:20,002::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:20,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:20,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:20,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:20,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:20,011::__init__::225::IOProcess::(_processLogs) (272708) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:20,012::__init__::225::IOProcess::(_processLogs) (272708) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:20,013::__init__::225::IOProcess::(_processLogs) (272708) Building response >Thread-18::DEBUG::2014-07-08 16:21:20,015::__init__::225::IOProcess::(_processLogs) (272708) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:20,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:20,018::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:21:20,028::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:21:20,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:20,035::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:20,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:20,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:20,040::__init__::225::IOProcess::(_processLogs) (272709) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:20,041::__init__::225::IOProcess::(_processLogs) (272709) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:20,043::__init__::225::IOProcess::(_processLogs) (272709) Building response >Thread-18::DEBUG::2014-07-08 16:21:20,045::__init__::225::IOProcess::(_processLogs) (272709) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:20,046::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:20,048::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:20,053::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:21:20,055::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:20,056::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:20,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:20,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:20,061::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:20,062::__init__::225::IOProcess::(_processLogs) (272710) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:20,063::__init__::225::IOProcess::(_processLogs) (272710) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:20,065::__init__::225::IOProcess::(_processLogs) (272710) Building response >Thread-18::DEBUG::2014-07-08 16:21:20,067::__init__::225::IOProcess::(_processLogs) (272710) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:20,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:20,069::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:20,074::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:21:20,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:20,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:20,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:20,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:20,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:20,093::__init__::225::IOProcess::(_processLogs) (272711) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:20,094::__init__::225::IOProcess::(_processLogs) (272711) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:20,095::__init__::225::IOProcess::(_processLogs) (272711) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:20,097::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:20,098::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:21:20,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:20,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01734 s, 59.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:21:22,345::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:21:22,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`92fba9ea-f9f1-4b49-b8b3-46b5ec2ff3af`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:22,346::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:21:22,361::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:22,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`92fba9ea-f9f1-4b49-b8b3-46b5ec2ff3af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:22,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`92fba9ea-f9f1-4b49-b8b3-46b5ec2ff3af`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:22,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:22,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:22,363::task::993::Storage.TaskManager.Task::(_decref) Task=`92fba9ea-f9f1-4b49-b8b3-46b5ec2ff3af`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:21:22,374::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:21:22,375::task::595::Storage.TaskManager.Task::(_updateState) Task=`5eb02750-85b0-4903-ab53-67e0c4e0f6de`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:21:22,375::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:21:22,376::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cabd8568-e3f3-4c2e-9c8d-09e5ce122670`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:21:22,376::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:21:22,377::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:21:22,377::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cabd8568-e3f3-4c2e-9c8d-09e5ce122670`::Granted request >Thread-6940::DEBUG::2014-07-08 16:21:22,378::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5eb02750-85b0-4903-ab53-67e0c4e0f6de`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:21:22,378::task::993::Storage.TaskManager.Task::(_decref) Task=`5eb02750-85b0-4903-ab53-67e0c4e0f6de`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:21:22,397::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:22,398::task::1191::Storage.TaskManager.Task::(prepare) Task=`5eb02750-85b0-4903-ab53-67e0c4e0f6de`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:22,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`5eb02750-85b0-4903-ab53-67e0c4e0f6de`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:21:22,398::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:21:22,398::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:21:22,399::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:21:22,399::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:21:22,399::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:21:22,400::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:21:22,400::task::993::Storage.TaskManager.Task::(_decref) Task=`5eb02750-85b0-4903-ab53-67e0c4e0f6de`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:21:22,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:22,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017273 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:24,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:25,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174998 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:27,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:27,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175127 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:21:28,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`7898737b-8591-450f-b646-21921f3ae949`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:28,269::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:21:28,270::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585255', 'lastCheck': '8.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:21:28,270::task::1191::Storage.TaskManager.Task::(prepare) Task=`7898737b-8591-450f-b646-21921f3ae949`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585255', 'lastCheck': '8.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:21:28,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`7898737b-8591-450f-b646-21921f3ae949`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:28,270::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:28,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:28,271::task::993::Storage.TaskManager.Task::(_decref) Task=`7898737b-8591-450f-b646-21921f3ae949`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:21:29,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:29,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173272 s, 59.1 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:21:30,103::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:21:30,111::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:21:30,114::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,116::__init__::225::IOProcess::(_processLogs) (272712) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:21:30,116::__init__::225::IOProcess::(_processLogs) (272712) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:21:30,117::__init__::225::IOProcess::(_processLogs) (272712) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,117::__init__::225::IOProcess::(_processLogs) (272712) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,117::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,117::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:21:30,118::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:21:30,119::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:30,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,120::__init__::225::IOProcess::(_processLogs) (272713) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:21:30,121::__init__::225::IOProcess::(_processLogs) (272713) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:21:30,121::__init__::225::IOProcess::(_processLogs) (272713) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,121::__init__::225::IOProcess::(_processLogs) (272713) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,122::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:21:30,123::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:21:30,123::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,124::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:30,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,125::__init__::225::IOProcess::(_processLogs) (272714) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:21:30,125::__init__::225::IOProcess::(_processLogs) (272714) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:21:30,125::__init__::225::IOProcess::(_processLogs) (272714) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,125::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,126::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:21:30,128::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:21:30,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,132::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,135::__init__::225::IOProcess::(_processLogs) (272715) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:21:30,137::__init__::225::IOProcess::(_processLogs) (272715) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:21:30,139::__init__::225::IOProcess::(_processLogs) (272715) Building response >Thread-37::DEBUG::2014-07-08 16:21:30,141::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:21:30,141::__init__::225::IOProcess::(_processLogs) (272715) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,143::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:21:30,144::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:21:30,148::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:30,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,157::__init__::225::IOProcess::(_processLogs) (272716) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:21:30,159::__init__::225::IOProcess::(_processLogs) (272716) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:21:30,160::__init__::225::IOProcess::(_processLogs) (272716) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,161::__init__::225::IOProcess::(_processLogs) (272716) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,164::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:21:30,168::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:21:30,171::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:21:30,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,176::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,179::__init__::225::IOProcess::(_processLogs) (272717) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:21:30,180::__init__::225::IOProcess::(_processLogs) (272717) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:21:30,181::__init__::225::IOProcess::(_processLogs) (272717) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,183::__init__::225::IOProcess::(_processLogs) (272717) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,186::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:21:30,190::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:21:30,193::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:21:30,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,199::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,201::__init__::225::IOProcess::(_processLogs) (272718) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:30,202::__init__::225::IOProcess::(_processLogs) (272718) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:30,204::__init__::225::IOProcess::(_processLogs) (272718) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,205::__init__::225::IOProcess::(_processLogs) (272718) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,207::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,209::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:30,218::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:21:30,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,221::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:30,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,226::__init__::225::IOProcess::(_processLogs) (272719) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:21:30,227::__init__::225::IOProcess::(_processLogs) (272719) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:21:30,229::__init__::225::IOProcess::(_processLogs) (272719) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,230::__init__::225::IOProcess::(_processLogs) (272719) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,232::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,233::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:21:30,236::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:21:30,238::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:21:30,238::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:21:30,241::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:30,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,244::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:30,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,249::__init__::225::IOProcess::(_processLogs) (272720) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:30,251::__init__::225::IOProcess::(_processLogs) (272720) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:30,252::__init__::225::IOProcess::(_processLogs) (272720) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,253::__init__::225::IOProcess::(_processLogs) (272720) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,255::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,256::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:21:30,262::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:21:30,412::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000461778 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:21:30,419::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:30,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:30,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,427::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,429::__init__::225::IOProcess::(_processLogs) (272721) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:30,430::__init__::225::IOProcess::(_processLogs) (272721) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:30,432::__init__::225::IOProcess::(_processLogs) (272721) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,434::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:21:30,443::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:21:30,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,446::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:30,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,449::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,453::__init__::225::IOProcess::(_processLogs) (272722) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:30,454::__init__::225::IOProcess::(_processLogs) (272722) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,456::__init__::225::IOProcess::(_processLogs) (272722) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,457::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,458::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:30,463::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:21:30,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,466::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:30,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,471::__init__::225::IOProcess::(_processLogs) (272723) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:30,473::__init__::225::IOProcess::(_processLogs) (272723) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:30,474::__init__::225::IOProcess::(_processLogs) (272723) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,475::__init__::225::IOProcess::(_processLogs) (272723) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,478::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:30,484::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:21:30,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:30,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:30,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:30,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:30,491::__init__::225::IOProcess::(_processLogs) (272724) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:30,493::__init__::225::IOProcess::(_processLogs) (272724) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:30,494::__init__::225::IOProcess::(_processLogs) (272724) Building response >Thread-18::DEBUG::2014-07-08 16:21:30,496::__init__::225::IOProcess::(_processLogs) (272724) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:30,497::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:30,499::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:21:31,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:32,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177339 s, 57.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:21:32,414::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:21:32,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5ff4c4a-8ecc-4add-a67d-460eae8d27e2`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:32,416::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:21:32,431::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:32,431::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5ff4c4a-8ecc-4add-a67d-460eae8d27e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:32,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5ff4c4a-8ecc-4add-a67d-460eae8d27e2`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:32,432::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:32,432::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:32,432::task::993::Storage.TaskManager.Task::(_decref) Task=`e5ff4c4a-8ecc-4add-a67d-460eae8d27e2`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:21:32,443::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:21:32,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d17a8ac-3a91-461c-8149-256ad47e3e58`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:21:32,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:21:32,446::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`53b4bf3f-dade-4093-b492-71ac1dd49606`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:21:32,446::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:21:32,446::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:21:32,447::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`53b4bf3f-dade-4093-b492-71ac1dd49606`::Granted request >Thread-6940::DEBUG::2014-07-08 16:21:32,447::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1d17a8ac-3a91-461c-8149-256ad47e3e58`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:21:32,448::task::993::Storage.TaskManager.Task::(_decref) Task=`1d17a8ac-3a91-461c-8149-256ad47e3e58`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:21:32,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:32,467::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d17a8ac-3a91-461c-8149-256ad47e3e58`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:32,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d17a8ac-3a91-461c-8149-256ad47e3e58`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:21:32,468::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:21:32,468::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:21:32,468::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:21:32,469::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:21:32,469::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:21:32,469::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:21:32,469::task::993::Storage.TaskManager.Task::(_decref) Task=`1d17a8ac-3a91-461c-8149-256ad47e3e58`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:21:34,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:34,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353304 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:36,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:36,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174663 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:38,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:39,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176378 s, 58.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:21:40,505::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:40,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:40,506::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:40,506::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:40,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:40,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:40,507::__init__::225::IOProcess::(_processLogs) (272725) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:40,507::__init__::225::IOProcess::(_processLogs) (272725) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:40,507::__init__::225::IOProcess::(_processLogs) (272725) Building response >Thread-18::DEBUG::2014-07-08 16:21:40,507::__init__::225::IOProcess::(_processLogs) (272725) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:40,508::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:40,508::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:21:40,510::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:21:40,662::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00549664 s, 84.1 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:21:40,666::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:21:40,666::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:40,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:40,667::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:40,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:40,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:40,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:40,669::__init__::225::IOProcess::(_processLogs) (272726) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:40,669::__init__::225::IOProcess::(_processLogs) (272726) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:40,670::__init__::225::IOProcess::(_processLogs) (272726) Building response >Thread-18::DEBUG::2014-07-08 16:21:40,670::__init__::225::IOProcess::(_processLogs) (272726) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:40,670::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:40,671::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:21:40,678::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:21:40,681::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:21:40,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:40,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:40,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:40,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:40,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:40,690::__init__::225::IOProcess::(_processLogs) (272727) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:40,691::__init__::225::IOProcess::(_processLogs) (272727) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:40,692::__init__::225::IOProcess::(_processLogs) (272727) Building response >Thread-18::DEBUG::2014-07-08 16:21:40,694::__init__::225::IOProcess::(_processLogs) (272727) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:40,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:40,697::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:40,701::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:21:40,702::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:21:40,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:40,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:40,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:40,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:40,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:40,711::__init__::225::IOProcess::(_processLogs) (272728) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:40,713::__init__::225::IOProcess::(_processLogs) (272728) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:40,714::__init__::225::IOProcess::(_processLogs) (272728) Building response >Thread-18::DEBUG::2014-07-08 16:21:40,715::__init__::225::IOProcess::(_processLogs) (272728) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:40,716::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:40,717::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:40,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:21:40,724::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:21:40,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:40,726::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:40,728::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:40,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:40,730::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:40,731::__init__::225::IOProcess::(_processLogs) (272729) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:40,733::__init__::225::IOProcess::(_processLogs) (272729) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:40,734::__init__::225::IOProcess::(_processLogs) (272729) Building response >Thread-18::DEBUG::2014-07-08 16:21:40,735::__init__::225::IOProcess::(_processLogs) (272729) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:40,737::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:40,738::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:21:41,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:41,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340062 s, 30.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:21:42,483::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:21:42,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`e61c3c3c-6f9b-41b6-9152-8f7d266758f6`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:42,485::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:21:42,501::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:42,501::task::1191::Storage.TaskManager.Task::(prepare) Task=`e61c3c3c-6f9b-41b6-9152-8f7d266758f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:42,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`e61c3c3c-6f9b-41b6-9152-8f7d266758f6`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:42,502::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:42,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:42,502::task::993::Storage.TaskManager.Task::(_decref) Task=`e61c3c3c-6f9b-41b6-9152-8f7d266758f6`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:21:42,514::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:21:42,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`08c27843-6740-4533-8de2-fc223dc6ec0f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:21:42,515::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:21:42,516::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`38be6004-ef22-4f44-a2a5-e481d02fb838`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:21:42,516::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:21:42,517::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:21:42,517::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`38be6004-ef22-4f44-a2a5-e481d02fb838`::Granted request >Thread-6940::DEBUG::2014-07-08 16:21:42,518::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`08c27843-6740-4533-8de2-fc223dc6ec0f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:21:42,518::task::993::Storage.TaskManager.Task::(_decref) Task=`08c27843-6740-4533-8de2-fc223dc6ec0f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:21:42,537::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:42,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`08c27843-6740-4533-8de2-fc223dc6ec0f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:42,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`08c27843-6740-4533-8de2-fc223dc6ec0f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:21:42,538::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:21:42,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:21:42,539::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:21:42,539::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:21:42,539::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:21:42,539::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:21:42,540::task::993::Storage.TaskManager.Task::(_decref) Task=`08c27843-6740-4533-8de2-fc223dc6ec0f`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:21:43,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`42938931-6d0f-4008-8106-adb2c7d3b81e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:43,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:21:43,492::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00549664', 'lastCheck': '2.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:21:43,493::task::1191::Storage.TaskManager.Task::(prepare) Task=`42938931-6d0f-4008-8106-adb2c7d3b81e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00549664', 'lastCheck': '2.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:21:43,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`42938931-6d0f-4008-8106-adb2c7d3b81e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:43,493::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:43,493::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:43,493::task::993::Storage.TaskManager.Task::(_decref) Task=`42938931-6d0f-4008-8106-adb2c7d3b81e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:21:43,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:43,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175188 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:45,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:46,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181365 s, 56.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:48,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:48,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174389 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:50,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:50,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182404 s, 56.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:21:50,744::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:21:50,745::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:50,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:50,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:50,745::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:50,746::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:50,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:50,746::__init__::225::IOProcess::(_processLogs) (272730) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:50,746::__init__::225::IOProcess::(_processLogs) (272730) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:50,747::__init__::225::IOProcess::(_processLogs) (272730) Building response >Thread-18::DEBUG::2014-07-08 16:21:50,747::__init__::225::IOProcess::(_processLogs) (272730) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:50,747::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:50,747::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:21:50,749::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:21:50,900::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000830531 s, 556 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:21:50,905::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:21:50,907::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:21:50,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:50,910::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:50,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:50,913::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:50,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:50,916::__init__::225::IOProcess::(_processLogs) (272731) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:21:50,917::__init__::225::IOProcess::(_processLogs) (272731) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:21:50,918::__init__::225::IOProcess::(_processLogs) (272731) Building response >Thread-18::DEBUG::2014-07-08 16:21:50,919::__init__::225::IOProcess::(_processLogs) (272731) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:50,921::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:50,922::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:21:50,930::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:21:50,931::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:21:50,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:50,935::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:50,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:50,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:50,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:50,941::__init__::225::IOProcess::(_processLogs) (272732) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:50,944::__init__::225::IOProcess::(_processLogs) (272732) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:50,945::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272732) Building response >Thread-18::DEBUG::2014-07-08 16:21:50,946::__init__::225::IOProcess::(_processLogs) (272732) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:50,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:50,949::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:50,957::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:21:50,959::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:21:50,961::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:50,963::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:50,964::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:50,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:50,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:50,969::__init__::225::IOProcess::(_processLogs) (272733) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:50,971::__init__::225::IOProcess::(_processLogs) (272733) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:50,973::__init__::225::IOProcess::(_processLogs) (272733) Building response >Thread-18::DEBUG::2014-07-08 16:21:50,974::__init__::225::IOProcess::(_processLogs) (272733) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:50,976::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:50,977::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:21:50,982::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:21:50,984::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:21:50,985::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:21:50,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:21:50,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:21:50,989::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:21:50,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:21:50,992::__init__::225::IOProcess::(_processLogs) (272734) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:21:50,995::__init__::225::IOProcess::(_processLogs) (272734) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:21:50,996::__init__::225::IOProcess::(_processLogs) (272734) Building response >Thread-18::DEBUG::2014-07-08 16:21:50,997::__init__::225::IOProcess::(_processLogs) (272734) Queuing response >Thread-18::DEBUG::2014-07-08 16:21:50,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:21:51,000::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:21:52,553::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:21:52,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6d57ca5-379d-4de2-8d75-4a28330f8c6d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:52,554::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:21:52,569::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:52,570::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6d57ca5-379d-4de2-8d75-4a28330f8c6d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:21:52,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6d57ca5-379d-4de2-8d75-4a28330f8c6d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:52,570::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:52,570::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:52,571::task::993::Storage.TaskManager.Task::(_decref) Task=`a6d57ca5-379d-4de2-8d75-4a28330f8c6d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:21:52,583::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:21:52,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c6ea977-d251-4bde-b942-3614a3b68b61`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:21:52,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:21:52,585::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`68ec0107-4b37-45bf-b89b-3e98a996f93b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:21:52,585::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:21:52,587::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:21:52,588::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`68ec0107-4b37-45bf-b89b-3e98a996f93b`::Granted request >Thread-6940::DEBUG::2014-07-08 16:21:52,589::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8c6ea977-d251-4bde-b942-3614a3b68b61`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:21:52,589::task::993::Storage.TaskManager.Task::(_decref) Task=`8c6ea977-d251-4bde-b942-3614a3b68b61`::ref 1 aborting False >Dummy-6860::DEBUG::2014-07-08 16:21:52,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6940::INFO::2014-07-08 16:21:52,749::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:52,757::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c6ea977-d251-4bde-b942-3614a3b68b61`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:21:52,759::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c6ea977-d251-4bde-b942-3614a3b68b61`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:21:52,760::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:21:52,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:21:52,764::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:21:52,766::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:21:52,767::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:21:52,768::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:21:52,770::task::993::Storage.TaskManager.Task::(_decref) Task=`8c6ea977-d251-4bde-b942-3614a3b68b61`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:21:52,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033416 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:54,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:55,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100852 s, 10.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:21:57,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:57,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174956 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:21:58,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb021369-072c-498c-aead-97512a62fb5a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:21:58,893::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:21:58,894::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830531', 'lastCheck': '7.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:21:58,894::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb021369-072c-498c-aead-97512a62fb5a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830531', 'lastCheck': '7.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:21:58,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb021369-072c-498c-aead-97512a62fb5a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:21:58,895::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:21:58,895::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:21:58,895::task::993::Storage.TaskManager.Task::(_decref) Task=`bb021369-072c-498c-aead-97512a62fb5a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:21:59,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:21:59,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399231 s, 25.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:01,006::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:01,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:01,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:01,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:01,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:01,008::__init__::225::IOProcess::(_processLogs) (272735) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:01,008::__init__::225::IOProcess::(_processLogs) (272735) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:01,008::__init__::225::IOProcess::(_processLogs) (272735) Building response >Thread-18::DEBUG::2014-07-08 16:22:01,008::__init__::225::IOProcess::(_processLogs) (272735) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:01,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:01,009::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:22:01,011::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:22:01,160::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000502565 s, 919 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:01,165::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:01,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:01,168::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:01,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:01,172::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:01,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:01,176::__init__::225::IOProcess::(_processLogs) (272736) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:01,177::__init__::225::IOProcess::(_processLogs) (272736) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:01,178::__init__::225::IOProcess::(_processLogs) (272736) Building response >Thread-18::DEBUG::2014-07-08 16:22:01,180::__init__::225::IOProcess::(_processLogs) (272736) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:01,181::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:01,182::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:22:01,193::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:01,194::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:22:01,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:01,198::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:01,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:01,201::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:01,202::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:01,204::__init__::225::IOProcess::(_processLogs) (272737) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:01,205::__init__::225::IOProcess::(_processLogs) (272737) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:01,207::__init__::225::IOProcess::(_processLogs) DEBUG|(272737) Building response >Thread-18::DEBUG::2014-07-08 16:22:01,209::__init__::225::IOProcess::(_processLogs) (272737) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:01,210::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:01,211::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:01,218::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:01,219::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:22:01,221::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:01,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:01,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:01,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:01,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:01,228::__init__::225::IOProcess::(_processLogs) (272738) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:01,230::__init__::225::IOProcess::(_processLogs) (272738) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:01,231::__init__::225::IOProcess::(_processLogs) (272738) Building response >Thread-18::DEBUG::2014-07-08 16:22:01,233::__init__::225::IOProcess::(_processLogs) (272738) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:01,235::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:01,236::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:01,242::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:01,243::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:22:01,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:01,246::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:01,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:01,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:01,251::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:01,252::__init__::225::IOProcess::(_processLogs) (272739) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:01,254::__init__::225::IOProcess::(_processLogs) (272739) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:01,255::__init__::225::IOProcess::(_processLogs) (272739) Building response >Thread-18::DEBUG::2014-07-08 16:22:01,257::__init__::225::IOProcess::(_processLogs) (272739) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:01,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:01,260::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:22:01,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:02,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174554 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:22:02,789::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:22:02,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a5cb836-2f6e-422b-a669-28e0a1319399`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:22:02,791::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:22:02,806::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:02,806::task::1191::Storage.TaskManager.Task::(prepare) Task=`4a5cb836-2f6e-422b-a669-28e0a1319399`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:02,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a5cb836-2f6e-422b-a669-28e0a1319399`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:22:02,807::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:22:02,807::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:22:02,808::task::993::Storage.TaskManager.Task::(_decref) Task=`4a5cb836-2f6e-422b-a669-28e0a1319399`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:22:02,819::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:22:02,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a81fc67-37d7-4ec4-947c-65fbb86592b5`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:22:02,820::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:22:02,821::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`66314793-361c-4ad3-ba7f-60efc9dc2575`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:22:02,821::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:22:02,822::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:22:02,822::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`66314793-361c-4ad3-ba7f-60efc9dc2575`::Granted request >Thread-6940::DEBUG::2014-07-08 16:22:02,823::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3a81fc67-37d7-4ec4-947c-65fbb86592b5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:22:02,823::task::993::Storage.TaskManager.Task::(_decref) Task=`3a81fc67-37d7-4ec4-947c-65fbb86592b5`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:22:02,843::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:02,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a81fc67-37d7-4ec4-947c-65fbb86592b5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:02,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a81fc67-37d7-4ec4-947c-65fbb86592b5`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:22:02,844::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:22:02,844::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:22:02,845::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:22:02,845::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:22:02,845::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:22:02,845::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:22:02,846::task::993::Storage.TaskManager.Task::(_decref) Task=`3a81fc67-37d7-4ec4-947c-65fbb86592b5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:04,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:04,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363157 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:06,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:06,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175554 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:08,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:09,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017354 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:11,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:22:11,267::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:11,267::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:11,268::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:11,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:11,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:11,272::__init__::225::IOProcess::(_processLogs) (272740) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:11,273::__init__::225::IOProcess::(_processLogs) (272740) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:11,275::__init__::225::IOProcess::(_processLogs) (272740) Building response >Thread-18::DEBUG::2014-07-08 16:22:11,276::__init__::225::IOProcess::(_processLogs) (272740) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:11,278::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:11,279::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:22:11,287::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:22:11,445::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00255836 s, 181 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:11,453::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:11,457::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:11,463::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:11,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:11,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 16:22:11,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.210738 s, 4.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:11,557::__init__::225::IOProcess::(_processLogs) (272741) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:11,561::__init__::225::IOProcess::(_processLogs) (272741) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:11,569::__init__::225::IOProcess::(_processLogs) (272741) Building response >Thread-18::DEBUG::2014-07-08 16:22:11,572::__init__::225::IOProcess::(_processLogs) (272741) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:11,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:11,578::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:22:11,595::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:22:11,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:11,600::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:11,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:11,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:11,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:11,608::__init__::225::IOProcess::(_processLogs) (272742) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:11,610::__init__::225::IOProcess::(_processLogs) (272742) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:11,614::__init__::225::IOProcess::(_processLogs) (272742) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:11,616::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:11,618::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:11,627::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:22:11,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:11,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:11,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:11,634::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:11,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:11,638::__init__::225::IOProcess::(_processLogs) (272743) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:11,640::__init__::225::IOProcess::(_processLogs) (272743) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:11,642::__init__::225::IOProcess::(_processLogs) (272743) Building response >Thread-18::DEBUG::2014-07-08 16:22:11,644::__init__::225::IOProcess::(_processLogs) (272743) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:11,646::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:11,649::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:11,656::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:22:11,659::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:11,662::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:11,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:11,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:11,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:11,671::__init__::225::IOProcess::(_processLogs) (272744) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:11,674::__init__::225::IOProcess::(_processLogs) (272744) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:11,678::__init__::225::IOProcess::(_processLogs) (272744) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:11,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:11,683::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:22:12,859::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:22:12,861::task::595::Storage.TaskManager.Task::(_updateState) Task=`97208c90-4f0c-45ba-99ea-86bec71a5dd5`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:22:12,861::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:22:12,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:12,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`97208c90-4f0c-45ba-99ea-86bec71a5dd5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:12,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`97208c90-4f0c-45ba-99ea-86bec71a5dd5`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:22:12,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:22:12,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:22:12,877::task::993::Storage.TaskManager.Task::(_decref) Task=`97208c90-4f0c-45ba-99ea-86bec71a5dd5`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:22:12,888::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:22:12,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`07243015-4d2c-4b10-9460-943e294ed3d3`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:22:12,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:22:12,890::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3bd2abed-8db1-40ab-a9ee-9346257c9f3b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:22:12,891::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:22:12,891::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:22:12,891::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3bd2abed-8db1-40ab-a9ee-9346257c9f3b`::Granted request >Thread-6940::DEBUG::2014-07-08 16:22:12,892::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`07243015-4d2c-4b10-9460-943e294ed3d3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:22:12,892::task::993::Storage.TaskManager.Task::(_decref) Task=`07243015-4d2c-4b10-9460-943e294ed3d3`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:22:12,911::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:12,912::task::1191::Storage.TaskManager.Task::(prepare) Task=`07243015-4d2c-4b10-9460-943e294ed3d3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:12,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`07243015-4d2c-4b10-9460-943e294ed3d3`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:22:12,912::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:22:12,912::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:22:12,913::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:22:12,913::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:22:12,913::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:22:12,914::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:22:12,914::task::993::Storage.TaskManager.Task::(_decref) Task=`07243015-4d2c-4b10-9460-943e294ed3d3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:13,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:14,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369736 s, 27.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:22:14,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c31c3ff-85cb-4e59-b730-f23d92528f04`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:22:14,271::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:22:14,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255836', 'lastCheck': '2.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:22:14,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c31c3ff-85cb-4e59-b730-f23d92528f04`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255836', 'lastCheck': '2.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:22:14,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c31c3ff-85cb-4e59-b730-f23d92528f04`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:22:14,272::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:22:14,272::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:22:14,272::task::993::Storage.TaskManager.Task::(_decref) Task=`9c31c3ff-85cb-4e59-b730-f23d92528f04`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:16,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:16,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173621 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:18,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:18,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173406 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:20,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:20,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175082 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:21,693::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:21,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:21,694::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:21,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:21,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:21,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:21,695::__init__::225::IOProcess::(_processLogs) (272745) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:21,695::__init__::225::IOProcess::(_processLogs) (272745) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:21,695::__init__::225::IOProcess::(_processLogs) (272745) Building response >Thread-18::DEBUG::2014-07-08 16:22:21,695::__init__::225::IOProcess::(_processLogs) (272745) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:21,696::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:21,696::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:22:21,698::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:22:21,843::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000436078 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:21,845::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:21,846::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:21,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:21,846::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:21,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:21,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:21,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:21,847::__init__::225::IOProcess::(_processLogs) (272746) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:21,847::__init__::225::IOProcess::(_processLogs) (272746) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:21,848::__init__::225::IOProcess::(_processLogs) (272746) Building response >Thread-18::DEBUG::2014-07-08 16:22:21,848::__init__::225::IOProcess::(_processLogs) (272746) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:21,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:21,848::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:22:21,851::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:21,851::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:22:21,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:21,851::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:21,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:21,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:21,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:21,852::__init__::225::IOProcess::(_processLogs) (272747) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:21,853::__init__::225::IOProcess::(_processLogs) (272747) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:21,853::__init__::225::IOProcess::(_processLogs) (272747) Building response >Thread-18::DEBUG::2014-07-08 16:22:21,853::__init__::225::IOProcess::(_processLogs) (272747) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:21,853::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:21,854::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:21,855::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:21,855::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:22:21,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:21,855::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:21,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:21,856::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:21,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:21,856::__init__::225::IOProcess::(_processLogs) (272748) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:21,857::__init__::225::IOProcess::(_processLogs) (272748) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:21,857::__init__::225::IOProcess::(_processLogs) (272748) Building response >Thread-18::DEBUG::2014-07-08 16:22:21,857::__init__::225::IOProcess::(_processLogs) (272748) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:21,857::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:21,858::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:21,859::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:21,859::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:22:21,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:21,863::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:21,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:21,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:21,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:21,870::__init__::225::IOProcess::(_processLogs) (272749) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:21,871::__init__::225::IOProcess::(_processLogs) (272749) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:21,872::__init__::225::IOProcess::(_processLogs) (272749) Building response >Thread-18::DEBUG::2014-07-08 16:22:21,874::__init__::225::IOProcess::(_processLogs) (272749) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:21,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:21,877::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:22:22,927::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:22:22,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`869c73a4-976d-4f0f-9f7c-d0c00584b79f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:22:22,928::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:22:22,943::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:22,943::task::1191::Storage.TaskManager.Task::(prepare) Task=`869c73a4-976d-4f0f-9f7c-d0c00584b79f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:22,944::task::595::Storage.TaskManager.Task::(_updateState) Task=`869c73a4-976d-4f0f-9f7c-d0c00584b79f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:22:22,944::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:22:22,944::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:22:22,944::task::993::Storage.TaskManager.Task::(_decref) Task=`869c73a4-976d-4f0f-9f7c-d0c00584b79f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:22:22,956::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:22:22,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`d97abf9e-3bb2-4d31-99dd-89700d2087ef`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:22:22,957::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:22:22,958::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`064e9339-bc8a-42cf-8723-5c9c27495ff1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:22:22,958::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:22:22,959::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:22:22,959::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`064e9339-bc8a-42cf-8723-5c9c27495ff1`::Granted request >Thread-6940::DEBUG::2014-07-08 16:22:22,959::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d97abf9e-3bb2-4d31-99dd-89700d2087ef`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:22:22,960::task::993::Storage.TaskManager.Task::(_decref) Task=`d97abf9e-3bb2-4d31-99dd-89700d2087ef`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:22:22,979::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:22,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`d97abf9e-3bb2-4d31-99dd-89700d2087ef`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:22,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`d97abf9e-3bb2-4d31-99dd-89700d2087ef`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:22:22,980::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:22:22,981::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:22:22,981::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:22:22,981::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:22:22,981::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:22:22,982::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:22:22,982::task::993::Storage.TaskManager.Task::(_decref) Task=`d97abf9e-3bb2-4d31-99dd-89700d2087ef`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:23,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:23,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174817 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:25,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:25,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173702 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:27,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:27,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017625 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:22:29,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`22d08eea-b09a-4fde-8ed1-7777095ae9d9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:22:29,437::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:22:29,438::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436078', 'lastCheck': '7.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:22:29,438::task::1191::Storage.TaskManager.Task::(prepare) Task=`22d08eea-b09a-4fde-8ed1-7777095ae9d9`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436078', 'lastCheck': '7.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:22:29,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`22d08eea-b09a-4fde-8ed1-7777095ae9d9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:22:29,438::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:22:29,439::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:22:29,439::task::993::Storage.TaskManager.Task::(_decref) Task=`22d08eea-b09a-4fde-8ed1-7777095ae9d9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:29,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:30,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017504 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:31,882::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:31,883::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:31,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:31,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:31,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:31,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:31,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:31,885::__init__::225::IOProcess::(_processLogs) (272750) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:31,885::__init__::225::IOProcess::(_processLogs) (272750) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:31,885::__init__::225::IOProcess::(_processLogs) (272750) Building response >Thread-18::DEBUG::2014-07-08 16:22:31,886::__init__::225::IOProcess::(_processLogs) (272750) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:31,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:31,886::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:22:31,888::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:22:32,038::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000472954 s, 977 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:32,045::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:32,047::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:32,050::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:32,051::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:32,053::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:32,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:32,057::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:32,059::__init__::225::IOProcess::(_processLogs) (272751) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:32,061::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:32,062::__init__::225::IOProcess::(_processLogs) (272751) Building response >Thread-18::DEBUG::2014-07-08 16:22:32,063::__init__::225::IOProcess::(_processLogs) (272751) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:32,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:32,066::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:22:32,075::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:32,076::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:22:32,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:32,079::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:32,081::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:32,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:32,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:32,085::__init__::225::IOProcess::(_processLogs) (272752) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:32,087::__init__::225::IOProcess::(_processLogs) (272752) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:32,088::__init__::225::IOProcess::(_processLogs) (272752) Building response >Thread-18::DEBUG::2014-07-08 16:22:32,090::__init__::225::IOProcess::(_processLogs) (272752) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:32,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:32,092::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:32,098::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:32,099::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:22:32,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:32,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:32,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:32,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:32,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:32,107::__init__::225::IOProcess::(_processLogs) (272753) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:32,109::__init__::225::IOProcess::(_processLogs) (272753) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:32,110::__init__::225::IOProcess::(_processLogs) (272753) Building response >Thread-18::DEBUG::2014-07-08 16:22:32,112::__init__::225::IOProcess::(_processLogs) (272753) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:32,114::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:22:32,115::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:32,120::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:32,121::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:22:32,123::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:32,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:32,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 16:22:32,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:22:32,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:32,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:32,307::__init__::225::IOProcess::(_processLogs) (272754) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:32,313::__init__::225::IOProcess::(_processLogs) (272754) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:32,318::__init__::225::IOProcess::(_processLogs) (272754) Building response >Thread-18::DEBUG::2014-07-08 16:22:32,328::__init__::225::IOProcess::(_processLogs) (272754) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:32,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:32,339::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:22:32,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.118239 s, 8.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:22:32,997::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:22:32,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd3b5f2e-58bc-4034-bc69-6ab00b3494a8`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:22:32,998::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:22:33,013::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:33,014::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd3b5f2e-58bc-4034-bc69-6ab00b3494a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:33,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd3b5f2e-58bc-4034-bc69-6ab00b3494a8`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:22:33,015::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:22:33,015::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:22:33,015::task::993::Storage.TaskManager.Task::(_decref) Task=`bd3b5f2e-58bc-4034-bc69-6ab00b3494a8`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:22:33,026::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:22:33,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e37b0fa-6211-4d96-ad34-91bc7ceda641`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:22:33,027::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:22:33,028::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c5e35ee4-dbde-49a5-a8cf-03fc27eb5ebb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:22:33,029::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:22:33,029::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:22:33,029::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c5e35ee4-dbde-49a5-a8cf-03fc27eb5ebb`::Granted request >Thread-6940::DEBUG::2014-07-08 16:22:33,030::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4e37b0fa-6211-4d96-ad34-91bc7ceda641`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:22:33,030::task::993::Storage.TaskManager.Task::(_decref) Task=`4e37b0fa-6211-4d96-ad34-91bc7ceda641`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:22:33,050::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:33,050::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e37b0fa-6211-4d96-ad34-91bc7ceda641`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:33,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e37b0fa-6211-4d96-ad34-91bc7ceda641`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:22:33,050::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:22:33,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:22:33,051::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:22:33,052::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:22:33,052::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:22:33,052::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:22:33,052::task::993::Storage.TaskManager.Task::(_decref) Task=`4e37b0fa-6211-4d96-ad34-91bc7ceda641`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:34,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:34,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174903 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:36,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:37,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172562 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:39,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:39,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172355 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:41,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:41,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.105196 s, 9.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:42,362::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:42,362::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:42,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:42,363::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:42,363::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:42,363::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:42,363::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:42,364::__init__::225::IOProcess::(_processLogs) (272755) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:42,364::__init__::225::IOProcess::(_processLogs) (272755) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:42,364::__init__::225::IOProcess::(_processLogs) (272755) Building response >Thread-18::DEBUG::2014-07-08 16:22:42,364::__init__::225::IOProcess::(_processLogs) (272755) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:42,365::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:42,365::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:22:42,367::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:22:42,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000511504 s, 903 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:42,518::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:42,519::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:42,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:42,519::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:42,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:42,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:42,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:42,520::__init__::225::IOProcess::(_processLogs) (272756) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:42,521::__init__::225::IOProcess::(_processLogs) (272756) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:42,521::__init__::225::IOProcess::(_processLogs) (272756) Building response >Thread-18::DEBUG::2014-07-08 16:22:42,521::__init__::225::IOProcess::(_processLogs) (272756) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:42,521::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:42,522::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:22:42,524::__init__::225::IOProcess::(_processLogs) (272751) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:42,524::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:22:42,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:42,525::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:42,525::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:42,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:42,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:42,526::__init__::225::IOProcess::(_processLogs) (272757) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:42,526::__init__::225::IOProcess::(_processLogs) (272757) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:42,526::__init__::225::IOProcess::(_processLogs) (272757) Building response >Thread-18::DEBUG::2014-07-08 16:22:42,526::__init__::225::IOProcess::(_processLogs) (272757) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:42,527::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:42,527::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:42,528::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:42,528::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:22:42,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:42,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:42,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:42,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:42,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:42,530::__init__::225::IOProcess::(_processLogs) (272758) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:42,530::__init__::225::IOProcess::(_processLogs) (272758) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:42,530::__init__::225::IOProcess::(_processLogs) (272758) Building response >Thread-18::DEBUG::2014-07-08 16:22:42,531::__init__::225::IOProcess::(_processLogs) (272758) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:42,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:42,531::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:42,532::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:22:42,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:42,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:42,533::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:42,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:42,533::__init__::225::IOProcess::(_processLogs) (272759) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:42,534::__init__::225::IOProcess::(_processLogs) (272759) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:42,534::__init__::225::IOProcess::(_processLogs) (272759) Building response >Thread-18::DEBUG::2014-07-08 16:22:42,534::__init__::225::IOProcess::(_processLogs) (272759) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:42,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:42,535::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:22:43,067::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:22:43,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3c6bcc3-a957-4ce7-833c-0db070e65914`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:22:43,068::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:22:43,084::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:43,084::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3c6bcc3-a957-4ce7-833c-0db070e65914`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:43,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3c6bcc3-a957-4ce7-833c-0db070e65914`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:22:43,085::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:22:43,085::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:22:43,085::task::993::Storage.TaskManager.Task::(_decref) Task=`d3c6bcc3-a957-4ce7-833c-0db070e65914`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:22:43,096::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:22:43,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee870291-0bfc-4597-8528-648dd61629ba`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:22:43,098::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:22:43,099::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`20dc796a-371a-4f58-97d0-5ca249f3bcbe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:22:43,099::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:22:43,099::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:22:43,100::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`20dc796a-371a-4f58-97d0-5ca249f3bcbe`::Granted request >Thread-6940::DEBUG::2014-07-08 16:22:43,100::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ee870291-0bfc-4597-8528-648dd61629ba`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:22:43,101::task::993::Storage.TaskManager.Task::(_decref) Task=`ee870291-0bfc-4597-8528-648dd61629ba`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:22:43,120::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:43,120::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee870291-0bfc-4597-8528-648dd61629ba`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:43,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee870291-0bfc-4597-8528-648dd61629ba`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:22:43,121::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:22:43,121::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:22:43,122::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:22:43,122::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:22:43,122::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:22:43,122::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:22:43,123::task::993::Storage.TaskManager.Task::(_decref) Task=`ee870291-0bfc-4597-8528-648dd61629ba`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:43,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:44,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173182 s, 59.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:22:44,750::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9e9b1a9-c704-4848-a7de-9d8d7c1a13f1`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:22:44,751::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:22:44,751::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511504', 'lastCheck': '2.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:22:44,752::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9e9b1a9-c704-4848-a7de-9d8d7c1a13f1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511504', 'lastCheck': '2.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:22:44,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9e9b1a9-c704-4848-a7de-9d8d7c1a13f1`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:22:44,752::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:22:44,752::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:22:44,753::task::993::Storage.TaskManager.Task::(_decref) Task=`b9e9b1a9-c704-4848-a7de-9d8d7c1a13f1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:46,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:46,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175725 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:48,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:48,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175537 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:22:50,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:50,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176443 s, 58.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:52,538::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:52,539::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:52,539::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:52,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:52,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:52,540::__init__::225::IOProcess::(_processLogs) (272760) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:52,540::__init__::225::IOProcess::(_processLogs) (272760) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:52,540::__init__::225::IOProcess::(_processLogs) (272760) Building response >Thread-18::DEBUG::2014-07-08 16:22:52,540::__init__::225::IOProcess::(_processLogs) (272760) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:52,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:52,541::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:22:52,543::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:22:52,692::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000483289 s, 956 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:22:52,694::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:22:52,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:52,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:52,695::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:52,695::__init__::225::IOProcess::(_processLogs) (272761) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:22:52,696::__init__::225::IOProcess::(_processLogs) (272761) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:22:52,696::__init__::225::IOProcess::(_processLogs) (272761) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:52,696::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:52,696::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:22:52,699::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:22:52,699::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:52,699::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:52,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:52,700::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:52,700::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:52,701::__init__::225::IOProcess::(_processLogs) (272762) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:52,701::__init__::225::IOProcess::(_processLogs) (272762) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:52,701::__init__::225::IOProcess::(_processLogs) DEBUG|(272762) Building response >Thread-18::DEBUG::2014-07-08 16:22:52,701::__init__::225::IOProcess::(_processLogs) (272762) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:52,702::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:52,702::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:52,703::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:52,703::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:22:52,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:52,704::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:52,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:52,705::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:52,705::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:52,705::__init__::225::IOProcess::(_processLogs) (272763) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:52,705::__init__::225::IOProcess::(_processLogs) (272763) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:52,706::__init__::225::IOProcess::(_processLogs) DEBUG|(272763) Building response >Thread-18::DEBUG::2014-07-08 16:22:52,706::__init__::225::IOProcess::(_processLogs) (272763) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:52,706::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:52,706::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:22:52,714::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:22:52,714::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:22:52,714::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:22:52,715::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:22:52,715::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:22:52,715::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:22:52,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:22:52,716::__init__::225::IOProcess::(_processLogs) (272764) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:22:52,716::__init__::225::IOProcess::(_processLogs) (272764) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:22:52,716::__init__::225::IOProcess::(_processLogs) (272764) Building response >Thread-18::DEBUG::2014-07-08 16:22:52,716::__init__::225::IOProcess::(_processLogs) (272764) Queuing response >Thread-18::DEBUG::2014-07-08 16:22:52,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:22:52,717::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:22:56,514::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Dummy-6860::DEBUG::2014-07-08 16:22:56,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:22:56,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf7f2020-6e5c-46db-85d3-6e8265110830`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:22:56,687::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:22:56,710::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:56,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf7f2020-6e5c-46db-85d3-6e8265110830`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:22:56,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf7f2020-6e5c-46db-85d3-6e8265110830`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:22:56,727::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:22:56,731::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:22:56,738::task::993::Storage.TaskManager.Task::(_decref) Task=`cf7f2020-6e5c-46db-85d3-6e8265110830`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:22:56,776::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:22:56,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`3883f41d-623a-4cff-a2a7-e2dd12518481`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:22:56,785::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:22:56,795::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1a574e20-02c8-4fae-b706-36c421993d26`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:22:56,797::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:22:56,801::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:22:56,803::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1a574e20-02c8-4fae-b706-36c421993d26`::Granted request >Thread-6940::DEBUG::2014-07-08 16:22:56,809::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3883f41d-623a-4cff-a2a7-e2dd12518481`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:22:56,811::task::993::Storage.TaskManager.Task::(_decref) Task=`3883f41d-623a-4cff-a2a7-e2dd12518481`::ref 1 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:56,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.145092 s, 7.1 MB/s\n'; <rc> = 0 >Thread-6940::INFO::2014-07-08 16:22:56,941::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:56,943::task::1191::Storage.TaskManager.Task::(prepare) Task=`3883f41d-623a-4cff-a2a7-e2dd12518481`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:22:56,944::task::595::Storage.TaskManager.Task::(_updateState) Task=`3883f41d-623a-4cff-a2a7-e2dd12518481`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:22:56,945::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:22:56,947::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:22:56,950::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:22:56,953::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:22:56,954::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:22:56,955::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:22:56,958::task::993::Storage.TaskManager.Task::(_decref) Task=`3883f41d-623a-4cff-a2a7-e2dd12518481`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:22:59,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:22:59,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174683 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:01,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:01,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177482 s, 57.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:02,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`70ba2c75-ca76-47d4-94b0-c978a9ab1f18`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:02,717::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:23:02,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483289', 'lastCheck': '10.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:23:02,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`70ba2c75-ca76-47d4-94b0-c978a9ab1f18`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483289', 'lastCheck': '10.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:23:02,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`70ba2c75-ca76-47d4-94b0-c978a9ab1f18`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:02,722::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:23:02,723::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:23:02,723::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:23:02,724::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:23:02,725::task::993::Storage.TaskManager.Task::(_decref) Task=`70ba2c75-ca76-47d4-94b0-c978a9ab1f18`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:23:02,726::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:02,727::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:02,729::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:02,732::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:02,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:02,735::__init__::225::IOProcess::(_processLogs) (272765) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:02,737::__init__::225::IOProcess::(_processLogs) (272765) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:02,739::__init__::225::IOProcess::(_processLogs) (272765) Building response >Thread-18::DEBUG::2014-07-08 16:23:02,740::__init__::225::IOProcess::(_processLogs) (272765) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:02,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:02,743::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:23:02,750::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:23:02,904::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00057855 s, 799 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:02,915::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:02,919::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:02,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:02,927::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:02,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:02,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:02,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:02,941::__init__::225::IOProcess::(_processLogs) (272766) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:02,942::__init__::225::IOProcess::(_processLogs) (272766) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:02,943::__init__::225::IOProcess::(_processLogs) (272766) Building response >Thread-18::DEBUG::2014-07-08 16:23:02,944::__init__::225::IOProcess::(_processLogs) (272766) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:02,945::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:02,946::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:23:02,956::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:02,957::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:23:02,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:02,967::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:02,973::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:02,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:02,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:02,977::__init__::225::IOProcess::(_processLogs) (272767) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:02,978::__init__::225::IOProcess::(_processLogs) (272767) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:02,980::__init__::225::IOProcess::(_processLogs) (272767) Building response >Thread-18::DEBUG::2014-07-08 16:23:02,980::__init__::225::IOProcess::(_processLogs) (272767) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:02,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:02,981::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:02,982::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:02,982::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:23:02,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:02,983::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:02,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:02,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:02,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:02,984::__init__::225::IOProcess::(_processLogs) (272768) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:02,984::__init__::225::IOProcess::(_processLogs) (272768) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:02,984::__init__::225::IOProcess::(_processLogs) (272768) Building response >Thread-18::DEBUG::2014-07-08 16:23:02,985::__init__::225::IOProcess::(_processLogs) (272768) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:02,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:02,985::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:02,986::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:02,986::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:23:02,987::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:02,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:02,987::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:02,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:02,988::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:02,988::__init__::225::IOProcess::(_processLogs) (272769) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:02,988::__init__::225::IOProcess::(_processLogs) (272769) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:02,989::__init__::225::IOProcess::(_processLogs) (272769) Building response >Thread-18::DEBUG::2014-07-08 16:23:02,989::__init__::225::IOProcess::(_processLogs) (272769) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:02,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:02,989::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:23:03,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:03,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178378 s, 57.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:05,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:06,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176711 s, 57.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:06,978::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:23:06,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`007578ec-4ff8-4ea7-be55-64d4b300a23f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:06,980::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:23:06,994::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:06,995::task::1191::Storage.TaskManager.Task::(prepare) Task=`007578ec-4ff8-4ea7-be55-64d4b300a23f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:06,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`007578ec-4ff8-4ea7-be55-64d4b300a23f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:06,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:23:06,996::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:23:06,996::task::993::Storage.TaskManager.Task::(_decref) Task=`007578ec-4ff8-4ea7-be55-64d4b300a23f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:23:07,010::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:23:07,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`de9d353e-3139-447b-9ed4-762e07877a76`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:23:07,024::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:23:07,035::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`839ce875-7c7e-4b42-b7ca-654e1c46ea47`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:23:07,037::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:23:07,043::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:23:07,046::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`839ce875-7c7e-4b42-b7ca-654e1c46ea47`::Granted request >Thread-6940::DEBUG::2014-07-08 16:23:07,055::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`de9d353e-3139-447b-9ed4-762e07877a76`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:23:07,057::task::993::Storage.TaskManager.Task::(_decref) Task=`de9d353e-3139-447b-9ed4-762e07877a76`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:23:07,090::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:07,091::task::1191::Storage.TaskManager.Task::(prepare) Task=`de9d353e-3139-447b-9ed4-762e07877a76`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:07,092::task::595::Storage.TaskManager.Task::(_updateState) Task=`de9d353e-3139-447b-9ed4-762e07877a76`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:23:07,093::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:23:07,095::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:23:07,097::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:23:07,098::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:23:07,099::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:23:07,100::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:23:07,103::task::993::Storage.TaskManager.Task::(_decref) Task=`de9d353e-3139-447b-9ed4-762e07877a76`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:23:08,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:08,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173196 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:10,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:10,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173716 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:12,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:12,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896267 s, 11.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:12,994::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:12,995::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:12,996::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:12,997::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:12,998::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:12,999::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:13,000::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:13,002::__init__::225::IOProcess::(_processLogs) (272770) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:13,003::__init__::225::IOProcess::(_processLogs) (272770) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:13,004::__init__::225::IOProcess::(_processLogs) (272770) Building response >Thread-18::DEBUG::2014-07-08 16:23:13,005::__init__::225::IOProcess::(_processLogs) (272770) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:13,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:13,007::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:23:13,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:23:13,165::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000416802 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:13,177::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:13,182::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:13,187::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:13,191::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:13,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:13,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:13,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:13,207::__init__::225::IOProcess::(_processLogs) (272771) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:13,210::__init__::225::IOProcess::(_processLogs) (272771) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:13,213::__init__::225::IOProcess::(_processLogs) (272771) Building response >Thread-18::DEBUG::2014-07-08 16:23:13,216::__init__::225::IOProcess::(_processLogs) (272771) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:13,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:13,223::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:23:13,243::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:13,250::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:23:13,251::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:13,253::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:13,254::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:13,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:13,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:13,258::__init__::225::IOProcess::(_processLogs) (272772) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:13,259::__init__::225::IOProcess::(_processLogs) (272772) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:13,260::__init__::225::IOProcess::(_processLogs) (272772) Building response >Thread-18::DEBUG::2014-07-08 16:23:13,261::__init__::225::IOProcess::(_processLogs) (272772) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:13,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:13,263::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:13,266::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:13,268::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:23:13,269::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:13,271::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:13,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:13,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:13,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:13,274::__init__::225::IOProcess::(_processLogs) (272773) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:13,275::__init__::225::IOProcess::(_processLogs) (272773) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:13,276::__init__::225::IOProcess::(_processLogs) (272773) Building response >Thread-18::DEBUG::2014-07-08 16:23:13,277::__init__::225::IOProcess::(_processLogs) (272773) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:13,278::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:13,279::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:13,282::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:13,284::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:23:13,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:13,286::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:13,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:13,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:13,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:13,291::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:13,292::__init__::225::IOProcess::(_processLogs) (272774) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:13,293::__init__::225::IOProcess::(_processLogs) (272774) Building response >Thread-18::DEBUG::2014-07-08 16:23:13,294::__init__::225::IOProcess::(_processLogs) (272774) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:13,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:13,296::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:23:15,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:15,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172411 s, 59.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:17,125::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:23:17,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ab07c30-360c-4a32-bf25-31ceafb3294f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:17,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:23:17,142::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:17,142::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ab07c30-360c-4a32-bf25-31ceafb3294f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:17,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ab07c30-360c-4a32-bf25-31ceafb3294f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:17,143::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:23:17,143::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:23:17,143::task::993::Storage.TaskManager.Task::(_decref) Task=`1ab07c30-360c-4a32-bf25-31ceafb3294f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:23:17,161::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:23:17,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e5ae610-4c85-493e-82b7-2324d0cbce2d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:23:17,165::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:23:17,168::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a6c95f64-0786-40f9-a328-9d719ceea279`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:23:17,170::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:23:17,172::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:23:17,173::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a6c95f64-0786-40f9-a328-9d719ceea279`::Granted request >Thread-6940::DEBUG::2014-07-08 16:23:17,175::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0e5ae610-4c85-493e-82b7-2324d0cbce2d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:23:17,176::task::993::Storage.TaskManager.Task::(_decref) Task=`0e5ae610-4c85-493e-82b7-2324d0cbce2d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:23:17,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:17,209::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e5ae610-4c85-493e-82b7-2324d0cbce2d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:17,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e5ae610-4c85-493e-82b7-2324d0cbce2d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:23:17,211::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:23:17,212::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:23:17,214::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:23:17,216::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:23:17,217::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:23:17,218::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:23:17,220::task::993::Storage.TaskManager.Task::(_decref) Task=`0e5ae610-4c85-493e-82b7-2324d0cbce2d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:23:17,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:17,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173149 s, 59.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:18,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0b0cd31-a5ed-4f84-8532-528dea57a1b8`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:18,138::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:23:18,139::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416802', 'lastCheck': '4.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:23:18,139::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0b0cd31-a5ed-4f84-8532-528dea57a1b8`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416802', 'lastCheck': '4.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:23:18,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0b0cd31-a5ed-4f84-8532-528dea57a1b8`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:18,140::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:23:18,140::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:23:18,140::task::993::Storage.TaskManager.Task::(_decref) Task=`d0b0cd31-a5ed-4f84-8532-528dea57a1b8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:23:19,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:20,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177342 s, 57.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:22,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:22,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173585 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:23,302::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:23,303::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:23,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:23,303::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:23,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:23,304::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:23,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:23,304::__init__::225::IOProcess::(_processLogs) (272775) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:23,304::__init__::225::IOProcess::(_processLogs) (272775) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:23,305::__init__::225::IOProcess::(_processLogs) (272775) Building response >Thread-18::DEBUG::2014-07-08 16:23:23,305::__init__::225::IOProcess::(_processLogs) (272775) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:23,305::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:23,305::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:23:23,307::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:23:23,462::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00048776 s, 947 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:23,468::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:23,470::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:23,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:23,474::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:23,476::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:23,479::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:23,481::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:23,482::__init__::225::IOProcess::(_processLogs) (272776) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:23,483::__init__::225::IOProcess::(_processLogs) (272776) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:23,484::__init__::225::IOProcess::(_processLogs) (272776) Building response >Thread-18::DEBUG::2014-07-08 16:23:23,485::__init__::225::IOProcess::(_processLogs) (272776) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:23,486::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:23,486::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:23:23,495::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:23,497::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:23:23,499::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:23,510::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:23,514::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:23,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:23,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:23,518::__init__::225::IOProcess::(_processLogs) (272777) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:23,519::__init__::225::IOProcess::(_processLogs) (272777) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:23,521::__init__::225::IOProcess::(_processLogs) (272777) Building response >Thread-18::DEBUG::2014-07-08 16:23:23,522::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'...DEBUG|(272777) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:23,524::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:23,525::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:23,526::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:23,527::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'...DEBUG|Message size is 168 >Thread-18::DEBUG::2014-07-08 16:23:23,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:23,527::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:23,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:23,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:23,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:23,528::__init__::225::IOProcess::(_processLogs) (272778) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:23,528::__init__::225::IOProcess::(_processLogs) (272778) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:23,529::__init__::225::IOProcess::(_processLogs) (272778) Building response >Thread-18::DEBUG::2014-07-08 16:23:23,529::__init__::225::IOProcess::(_processLogs) (272778) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:23,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:23,529::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:23,530::__init__::225::IOProcess::(_processLogs) (272774) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:23,531::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:23:23,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:23,531::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:23,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:23,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:23,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:23,532::__init__::225::IOProcess::(_processLogs) (272779) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:23,532::__init__::225::IOProcess::(_processLogs) (272779) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:23,533::__init__::225::IOProcess::(_processLogs) (272779) Building response >Thread-18::DEBUG::2014-07-08 16:23:23,533::__init__::225::IOProcess::(_processLogs) (272779) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:23,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:23,533::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:23:24,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:24,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173766 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:26,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:26,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177241 s, 57.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:27,239::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:23:27,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`b07c2b4a-f104-493c-8ed1-054a54cb2646`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:27,240::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:23:27,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:27,256::task::1191::Storage.TaskManager.Task::(prepare) Task=`b07c2b4a-f104-493c-8ed1-054a54cb2646`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:27,256::task::595::Storage.TaskManager.Task::(_updateState) Task=`b07c2b4a-f104-493c-8ed1-054a54cb2646`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:27,256::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:23:27,257::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:23:27,257::task::993::Storage.TaskManager.Task::(_decref) Task=`b07c2b4a-f104-493c-8ed1-054a54cb2646`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:23:27,270::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:23:27,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`413b30ad-f836-449b-8218-c4705ec46b06`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:23:27,272::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:23:27,279::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e312be5c-ecf2-45a9-8b29-879914e24166`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:23:27,281::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:23:27,283::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:23:27,285::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e312be5c-ecf2-45a9-8b29-879914e24166`::Granted request >Thread-6940::DEBUG::2014-07-08 16:23:27,287::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`413b30ad-f836-449b-8218-c4705ec46b06`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:23:27,289::task::993::Storage.TaskManager.Task::(_decref) Task=`413b30ad-f836-449b-8218-c4705ec46b06`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:23:27,321::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:27,323::task::1191::Storage.TaskManager.Task::(prepare) Task=`413b30ad-f836-449b-8218-c4705ec46b06`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:27,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`413b30ad-f836-449b-8218-c4705ec46b06`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:23:27,325::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:23:27,326::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:23:27,327::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:23:27,328::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:23:27,329::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:23:27,330::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:23:27,332::task::993::Storage.TaskManager.Task::(_decref) Task=`413b30ad-f836-449b-8218-c4705ec46b06`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:23:28,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:29,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174317 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:31,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:31,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017492 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:33,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f981d6b-465f-4c69-af83-3514de7f326f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:33,359::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:23:33,359::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048776', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:23:33,360::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f981d6b-465f-4c69-af83-3514de7f326f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048776', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:23:33,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f981d6b-465f-4c69-af83-3514de7f326f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:33,360::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:23:33,360::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:23:33,361::task::993::Storage.TaskManager.Task::(_decref) Task=`7f981d6b-465f-4c69-af83-3514de7f326f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:23:33,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:23:33,630::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:33,633::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:33,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:33,721::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:33,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:33,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:33,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:33,756::__init__::225::IOProcess::(_processLogs) (272780) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:33,763::__init__::225::IOProcess::(_processLogs) (272780) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:33,766::__init__::225::IOProcess::(_processLogs) (272780) Building response >Thread-18::DEBUG::2014-07-08 16:23:33,769::__init__::225::IOProcess::(_processLogs) (272780) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:33,775::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:33,778::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:23:33,790::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:23:33,957::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000673533 s, 686 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:33,971::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:33,980::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:33,987::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:33,996::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:34,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:34,011::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:34,017::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:34,020::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272781) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:34,023::__init__::225::IOProcess::(_processLogs) (272781) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:34,106::__init__::225::IOProcess::(_processLogs) (272781) Building response >Dummy-6860::DEBUG::2014-07-08 16:23:34,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.394726 s, 2.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:34,109::__init__::225::IOProcess::(_processLogs) (272781) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:34,112::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:34,114::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:23:34,129::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:34,131::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:23:34,133::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:34,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:34,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:34,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:34,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:34,145::__init__::225::IOProcess::(_processLogs) (272782) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:34,146::__init__::225::IOProcess::(_processLogs) (272782) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:34,149::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272782) Building response >Thread-18::DEBUG::2014-07-08 16:23:34,151::__init__::225::IOProcess::(_processLogs) (272782) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:34,153::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:34,155::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:34,163::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:34,165::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:23:34,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:34,169::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:34,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:34,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:34,176::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:34,178::__init__::225::IOProcess::(_processLogs) (272783) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:34,180::__init__::225::IOProcess::(_processLogs) (272783) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:34,183::__init__::225::IOProcess::(_processLogs) (272783) Building response >Thread-18::DEBUG::2014-07-08 16:23:34,184::__init__::225::IOProcess::(_processLogs) (272783) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:34,187::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:34,189::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:34,197::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:34,200::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:23:34,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:34,205::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:34,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:34,210::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:34,212::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:34,214::__init__::225::IOProcess::(_processLogs) (272784) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:34,216::__init__::225::IOProcess::(_processLogs) (272784) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:34,218::__init__::225::IOProcess::(_processLogs) (272784) Building response >Thread-18::DEBUG::2014-07-08 16:23:34,221::__init__::225::IOProcess::(_processLogs) (272784) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:34,223::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:34,225::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:23:36,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:36,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182625 s, 56.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:37,349::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:23:37,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`c64b773a-3f70-4c56-9128-e38059e6a29a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:37,350::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:23:37,365::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:37,366::task::1191::Storage.TaskManager.Task::(prepare) Task=`c64b773a-3f70-4c56-9128-e38059e6a29a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:37,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`c64b773a-3f70-4c56-9128-e38059e6a29a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:37,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:23:37,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:23:37,367::task::993::Storage.TaskManager.Task::(_decref) Task=`c64b773a-3f70-4c56-9128-e38059e6a29a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:23:37,378::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:23:37,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`4648703f-45f0-4450-b4c5-effa2b07a16c`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:23:37,379::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:23:37,380::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5cf447f9-3eda-41d5-843b-dc37cea36208`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:23:37,380::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:23:37,381::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:23:37,381::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5cf447f9-3eda-41d5-843b-dc37cea36208`::Granted request >Thread-6940::DEBUG::2014-07-08 16:23:37,382::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4648703f-45f0-4450-b4c5-effa2b07a16c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:23:37,382::task::993::Storage.TaskManager.Task::(_decref) Task=`4648703f-45f0-4450-b4c5-effa2b07a16c`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:23:37,412::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:37,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`4648703f-45f0-4450-b4c5-effa2b07a16c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:37,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`4648703f-45f0-4450-b4c5-effa2b07a16c`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:23:37,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:23:37,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:23:37,420::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:23:37,422::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:23:37,423::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:23:37,424::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:23:37,425::task::993::Storage.TaskManager.Task::(_decref) Task=`4648703f-45f0-4450-b4c5-effa2b07a16c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:23:38,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:38,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182457 s, 56.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:40,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:41,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177348 s, 57.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:43,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:43,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017202 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:44,243::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:44,244::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:44,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:44,244::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:44,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:44,245::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:44,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:44,245::__init__::225::IOProcess::(_processLogs) (272785) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:44,246::__init__::225::IOProcess::(_processLogs) (272785) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:44,246::__init__::225::IOProcess::(_processLogs) (272785) Building response >Thread-18::DEBUG::2014-07-08 16:23:44,246::__init__::225::IOProcess::(_processLogs) (272785) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:44,246::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:44,247::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:23:44,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:23:44,399::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000570729 s, 809 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:44,401::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:44,401::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:44,402::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:44,402::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:44,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:44,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:44,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:44,403::__init__::225::IOProcess::(_processLogs) (272786) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:44,403::__init__::225::IOProcess::(_processLogs) (272786) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:44,403::__init__::225::IOProcess::(_processLogs) (272786) Building response >Thread-18::DEBUG::2014-07-08 16:23:44,404::__init__::225::IOProcess::(_processLogs) (272786) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:44,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:44,404::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:23:44,406::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:44,406::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:23:44,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:44,407::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:44,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:44,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:44,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:44,408::__init__::225::IOProcess::(_processLogs) (272787) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:44,408::__init__::225::IOProcess::(_processLogs) (272787) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:44,408::__init__::225::IOProcess::(_processLogs) (272787) Building response >Thread-18::DEBUG::2014-07-08 16:23:44,409::__init__::225::IOProcess::(_processLogs) (272787) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:44,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:44,409::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:44,410::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:44,411::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:23:44,411::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:44,411::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:44,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:44,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:44,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:44,412::__init__::225::IOProcess::(_processLogs) (272788) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:44,412::__init__::225::IOProcess::(_processLogs) (272788) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:44,413::__init__::225::IOProcess::(_processLogs) (272788) Building response >Thread-18::DEBUG::2014-07-08 16:23:44,413::__init__::225::IOProcess::(_processLogs) (272788) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:44,413::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:44,413::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:44,414::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:44,415::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:23:44,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:44,415::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:44,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:44,416::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:44,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:44,416::__init__::225::IOProcess::(_processLogs) (272789) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:44,417::__init__::225::IOProcess::(_processLogs) (272789) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:44,417::__init__::225::IOProcess::(_processLogs) (272789) Building response >Thread-18::DEBUG::2014-07-08 16:23:44,417::__init__::225::IOProcess::(_processLogs) (272789) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:44,417::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:44,417::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:23:45,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:45,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017485 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:47,443::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:23:47,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`25d3bf63-8386-4ccf-9bb1-9114ea5aef80`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:47,444::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:23:47,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:47,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`25d3bf63-8386-4ccf-9bb1-9114ea5aef80`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:47,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`25d3bf63-8386-4ccf-9bb1-9114ea5aef80`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:47,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:23:47,461::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:23:47,462::task::993::Storage.TaskManager.Task::(_decref) Task=`25d3bf63-8386-4ccf-9bb1-9114ea5aef80`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:23:47,473::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:23:47,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f680c5b-7042-4d0e-ba1a-8d62781271b9`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:23:47,474::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:23:47,475::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`17e81a32-bfd8-4f22-b23a-c035c10fa89f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:23:47,475::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:23:47,476::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:23:47,476::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`17e81a32-bfd8-4f22-b23a-c035c10fa89f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:23:47,477::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7f680c5b-7042-4d0e-ba1a-8d62781271b9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:23:47,477::task::993::Storage.TaskManager.Task::(_decref) Task=`7f680c5b-7042-4d0e-ba1a-8d62781271b9`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:23:47,496::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:47,498::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f680c5b-7042-4d0e-ba1a-8d62781271b9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:47,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f680c5b-7042-4d0e-ba1a-8d62781271b9`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:23:47,502::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:23:47,507::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:23:47,514::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:23:47,516::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:23:47,517::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:23:47,517::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:23:47,519::task::993::Storage.TaskManager.Task::(_decref) Task=`7f680c5b-7042-4d0e-ba1a-8d62781271b9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:23:47,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:48,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176169 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:48,750::task::595::Storage.TaskManager.Task::(_updateState) Task=`81342fb2-c1d2-4d0e-9ba6-f65dbf355380`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:48,751::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:23:48,751::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570729', 'lastCheck': '4.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:23:48,751::task::1191::Storage.TaskManager.Task::(prepare) Task=`81342fb2-c1d2-4d0e-9ba6-f65dbf355380`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570729', 'lastCheck': '4.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:23:48,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`81342fb2-c1d2-4d0e-9ba6-f65dbf355380`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:48,752::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:23:48,752::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:23:48,752::task::993::Storage.TaskManager.Task::(_decref) Task=`81342fb2-c1d2-4d0e-9ba6-f65dbf355380`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:23:50,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:50,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332894 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:23:52,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:52,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173604 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:54,420::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:54,421::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:54,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:54,421::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:54,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:54,422::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:54,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:54,422::__init__::225::IOProcess::(_processLogs) (272790) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:54,423::__init__::225::IOProcess::(_processLogs) (272790) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:54,423::__init__::225::IOProcess::(_processLogs) (272790) Building response >Thread-18::DEBUG::2014-07-08 16:23:54,423::__init__::225::IOProcess::(_processLogs) (272790) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:54,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:54,423::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:23:54,425::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:23:54,571::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000457588 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:54,576::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:54,652::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:23:54,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:54,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:54,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:54,658::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:54,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 16:23:54,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:23:54,662::__init__::225::IOProcess::(_processLogs) (272791) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:23:54,819::__init__::225::IOProcess::(_processLogs) (272791) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:23:54,820::__init__::225::IOProcess::(_processLogs) (272791) Building response >Thread-18::DEBUG::2014-07-08 16:23:54,820::__init__::225::IOProcess::(_processLogs) (272791) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:54,821::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:54,821::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:23:54,833::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:23:54,834::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:23:54,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:54,837::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:54,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:54,839::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:54,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:54,842::__init__::225::IOProcess::(_processLogs) (272792) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:54,843::__init__::225::IOProcess::(_processLogs) (272792) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:54,845::__init__::225::IOProcess::(_processLogs) (272792) Building response >Thread-18::DEBUG::2014-07-08 16:23:54,846::__init__::225::IOProcess::(_processLogs) (272792) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:54,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:54,849::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:54,855::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:23:54,856::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:54,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:54,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:54,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:54,861::__init__::225::IOProcess::(_processLogs) (272793) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:54,863::__init__::225::IOProcess::(_processLogs) (272793) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:54,946::__init__::225::IOProcess::(_processLogs) (272793) Building response >Dummy-6860::DEBUG::2014-07-08 16:23:54,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452862 s, 22.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:23:54,951::__init__::225::IOProcess::(_processLogs) (272793) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:54,955::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:54,957::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:23:54,961::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:23:54,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:23:54,963::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:23:54,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:23:54,965::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:23:54,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:23:54,967::__init__::225::IOProcess::(_processLogs) (272794) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:23:54,968::__init__::225::IOProcess::(_processLogs) (272794) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:23:54,969::__init__::225::IOProcess::(_processLogs) (272794) Building response >Thread-18::DEBUG::2014-07-08 16:23:54,970::__init__::225::IOProcess::(_processLogs) (272794) Queuing response >Thread-18::DEBUG::2014-07-08 16:23:54,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:23:54,972::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:23:56,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:57,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173708 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:23:57,536::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:23:57,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac23b534-f5a3-4531-827f-f1682c6173b5`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:23:57,538::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:23:57,553::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:57,554::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac23b534-f5a3-4531-827f-f1682c6173b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:23:57,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac23b534-f5a3-4531-827f-f1682c6173b5`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:23:57,554::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:23:57,555::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:23:57,555::task::993::Storage.TaskManager.Task::(_decref) Task=`ac23b534-f5a3-4531-827f-f1682c6173b5`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:23:57,565::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:23:57,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f39bf52-28bf-488e-bd60-f8455e77bee9`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:23:57,567::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:23:57,568::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3d79bcd4-cf79-4c1a-a7a2-d4d2d992fa7a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:23:57,568::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:23:57,569::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:23:57,569::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3d79bcd4-cf79-4c1a-a7a2-d4d2d992fa7a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:23:57,570::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4f39bf52-28bf-488e-bd60-f8455e77bee9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:23:57,570::task::993::Storage.TaskManager.Task::(_decref) Task=`4f39bf52-28bf-488e-bd60-f8455e77bee9`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:23:57,590::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:57,591::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f39bf52-28bf-488e-bd60-f8455e77bee9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:23:57,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f39bf52-28bf-488e-bd60-f8455e77bee9`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:23:57,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:23:57,594::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:23:57,596::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:23:57,598::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:23:57,599::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:23:57,600::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:23:57,602::task::993::Storage.TaskManager.Task::(_decref) Task=`4f39bf52-28bf-488e-bd60-f8455e77bee9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:23:59,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:23:59,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173484 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:01,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:01,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175585 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:03,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:24:04,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`54d3c9a3-8583-4a48-aab0-c96c13ee2090`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:04,015::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:24:04,019::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457588', 'lastCheck': '9.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:24:04,023::task::1191::Storage.TaskManager.Task::(prepare) Task=`54d3c9a3-8583-4a48-aab0-c96c13ee2090`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457588', 'lastCheck': '9.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:24:04,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`54d3c9a3-8583-4a48-aab0-c96c13ee2090`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:04,027::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:04,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:04,033::task::993::Storage.TaskManager.Task::(_decref) Task=`54d3c9a3-8583-4a48-aab0-c96c13ee2090`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:24:04,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.058835 s, 17.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:04,977::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:04,978::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:04,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:04,978::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:04,978::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:04,979::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:04,979::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:04,979::__init__::225::IOProcess::(_processLogs) (272795) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:04,979::__init__::225::IOProcess::(_processLogs) (272795) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:04,980::__init__::225::IOProcess::(_processLogs) (272795) Building response >Thread-18::DEBUG::2014-07-08 16:24:04,980::__init__::225::IOProcess::(_processLogs) (272795) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:04,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:04,980::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:24:04,982::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:24:05,344::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00703535 s, 65.7 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:05,355::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:05,358::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:05,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:05,359::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:05,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:05,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:05,360::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:05,360::__init__::225::IOProcess::(_processLogs) (272796) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:05,363::__init__::225::IOProcess::(_processLogs) (272796) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:05,364::__init__::225::IOProcess::(_processLogs) (272796) Building response >Thread-18::DEBUG::2014-07-08 16:24:05,364::__init__::225::IOProcess::(_processLogs) (272796) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:05,364::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:05,364::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:24:05,367::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:05,367::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:24:05,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:05,368::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:05,368::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:05,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:05,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:05,369::__init__::225::IOProcess::(_processLogs) (272797) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:05,369::__init__::225::IOProcess::(_processLogs) (272797) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:05,370::__init__::225::IOProcess::(_processLogs) (272797) Building response >Thread-18::DEBUG::2014-07-08 16:24:05,370::__init__::225::IOProcess::(_processLogs) (272797) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:05,370::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:05,370::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:05,372::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:05,372::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:24:05,372::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:05,373::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:05,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:05,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:05,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:05,374::__init__::225::IOProcess::(_processLogs) (272798) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:05,374::__init__::225::IOProcess::(_processLogs) (272798) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:05,374::__init__::225::IOProcess::(_processLogs) (272798) Building response >Thread-18::DEBUG::2014-07-08 16:24:05,374::__init__::225::IOProcess::(_processLogs) (272798) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:05,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:05,375::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:05,376::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:05,376::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:24:05,377::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:05,377::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:05,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:05,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:05,378::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:05,378::__init__::225::IOProcess::(_processLogs) (272799) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:05,378::__init__::225::IOProcess::(_processLogs) (272799) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:05,378::__init__::225::IOProcess::(_processLogs) (272799) Building response >Thread-18::DEBUG::2014-07-08 16:24:05,379::__init__::225::IOProcess::(_processLogs) (272799) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:05,379::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:05,379::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:24:06,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:06,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331813 s, 30.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:24:07,618::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:24:07,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`af0cdfdd-9847-4e22-aee3-f6b08bd8c109`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:07,620::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:24:07,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:07,635::task::1191::Storage.TaskManager.Task::(prepare) Task=`af0cdfdd-9847-4e22-aee3-f6b08bd8c109`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:07,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`af0cdfdd-9847-4e22-aee3-f6b08bd8c109`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:07,636::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:07,636::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:07,636::task::993::Storage.TaskManager.Task::(_decref) Task=`af0cdfdd-9847-4e22-aee3-f6b08bd8c109`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:24:07,647::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:24:07,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`247c1810-6226-4d2a-bcf4-4f459d5914e8`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:24:07,648::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:24:07,649::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0d14e339-6c76-4f9b-9204-2f0c0eb246d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:24:07,650::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:24:07,650::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:24:07,650::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0d14e339-6c76-4f9b-9204-2f0c0eb246d0`::Granted request >Thread-6940::DEBUG::2014-07-08 16:24:07,651::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`247c1810-6226-4d2a-bcf4-4f459d5914e8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:24:07,651::task::993::Storage.TaskManager.Task::(_decref) Task=`247c1810-6226-4d2a-bcf4-4f459d5914e8`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:24:07,670::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:07,671::task::1191::Storage.TaskManager.Task::(prepare) Task=`247c1810-6226-4d2a-bcf4-4f459d5914e8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:07,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`247c1810-6226-4d2a-bcf4-4f459d5914e8`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:24:07,671::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:24:07,672::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:24:07,672::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:24:07,672::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:24:07,673::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:24:07,673::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:24:07,673::task::993::Storage.TaskManager.Task::(_decref) Task=`247c1810-6226-4d2a-bcf4-4f459d5914e8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:24:08,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:08,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174554 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:10,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:11,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200917 s, 51.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:13,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:13,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173347 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:15,382::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:15,383::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:15,383::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:15,384::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:15,384::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:15,384::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:15,384::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:15,385::__init__::225::IOProcess::(_processLogs) (272800) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:15,385::__init__::225::IOProcess::(_processLogs) (272800) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:15,385::__init__::225::IOProcess::(_processLogs) (272800) Building response >Thread-18::DEBUG::2014-07-08 16:24:15,385::__init__::225::IOProcess::(_processLogs) (272800) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:15,386::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:15,386::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:24:15,387::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:15,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:24:15,897::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000464293 s, 995 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:15,913::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:15,917::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:15,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:15,922::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:15,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:15,927::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:15,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:15,932::__init__::225::IOProcess::(_processLogs) (272801) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:15,933::__init__::225::IOProcess::(_processLogs) (272801) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:15,936::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272801) Building response >Thread-18::DEBUG::2014-07-08 16:24:15,937::__init__::225::IOProcess::(_processLogs) (272801) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:15,937::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:15,937::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:24:15,945::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:16,029::__init__::225::IOProcess::(_processLogs) Message size is 164 >Dummy-6860::DEBUG::2014-07-08 16:24:16,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.11918 s, 8.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:16,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:16,032::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:16,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:16,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:16,035::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:16,036::__init__::225::IOProcess::(_processLogs) (272802) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:16,036::__init__::225::IOProcess::(_processLogs) (272802) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:16,037::__init__::225::IOProcess::(_processLogs) (272802) Building response >Thread-18::DEBUG::2014-07-08 16:24:16,038::__init__::225::IOProcess::(_processLogs) (272802) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:16,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:16,040::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:16,043::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:16,045::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:24:16,046::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:16,047::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:16,049::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:16,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:16,051::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:16,052::__init__::225::IOProcess::(_processLogs) (272803) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:16,053::__init__::225::IOProcess::(_processLogs) (272803) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:16,054::__init__::225::IOProcess::(_processLogs) (272803) Building response >Thread-18::DEBUG::2014-07-08 16:24:16,055::__init__::225::IOProcess::(_processLogs) (272803) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:16,056::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:16,057::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:16,060::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:16,061::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:24:16,062::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:16,062::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:16,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:16,063::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:16,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:16,065::__init__::225::IOProcess::(_processLogs) (272804) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:16,066::__init__::225::IOProcess::(_processLogs) (272804) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:16,067::__init__::225::IOProcess::(_processLogs) (272804) Building response >Thread-18::DEBUG::2014-07-08 16:24:16,068::__init__::225::IOProcess::(_processLogs) (272804) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:16,069::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:16,070::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:24:17,686::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:24:17,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3633fa6-1bda-404e-9744-b8d25de09031`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:17,688::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:24:17,703::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:17,703::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3633fa6-1bda-404e-9744-b8d25de09031`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:17,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3633fa6-1bda-404e-9744-b8d25de09031`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:17,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:17,704::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:17,704::task::993::Storage.TaskManager.Task::(_decref) Task=`f3633fa6-1bda-404e-9744-b8d25de09031`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:24:17,716::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:24:17,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f749f89-ff9c-46f3-9f3e-8f5dfb8534fa`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:24:17,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:24:17,718::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b2dd26f7-fec0-451f-b581-b545036b3236`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:24:17,718::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:24:17,719::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:24:17,719::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b2dd26f7-fec0-451f-b581-b545036b3236`::Granted request >Thread-6940::DEBUG::2014-07-08 16:24:17,720::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3f749f89-ff9c-46f3-9f3e-8f5dfb8534fa`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:24:17,720::task::993::Storage.TaskManager.Task::(_decref) Task=`3f749f89-ff9c-46f3-9f3e-8f5dfb8534fa`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:24:17,739::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:17,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f749f89-ff9c-46f3-9f3e-8f5dfb8534fa`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:17,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f749f89-ff9c-46f3-9f3e-8f5dfb8534fa`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:24:17,740::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:24:17,740::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:24:17,740::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:24:17,741::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:24:17,741::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:24:17,741::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:24:17,741::task::993::Storage.TaskManager.Task::(_decref) Task=`3f749f89-ff9c-46f3-9f3e-8f5dfb8534fa`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:24:18,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:18,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173856 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:24:19,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`92a4ee0c-03dd-4aa0-9423-83d96549c4ad`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:19,368::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:24:19,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464293', 'lastCheck': '3.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:24:19,369::task::1191::Storage.TaskManager.Task::(prepare) Task=`92a4ee0c-03dd-4aa0-9423-83d96549c4ad`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464293', 'lastCheck': '3.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:24:19,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`92a4ee0c-03dd-4aa0-9423-83d96549c4ad`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:19,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:19,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:19,370::task::993::Storage.TaskManager.Task::(_decref) Task=`92a4ee0c-03dd-4aa0-9423-83d96549c4ad`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:24:20,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:20,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0224757 s, 45.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:22,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:22,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0223073 s, 45.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:24,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:25,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175568 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:26,076::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:26,076::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:26,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:26,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:26,077::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:26,077::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:26,078::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:26,078::__init__::225::IOProcess::(_processLogs) (272805) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:26,078::__init__::225::IOProcess::(_processLogs) (272805) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:26,079::__init__::225::IOProcess::(_processLogs) (272805) Building response >Thread-18::DEBUG::2014-07-08 16:24:26,079::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272805) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:26,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:26,079::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:24:26,081::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:24:26,230::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000504241 s, 916 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:26,314::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:26,315::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:26,316::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:26,316::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:26,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:26,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:26,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:26,320::__init__::225::IOProcess::(_processLogs) (272806) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:26,320::__init__::225::IOProcess::(_processLogs) (272806) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:26,321::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272806) Building response >Thread-18::DEBUG::2014-07-08 16:24:26,321::__init__::225::IOProcess::(_processLogs) (272806) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:26,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:26,321::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:24:26,325::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:26,325::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:24:26,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:26,326::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:26,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:26,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:26,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:26,327::__init__::225::IOProcess::(_processLogs) (272807) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:26,327::__init__::225::IOProcess::(_processLogs) (272807) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:26,328::__init__::225::IOProcess::(_processLogs) (272807) Building response >Thread-18::DEBUG::2014-07-08 16:24:26,328::__init__::225::IOProcess::(_processLogs) (272807) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:26,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:26,328::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:26,330::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:26,330::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:24:26,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:26,330::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:26,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:26,331::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:26,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:26,331::__init__::225::IOProcess::(_processLogs) (272808) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:26,332::__init__::225::IOProcess::(_processLogs) (272808) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:26,332::__init__::225::IOProcess::(_processLogs) (272808) Building response >Thread-18::DEBUG::2014-07-08 16:24:26,332::__init__::225::IOProcess::(_processLogs) (272808) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:26,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:26,333::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:26,334::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:26,334::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:24:26,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:26,335::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:26,335::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:26,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:26,336::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:26,336::__init__::225::IOProcess::(_processLogs) (272809) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:26,336::__init__::225::IOProcess::(_processLogs) (272809) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:26,336::__init__::225::IOProcess::(_processLogs) (272809) Building response >Thread-18::DEBUG::2014-07-08 16:24:26,337::__init__::225::IOProcess::(_processLogs) (272809) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:26,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:26,337::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:24:27,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:27,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174588 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:24:27,766::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:24:27,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e0f71c7-e17c-4735-9c6d-f99a05f8b53c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:27,768::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:24:27,782::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:27,783::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e0f71c7-e17c-4735-9c6d-f99a05f8b53c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:27,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e0f71c7-e17c-4735-9c6d-f99a05f8b53c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:27,783::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:27,784::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:27,784::task::993::Storage.TaskManager.Task::(_decref) Task=`7e0f71c7-e17c-4735-9c6d-f99a05f8b53c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:24:27,796::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:24:27,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5f75b69-2a0f-4c3c-8112-32e8a3e9030a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:24:27,797::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:24:27,798::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f5e928c6-4cf4-42f5-b6e7-13fc20cc146a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:24:27,799::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:24:27,799::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:24:27,799::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f5e928c6-4cf4-42f5-b6e7-13fc20cc146a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:24:27,800::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c5f75b69-2a0f-4c3c-8112-32e8a3e9030a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:24:27,800::task::993::Storage.TaskManager.Task::(_decref) Task=`c5f75b69-2a0f-4c3c-8112-32e8a3e9030a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:24:27,820::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:27,822::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5f75b69-2a0f-4c3c-8112-32e8a3e9030a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:27,823::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5f75b69-2a0f-4c3c-8112-32e8a3e9030a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:24:27,824::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:24:27,824::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:24:27,826::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:24:27,828::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:24:27,828::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:24:27,829::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:24:27,832::task::993::Storage.TaskManager.Task::(_decref) Task=`c5f75b69-2a0f-4c3c-8112-32e8a3e9030a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:24:29,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:29,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0192218 s, 53.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:31,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:31,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171953 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:34,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:34,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369088 s, 27.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:24:34,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f037a83-9fc4-4242-b2ea-42aeee667b28`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:34,538::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:24:34,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504241', 'lastCheck': '8.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:24:34,541::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f037a83-9fc4-4242-b2ea-42aeee667b28`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504241', 'lastCheck': '8.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:24:34,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f037a83-9fc4-4242-b2ea-42aeee667b28`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:34,544::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:34,545::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:34,546::task::993::Storage.TaskManager.Task::(_decref) Task=`5f037a83-9fc4-4242-b2ea-42aeee667b28`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:24:36,340::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:36,341::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:36,341::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:36,341::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:36,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:36,342::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:36,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:36,342::__init__::225::IOProcess::(_processLogs) (272810) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:36,343::__init__::225::IOProcess::(_processLogs) (272810) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:36,343::__init__::225::IOProcess::(_processLogs) (272810) Building response >Thread-18::DEBUG::2014-07-08 16:24:36,343::__init__::225::IOProcess::(_processLogs) (272810) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:36,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:36,343::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:24:36,345::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:24:36,494::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000463734 s, 996 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:36,496::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:36,496::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:36,497::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:36,497::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:36,497::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:36,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:36,498::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:36,498::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:36,499::__init__::225::IOProcess::(_processLogs) (272811) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:36,499::__init__::225::IOProcess::(_processLogs) (272811) Building response >Thread-18::DEBUG::2014-07-08 16:24:36,500::__init__::225::IOProcess::(_processLogs) (272811) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:24:36,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:24:36,653::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:24:36,659::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:24:36,754::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:36,755::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:24:36,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:36,756::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:36,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:36,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:36,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:36,761::__init__::225::IOProcess::(_processLogs) (272812) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:36,761::__init__::225::IOProcess::(_processLogs) (272812) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:36,762::__init__::225::IOProcess::(_processLogs) (272812) Building response >Thread-18::DEBUG::2014-07-08 16:24:36,762::__init__::225::IOProcess::(_processLogs) (272812) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:36,763::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:36,763::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:36,767::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:36,767::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:24:36,767::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:36,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:36,768::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:36,768::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:36,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:36,769::__init__::225::IOProcess::(_processLogs) (272813) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:36,769::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|(272813) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:36,769::__init__::225::IOProcess::(_processLogs) (272813) Building response >Thread-18::DEBUG::2014-07-08 16:24:36,769::__init__::225::IOProcess::(_processLogs) (272813) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:36,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:36,770::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:36,772::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:36,772::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:24:36,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:36,776::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:36,777::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:36,777::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:36,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:36,778::__init__::225::IOProcess::(_processLogs) (272814) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:36,778::__init__::225::IOProcess::(_processLogs) (272814) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:36,779::__init__::225::IOProcess::(_processLogs) (272814) Building response >Thread-18::DEBUG::2014-07-08 16:24:36,779::__init__::225::IOProcess::(_processLogs) (272814) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:36,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:36,780::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:24:36,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.135487 s, 7.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:24:37,848::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:24:37,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`c13d6d0d-7bfe-4af2-b9bf-6f1b56ada04b`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:37,850::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:24:37,865::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:37,865::task::1191::Storage.TaskManager.Task::(prepare) Task=`c13d6d0d-7bfe-4af2-b9bf-6f1b56ada04b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:37,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`c13d6d0d-7bfe-4af2-b9bf-6f1b56ada04b`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:37,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:37,866::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:37,866::task::993::Storage.TaskManager.Task::(_decref) Task=`c13d6d0d-7bfe-4af2-b9bf-6f1b56ada04b`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:24:37,877::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:24:37,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`13ee1d36-6a7d-4d01-8d8e-e60b0f1f42c6`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:24:37,878::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:24:37,879::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e4259cb1-5d7d-4c70-b83b-3d7ccc0caffc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:24:37,880::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:24:37,880::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:24:37,880::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e4259cb1-5d7d-4c70-b83b-3d7ccc0caffc`::Granted request >Thread-6940::DEBUG::2014-07-08 16:24:37,881::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`13ee1d36-6a7d-4d01-8d8e-e60b0f1f42c6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:24:37,881::task::993::Storage.TaskManager.Task::(_decref) Task=`13ee1d36-6a7d-4d01-8d8e-e60b0f1f42c6`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:24:37,900::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:37,900::task::1191::Storage.TaskManager.Task::(prepare) Task=`13ee1d36-6a7d-4d01-8d8e-e60b0f1f42c6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:37,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`13ee1d36-6a7d-4d01-8d8e-e60b0f1f42c6`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:24:37,901::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:24:37,901::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:24:37,902::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:24:37,902::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:24:37,902::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:24:37,902::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:24:37,903::task::993::Storage.TaskManager.Task::(_decref) Task=`13ee1d36-6a7d-4d01-8d8e-e60b0f1f42c6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:24:38,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:39,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401882 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:41,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:41,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172702 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:43,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:43,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175577 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:45,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:45,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173233 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:46,784::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:46,785::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:46,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:46,785::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:46,786::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:46,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:46,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:46,786::__init__::225::IOProcess::(_processLogs) (272815) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:46,786::__init__::225::IOProcess::(_processLogs) (272815) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:46,787::__init__::225::IOProcess::(_processLogs) (272815) Building response >Thread-18::DEBUG::2014-07-08 16:24:46,787::__init__::225::IOProcess::(_processLogs) (272815) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:46,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:46,787::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:24:46,789::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:24:46,937::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000482451 s, 958 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:46,940::__init__::225::IOProcess::(_processLogs) (272811) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:46,940::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:46,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:46,941::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:46,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:46,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:46,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:46,942::__init__::225::IOProcess::(_processLogs) (272816) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:46,942::__init__::225::IOProcess::(_processLogs) (272816) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:46,942::__init__::225::IOProcess::(_processLogs) (272816) Building response >Thread-18::DEBUG::2014-07-08 16:24:46,942::__init__::225::IOProcess::(_processLogs) (272816) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:46,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:46,943::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:24:46,945::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:46,945::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:24:46,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:46,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:46,946::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:46,947::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:46,947::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:46,947::__init__::225::IOProcess::(_processLogs) (272817) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:46,947::__init__::225::IOProcess::(_processLogs) (272817) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:46,947::__init__::225::IOProcess::(_processLogs) (272817) Building response >Thread-18::DEBUG::2014-07-08 16:24:46,948::__init__::225::IOProcess::(_processLogs) (272817) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:46,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:46,948::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:46,949::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:46,950::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:24:46,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:46,950::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:46,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:46,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:46,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:46,951::__init__::225::IOProcess::(_processLogs) (272818) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:46,951::__init__::225::IOProcess::(_processLogs) (272818) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:46,952::__init__::225::IOProcess::(_processLogs) (272818) Building response >Thread-18::DEBUG::2014-07-08 16:24:46,952::__init__::225::IOProcess::(_processLogs) (272818) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:46,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:46,952::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:46,954::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:46,954::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:24:46,954::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:46,954::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:46,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:46,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:46,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:46,955::__init__::225::IOProcess::(_processLogs) (272819) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:46,956::__init__::225::IOProcess::(_processLogs) (272819) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:46,956::__init__::225::IOProcess::(_processLogs) (272819) Building response >Thread-18::DEBUG::2014-07-08 16:24:46,956::__init__::225::IOProcess::(_processLogs) (272819) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:46,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:46,956::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:24:47,920::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:24:47,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`070d1d80-1d7a-48fe-b1ea-5552221335ee`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:47,922::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:24:47,938::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:47,939::task::1191::Storage.TaskManager.Task::(prepare) Task=`070d1d80-1d7a-48fe-b1ea-5552221335ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:47,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`070d1d80-1d7a-48fe-b1ea-5552221335ee`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:47,939::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:47,939::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:47,940::task::993::Storage.TaskManager.Task::(_decref) Task=`070d1d80-1d7a-48fe-b1ea-5552221335ee`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:24:47,951::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:24:47,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d347518-7b94-4ab8-872a-3f62bc9e7c00`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:24:47,952::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:24:47,957::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8b01e35a-2a6f-43fc-a60c-66df2c7757ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:24:47,958::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:24:47,958::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:24:47,959::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8b01e35a-2a6f-43fc-a60c-66df2c7757ee`::Granted request >Thread-6940::DEBUG::2014-07-08 16:24:47,959::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3d347518-7b94-4ab8-872a-3f62bc9e7c00`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:24:47,960::task::993::Storage.TaskManager.Task::(_decref) Task=`3d347518-7b94-4ab8-872a-3f62bc9e7c00`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:24:47,979::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:47,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d347518-7b94-4ab8-872a-3f62bc9e7c00`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:47,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d347518-7b94-4ab8-872a-3f62bc9e7c00`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:24:47,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:24:47,983::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:24:47,984::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:24:47,986::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:24:47,986::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:24:47,987::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:24:47,989::task::993::Storage.TaskManager.Task::(_decref) Task=`3d347518-7b94-4ab8-872a-3f62bc9e7c00`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:24:48,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:48,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356251 s, 28.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:24:49,750::task::595::Storage.TaskManager.Task::(_updateState) Task=`f37f7cc2-0c94-4e87-bfe6-fb47f8ac615c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:49,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:24:49,751::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482451', 'lastCheck': '2.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:24:49,751::task::1191::Storage.TaskManager.Task::(prepare) Task=`f37f7cc2-0c94-4e87-bfe6-fb47f8ac615c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482451', 'lastCheck': '2.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:24:49,751::task::595::Storage.TaskManager.Task::(_updateState) Task=`f37f7cc2-0c94-4e87-bfe6-fb47f8ac615c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:49,752::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:49,752::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:49,752::task::993::Storage.TaskManager.Task::(_decref) Task=`f37f7cc2-0c94-4e87-bfe6-fb47f8ac615c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:24:50,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:50,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175155 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:52,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:52,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173146 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:24:54,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:55,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173844 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:56,959::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:56,960::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:56,960::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:56,960::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:56,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:56,961::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:56,961::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:56,961::__init__::225::IOProcess::(_processLogs) (272820) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:56,961::__init__::225::IOProcess::(_processLogs) (272820) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:56,962::__init__::225::IOProcess::(_processLogs) (272820) Building response >Thread-18::DEBUG::2014-07-08 16:24:56,962::__init__::225::IOProcess::(_processLogs) (272820) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:56,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:56,962::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:24:56,964::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:24:57,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000486363 s, 950 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:24:57,112::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:57,113::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:24:57,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:57,113::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:57,113::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:57,114::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:57,114::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:57,114::__init__::225::IOProcess::(_processLogs) (272821) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:24:57,115::__init__::225::IOProcess::(_processLogs) (272821) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:24:57,115::__init__::225::IOProcess::(_processLogs) (272821) Building response >Thread-18::DEBUG::2014-07-08 16:24:57,115::__init__::225::IOProcess::(_processLogs) (272821) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:57,116::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:24:57,116::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:24:57,118::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:57,118::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:24:57,119::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:57,119::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:57,119::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:57,119::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:57,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:57,120::__init__::225::IOProcess::(_processLogs) (272822) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:57,120::__init__::225::IOProcess::(_processLogs) (272822) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:57,121::__init__::225::IOProcess::(_processLogs) (272822) Building response >Thread-18::DEBUG::2014-07-08 16:24:57,121::__init__::225::IOProcess::(_processLogs) (272822) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:57,121::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:24:57,121::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:57,123::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:57,123::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:24:57,123::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:57,124::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:57,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:57,124::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:57,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:57,125::__init__::225::IOProcess::(_processLogs) (272823) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:57,125::__init__::225::IOProcess::(_processLogs) (272823) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:57,125::__init__::225::IOProcess::(_processLogs) (272823) Building response >Thread-18::DEBUG::2014-07-08 16:24:57,125::__init__::225::IOProcess::(_processLogs) (272823) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:57,126::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:24:57,126::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:24:57,127::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:24:57,127::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:24:57,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:24:57,128::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:24:57,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:24:57,129::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:24:57,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:24:57,129::__init__::225::IOProcess::(_processLogs) (272824) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:24:57,129::__init__::225::IOProcess::(_processLogs) (272824) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:24:57,130::__init__::225::IOProcess::(_processLogs) (272824) Building response >Thread-18::DEBUG::2014-07-08 16:24:57,130::__init__::225::IOProcess::(_processLogs) (272824) Queuing response >Thread-18::DEBUG::2014-07-08 16:24:57,130::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:24:57,130::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:24:57,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:57,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329511 s, 31.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:24:58,011::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:24:58,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`adae8b99-a8c5-4293-80b2-fc1c4b747460`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:24:58,013::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:24:58,028::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:58,028::task::1191::Storage.TaskManager.Task::(prepare) Task=`adae8b99-a8c5-4293-80b2-fc1c4b747460`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:24:58,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`adae8b99-a8c5-4293-80b2-fc1c4b747460`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:24:58,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:24:58,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:24:58,029::task::993::Storage.TaskManager.Task::(_decref) Task=`adae8b99-a8c5-4293-80b2-fc1c4b747460`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:24:58,041::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:24:58,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`305b2bd3-c1a3-449f-b97f-a04b771c6c41`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:24:58,042::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:24:58,043::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6f7b11ad-fd74-41f1-a978-eb79e851c92f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:24:58,044::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:24:58,044::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:24:58,044::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6f7b11ad-fd74-41f1-a978-eb79e851c92f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:24:58,045::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`305b2bd3-c1a3-449f-b97f-a04b771c6c41`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:24:58,045::task::993::Storage.TaskManager.Task::(_decref) Task=`305b2bd3-c1a3-449f-b97f-a04b771c6c41`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:24:58,065::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:58,065::task::1191::Storage.TaskManager.Task::(prepare) Task=`305b2bd3-c1a3-449f-b97f-a04b771c6c41`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:24:58,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`305b2bd3-c1a3-449f-b97f-a04b771c6c41`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:24:58,066::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:24:58,066::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:24:58,066::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:24:58,067::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:24:58,067::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:24:58,067::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:24:58,068::task::993::Storage.TaskManager.Task::(_decref) Task=`305b2bd3-c1a3-449f-b97f-a04b771c6c41`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:24:59,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:24:59,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180767 s, 56.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:01,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:02,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0192595 s, 53.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:04,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:04,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0434114 s, 23.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:25:05,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c4c1f0d-4e84-4a33-8738-cd3da6f414ca`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:05,023::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:25:05,023::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486363', 'lastCheck': '7.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:25:05,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c4c1f0d-4e84-4a33-8738-cd3da6f414ca`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486363', 'lastCheck': '7.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:25:05,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c4c1f0d-4e84-4a33-8738-cd3da6f414ca`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:05,024::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:05,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:05,025::task::993::Storage.TaskManager.Task::(_decref) Task=`1c4c1f0d-4e84-4a33-8738-cd3da6f414ca`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:06,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:06,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171738 s, 59.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:07,133::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:07,134::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:07,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:07,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:07,136::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:07,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:07,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:07,136::__init__::225::IOProcess::(_processLogs) (272825) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:07,137::__init__::225::IOProcess::(_processLogs) (272825) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:07,137::__init__::225::IOProcess::(_processLogs) (272825) Building response >Thread-18::DEBUG::2014-07-08 16:25:07,137::__init__::225::IOProcess::(_processLogs) (272825) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:07,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:07,137::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:25:07,139::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:25:07,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000425462 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:07,287::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:07,287::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:07,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:07,288::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:07,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:07,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:07,289::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:07,289::__init__::225::IOProcess::(_processLogs) (272826) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:07,289::__init__::225::IOProcess::(_processLogs) (272826) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:07,289::__init__::225::IOProcess::(_processLogs) DEBUG|(272826) Building response >Thread-18::DEBUG::2014-07-08 16:25:07,290::__init__::225::IOProcess::(_processLogs) (272826) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:07,290::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:07,290::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:25:07,292::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:07,293::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:25:07,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:07,293::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:07,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:07,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:07,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:07,294::__init__::225::IOProcess::(_processLogs) (272827) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:07,294::__init__::225::IOProcess::(_processLogs) (272827) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:07,295::__init__::225::IOProcess::(_processLogs) (272827) Building response >Thread-18::DEBUG::2014-07-08 16:25:07,295::__init__::225::IOProcess::(_processLogs) (272827) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:07,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:07,295::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:07,296::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:07,297::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:25:07,297::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:07,297::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:07,297::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:07,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:07,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:07,298::__init__::225::IOProcess::(_processLogs) (272828) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:07,298::__init__::225::IOProcess::(_processLogs) (272828) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:07,299::__init__::225::IOProcess::(_processLogs) (272828) Building response >Thread-18::DEBUG::2014-07-08 16:25:07,299::__init__::225::IOProcess::(_processLogs) (272828) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:07,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:07,299::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:07,300::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:07,301::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:25:07,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:07,301::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:07,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:07,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:07,302::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:07,302::__init__::225::IOProcess::(_processLogs) (272829) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:07,302::__init__::225::IOProcess::(_processLogs) (272829) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:07,303::__init__::225::IOProcess::(_processLogs) (272829) Building response >Thread-18::DEBUG::2014-07-08 16:25:07,303::__init__::225::IOProcess::(_processLogs) (272829) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:07,303::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:07,303::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:25:08,082::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:25:08,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`389d92f6-1499-453e-a5d4-a062d047c2fd`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:08,083::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:25:08,098::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:08,099::task::1191::Storage.TaskManager.Task::(prepare) Task=`389d92f6-1499-453e-a5d4-a062d047c2fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:08,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`389d92f6-1499-453e-a5d4-a062d047c2fd`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:08,099::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:08,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:08,100::task::993::Storage.TaskManager.Task::(_decref) Task=`389d92f6-1499-453e-a5d4-a062d047c2fd`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:25:08,111::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:25:08,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dde8d36-eb23-4e3c-b3f0-c348fd37e15a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:25:08,113::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:25:08,114::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6ac41598-c5e3-4dd9-bda9-743f2ddef682`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:25:08,114::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:25:08,114::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:25:08,115::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6ac41598-c5e3-4dd9-bda9-743f2ddef682`::Granted request >Thread-6940::DEBUG::2014-07-08 16:25:08,115::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2dde8d36-eb23-4e3c-b3f0-c348fd37e15a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:25:08,116::task::993::Storage.TaskManager.Task::(_decref) Task=`2dde8d36-eb23-4e3c-b3f0-c348fd37e15a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:25:08,135::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:08,135::task::1191::Storage.TaskManager.Task::(prepare) Task=`2dde8d36-eb23-4e3c-b3f0-c348fd37e15a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:08,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dde8d36-eb23-4e3c-b3f0-c348fd37e15a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:25:08,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:25:08,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:25:08,137::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:25:08,137::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:25:08,137::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:25:08,138::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:25:08,138::task::993::Storage.TaskManager.Task::(_decref) Task=`2dde8d36-eb23-4e3c-b3f0-c348fd37e15a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:08,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:09,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173601 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:11,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:11,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174557 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:13,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:13,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319566 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:15,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:15,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174135 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:17,306::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:17,307::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:17,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:17,307::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:17,308::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:17,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:17,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:17,308::__init__::225::IOProcess::(_processLogs) (272830) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:17,309::__init__::225::IOProcess::(_processLogs) (272830) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:17,309::__init__::225::IOProcess::(_processLogs) (272830) Building response >Thread-18::DEBUG::2014-07-08 16:25:17,309::__init__::225::IOProcess::(_processLogs) (272830) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:17,309::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:17,310::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:25:17,311::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:25:17,458::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000486641 s, 949 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:17,465::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:17,466::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:17,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:17,466::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:17,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:17,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:17,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:17,467::__init__::225::IOProcess::(_processLogs) (272831) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:17,467::__init__::225::IOProcess::(_processLogs) (272831) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:17,468::__init__::225::IOProcess::(_processLogs) (272831) Building response >Thread-18::DEBUG::2014-07-08 16:25:17,468::__init__::225::IOProcess::(_processLogs) (272831) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:17,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:17,468::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:25:17,470::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:17,471::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:25:17,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:17,471::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:17,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:17,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:17,472::__init__::225::IOProcess::(_processLogs) (272832) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:17,473::__init__::225::IOProcess::(_processLogs) (272832) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:17,473::__init__::225::IOProcess::(_processLogs) (272832) Building response >Thread-18::DEBUG::2014-07-08 16:25:17,473::__init__::225::IOProcess::(_processLogs) (272832) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:17,473::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:17,473::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:17,475::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:25:17,475::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:17,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:17,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:17,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:17,476::__init__::225::IOProcess::(_processLogs) (272833) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:17,476::__init__::225::IOProcess::(_processLogs) (272833) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:17,477::__init__::225::IOProcess::(_processLogs) (272833) Building response >Thread-18::DEBUG::2014-07-08 16:25:17,477::__init__::225::IOProcess::(_processLogs) (272833) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:17,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:17,477::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:17,478::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:25:17,479::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:17,479::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:17,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:17,479::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:17,480::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:17,480::__init__::225::IOProcess::(_processLogs) (272834) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:17,480::__init__::225::IOProcess::(_processLogs) (272834) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:17,480::__init__::225::IOProcess::(_processLogs) (272834) Building response >Thread-18::DEBUG::2014-07-08 16:25:17,481::__init__::225::IOProcess::(_processLogs) (272834) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:17,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:17,481::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:25:18,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:25:18,161::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:25:18,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc4691f7-600e-4907-af2b-f1bf97bca021`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:18,167::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:25:18,258::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:25:18,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285649 s, 35.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:25:18,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc4691f7-600e-4907-af2b-f1bf97bca021`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:18,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc4691f7-600e-4907-af2b-f1bf97bca021`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:18,350::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:18,354::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:18,356::task::993::Storage.TaskManager.Task::(_decref) Task=`bc4691f7-600e-4907-af2b-f1bf97bca021`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:25:18,378::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:25:18,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`4264cb33-81e3-4699-b36a-a60799290ee6`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:25:18,382::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:25:18,385::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b81bf2fd-53a4-46b5-8791-c4dd63ea6f77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:25:18,386::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:25:18,388::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:25:18,389::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b81bf2fd-53a4-46b5-8791-c4dd63ea6f77`::Granted request >Thread-6940::DEBUG::2014-07-08 16:25:18,391::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4264cb33-81e3-4699-b36a-a60799290ee6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:25:18,392::task::993::Storage.TaskManager.Task::(_decref) Task=`4264cb33-81e3-4699-b36a-a60799290ee6`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:25:18,426::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:18,427::task::1191::Storage.TaskManager.Task::(prepare) Task=`4264cb33-81e3-4699-b36a-a60799290ee6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:18,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`4264cb33-81e3-4699-b36a-a60799290ee6`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:25:18,427::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:25:18,427::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:25:18,428::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:25:18,428::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:25:18,428::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:25:18,429::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:25:18,431::task::993::Storage.TaskManager.Task::(_decref) Task=`4264cb33-81e3-4699-b36a-a60799290ee6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:20,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:25:20,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`36e4018e-eb30-4347-b3a0-32c42129ecc4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:20,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:25:20,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486641', 'lastCheck': '3.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:25:20,580::task::1191::Storage.TaskManager.Task::(prepare) Task=`36e4018e-eb30-4347-b3a0-32c42129ecc4`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486641', 'lastCheck': '3.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:25:20,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`36e4018e-eb30-4347-b3a0-32c42129ecc4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:20,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:20,584::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:20,585::task::993::Storage.TaskManager.Task::(_decref) Task=`36e4018e-eb30-4347-b3a0-32c42129ecc4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:20,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461251 s, 22.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:22,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:22,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0221601 s, 46.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:24,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:25,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0183424 s, 55.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:27,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:27,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172934 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:27,514::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:27,515::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:27,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:27,517::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:27,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:27,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:27,521::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:27,522::__init__::225::IOProcess::(_processLogs) (272835) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:27,523::__init__::225::IOProcess::(_processLogs) (272835) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:27,524::__init__::225::IOProcess::(_processLogs) (272835) Building response >Thread-18::DEBUG::2014-07-08 16:25:27,525::__init__::225::IOProcess::(_processLogs) (272835) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:27,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:27,527::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:25:27,532::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:25:27,683::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000716832 s, 645 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:27,688::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:27,690::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:27,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:27,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:27,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:27,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:27,695::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:27,697::__init__::225::IOProcess::(_processLogs) (272836) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:27,698::__init__::225::IOProcess::(_processLogs) (272836) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:27,699::__init__::225::IOProcess::(_processLogs) (272836) Building response >Thread-18::DEBUG::2014-07-08 16:25:27,700::__init__::225::IOProcess::(_processLogs) (272836) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:27,701::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:27,701::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:25:27,714::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:27,715::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:25:27,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:27,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:27,719::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:27,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:27,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:27,723::__init__::225::IOProcess::(_processLogs) DEBUG|(272837) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:27,724::__init__::225::IOProcess::(_processLogs) (272837) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:27,726::__init__::225::IOProcess::(_processLogs) (272837) Building response >Thread-18::DEBUG::2014-07-08 16:25:27,727::__init__::225::IOProcess::(_processLogs) (272837) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:27,728::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:27,729::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:27,733::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:27,734::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:25:27,734::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:27,735::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:27,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:27,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:27,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:27,740::__init__::225::IOProcess::(_processLogs) (272838) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:27,740::__init__::225::IOProcess::(_processLogs) (272838) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:27,741::__init__::225::IOProcess::(_processLogs) (272838) Building response >Thread-18::DEBUG::2014-07-08 16:25:27,745::__init__::225::IOProcess::(_processLogs) (272838) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:27,748::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:27,751::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:27,763::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:27,766::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:25:27,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:27,772::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:27,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:27,779::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:27,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:27,785::__init__::225::IOProcess::(_processLogs) (272839) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:27,788::__init__::225::IOProcess::(_processLogs) (272839) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:27,791::__init__::225::IOProcess::(_processLogs) (272839) Building response >Thread-18::DEBUG::2014-07-08 16:25:27,794::__init__::225::IOProcess::(_processLogs) (272839) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:27,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:27,799::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:25:28,444::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:25:28,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`a71d47c4-878a-40d9-a80a-abe91edebc25`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:28,446::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:25:28,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:28,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`a71d47c4-878a-40d9-a80a-abe91edebc25`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:28,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`a71d47c4-878a-40d9-a80a-abe91edebc25`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:28,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:28,462::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:28,462::task::993::Storage.TaskManager.Task::(_decref) Task=`a71d47c4-878a-40d9-a80a-abe91edebc25`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:25:28,474::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:25:28,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb28a22e-f8eb-493d-86da-b6167d31f6bc`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:25:28,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:25:28,476::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`34ba4350-5bec-4ca3-a309-2f7f7f02affc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:25:28,477::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:25:28,477::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:25:28,477::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`34ba4350-5bec-4ca3-a309-2f7f7f02affc`::Granted request >Thread-6940::DEBUG::2014-07-08 16:25:28,478::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cb28a22e-f8eb-493d-86da-b6167d31f6bc`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:25:28,478::task::993::Storage.TaskManager.Task::(_decref) Task=`cb28a22e-f8eb-493d-86da-b6167d31f6bc`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:25:28,498::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:28,498::task::1191::Storage.TaskManager.Task::(prepare) Task=`cb28a22e-f8eb-493d-86da-b6167d31f6bc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:28,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb28a22e-f8eb-493d-86da-b6167d31f6bc`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:25:28,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:25:28,499::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:25:28,499::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:25:28,500::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:25:28,500::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:25:28,500::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:25:28,501::task::993::Storage.TaskManager.Task::(_decref) Task=`cb28a22e-f8eb-493d-86da-b6167d31f6bc`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:29,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:30,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175535 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:32,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:32,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178261 s, 57.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:34,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:34,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116968 s, 8.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:25:35,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`aef251ec-7029-46a6-9829-1f9ce5dca08c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:35,818::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:25:35,819::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716832', 'lastCheck': '8.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:25:35,819::task::1191::Storage.TaskManager.Task::(prepare) Task=`aef251ec-7029-46a6-9829-1f9ce5dca08c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716832', 'lastCheck': '8.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:25:35,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`aef251ec-7029-46a6-9829-1f9ce5dca08c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:35,820::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:35,820::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:35,820::task::993::Storage.TaskManager.Task::(_decref) Task=`aef251ec-7029-46a6-9829-1f9ce5dca08c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:36,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:37,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172121 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:37,804::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:37,805::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:37,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:37,805::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:37,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:37,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:37,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:37,806::__init__::225::IOProcess::(_processLogs) (272840) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:37,806::__init__::225::IOProcess::(_processLogs) (272840) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:37,807::__init__::225::IOProcess::(_processLogs) (272840) Building response >Thread-18::DEBUG::2014-07-08 16:25:37,807::__init__::225::IOProcess::(_processLogs) (272840) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:37,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:37,807::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:25:37,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:25:37,954::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00047854 s, 965 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:37,956::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:37,957::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:37,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:37,957::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:37,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:37,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:37,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:37,958::__init__::225::IOProcess::(_processLogs) (272841) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:37,959::__init__::225::IOProcess::(_processLogs) (272841) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:37,959::__init__::225::IOProcess::(_processLogs) (272841) Building response >Thread-18::DEBUG::2014-07-08 16:25:37,959::__init__::225::IOProcess::(_processLogs) (272841) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:37,959::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:37,960::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:25:37,962::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:37,962::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:25:37,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:37,963::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:37,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:37,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:37,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:37,964::__init__::225::IOProcess::(_processLogs) (272842) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:37,964::__init__::225::IOProcess::(_processLogs) (272842) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:37,964::__init__::225::IOProcess::(_processLogs) (272842) Building response >Thread-18::DEBUG::2014-07-08 16:25:37,964::__init__::225::IOProcess::(_processLogs) (272842) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:37,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:37,965::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:37,966::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:37,966::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:25:37,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:37,967::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:37,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:37,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:37,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:37,968::__init__::225::IOProcess::(_processLogs) (272843) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:37,968::__init__::225::IOProcess::(_processLogs) (272843) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:37,968::__init__::225::IOProcess::(_processLogs) (272843) Building response >Thread-18::DEBUG::2014-07-08 16:25:37,968::__init__::225::IOProcess::(_processLogs) (272843) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:37,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:37,969::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:37,970::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:37,970::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:25:37,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:37,971::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:37,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:37,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:37,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:37,972::__init__::225::IOProcess::(_processLogs) (272844) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:37,972::__init__::225::IOProcess::(_processLogs) (272844) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:37,972::__init__::225::IOProcess::(_processLogs) (272844) Building response >Thread-18::DEBUG::2014-07-08 16:25:37,972::__init__::225::IOProcess::(_processLogs) (272844) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:37,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:37,973::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:25:38,516::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:25:38,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`78891a65-995f-4503-b656-2850b4c5c55a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:38,517::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:25:38,532::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:38,532::task::1191::Storage.TaskManager.Task::(prepare) Task=`78891a65-995f-4503-b656-2850b4c5c55a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:38,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`78891a65-995f-4503-b656-2850b4c5c55a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:38,533::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:38,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:38,533::task::993::Storage.TaskManager.Task::(_decref) Task=`78891a65-995f-4503-b656-2850b4c5c55a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:25:38,545::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:25:38,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cc29ce4-31b0-4427-9de6-a6ee0aab0f9f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:25:38,546::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:25:38,547::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b3d22e0a-25af-458f-8956-83178ad3fe87`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:25:38,547::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:25:38,548::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:25:38,548::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b3d22e0a-25af-458f-8956-83178ad3fe87`::Granted request >Thread-6940::DEBUG::2014-07-08 16:25:38,549::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8cc29ce4-31b0-4427-9de6-a6ee0aab0f9f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:25:38,549::task::993::Storage.TaskManager.Task::(_decref) Task=`8cc29ce4-31b0-4427-9de6-a6ee0aab0f9f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:25:38,568::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:38,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`8cc29ce4-31b0-4427-9de6-a6ee0aab0f9f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:38,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cc29ce4-31b0-4427-9de6-a6ee0aab0f9f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:25:38,569::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:25:38,569::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:25:38,569::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:25:38,570::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:25:38,570::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:25:38,570::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:25:38,571::task::993::Storage.TaskManager.Task::(_decref) Task=`8cc29ce4-31b0-4427-9de6-a6ee0aab0f9f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:39,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:39,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176244 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:41,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:41,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172889 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:43,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:43,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017487 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:45,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:46,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181717 s, 56.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:47,975::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:47,976::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:47,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:47,976::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:47,977::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:47,977::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:47,977::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:47,977::__init__::225::IOProcess::(_processLogs) (272845) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:47,978::__init__::225::IOProcess::(_processLogs) (272845) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:47,978::__init__::225::IOProcess::(_processLogs) (272845) Building response >Thread-18::DEBUG::2014-07-08 16:25:47,978::__init__::225::IOProcess::(_processLogs) (272845) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:47,978::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:47,979::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:25:47,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:25:48,126::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000497257 s, 929 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:48,128::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:48,129::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:48,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:48,129::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:48,129::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:48,130::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:48,130::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:48,130::__init__::225::IOProcess::(_processLogs) (272846) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:48,131::__init__::225::IOProcess::(_processLogs) (272846) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:48,131::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272846) Building response >Thread-18::DEBUG::2014-07-08 16:25:48,131::__init__::225::IOProcess::(_processLogs) (272846) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:48,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:48,132::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:25:48,134::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:48,134::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:25:48,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:48,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:48,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:48,135::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:48,136::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:48,136::__init__::225::IOProcess::(_processLogs) (272847) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:48,136::__init__::225::IOProcess::(_processLogs) (272847) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:48,137::__init__::225::IOProcess::(_processLogs) DEBUG|(272847) Building response >Thread-18::DEBUG::2014-07-08 16:25:48,137::__init__::225::IOProcess::(_processLogs) (272847) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:48,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:48,137::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:48,139::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:48,139::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:25:48,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:48,139::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:48,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:48,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:48,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:48,140::__init__::225::IOProcess::(_processLogs) (272848) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:48,141::__init__::225::IOProcess::(_processLogs) (272848) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:48,141::__init__::225::IOProcess::(_processLogs) (272848) Building response >Thread-18::DEBUG::2014-07-08 16:25:48,141::__init__::225::IOProcess::(_processLogs) (272848) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:48,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:48,142::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:48,143::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:48,143::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:25:48,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:48,144::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:48,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:48,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:48,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:48,145::__init__::225::IOProcess::(_processLogs) (272849) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:48,145::__init__::225::IOProcess::(_processLogs) (272849) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:48,145::__init__::225::IOProcess::(_processLogs) (272849) Building response >Thread-18::DEBUG::2014-07-08 16:25:48,145::__init__::225::IOProcess::(_processLogs) (272849) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:48,145::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:48,146::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:25:48,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:48,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172445 s, 59.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:25:48,584::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:25:48,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8edea44-6a25-4911-90d2-e68fca09c8a4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:48,585::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:25:48,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:48,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8edea44-6a25-4911-90d2-e68fca09c8a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:48,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8edea44-6a25-4911-90d2-e68fca09c8a4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:48,603::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:48,603::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:48,603::task::993::Storage.TaskManager.Task::(_decref) Task=`d8edea44-6a25-4911-90d2-e68fca09c8a4`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:25:48,615::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:25:48,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3c73a95-23c6-4907-9fee-6458374a3fc3`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:25:48,616::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:25:48,617::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4c5044b6-b018-4d29-93cd-bcb73f926c8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:25:48,617::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:25:48,618::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:25:48,618::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4c5044b6-b018-4d29-93cd-bcb73f926c8c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:25:48,619::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c3c73a95-23c6-4907-9fee-6458374a3fc3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:25:48,619::task::993::Storage.TaskManager.Task::(_decref) Task=`c3c73a95-23c6-4907-9fee-6458374a3fc3`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:25:48,638::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:48,638::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3c73a95-23c6-4907-9fee-6458374a3fc3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:48,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3c73a95-23c6-4907-9fee-6458374a3fc3`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:25:48,639::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:25:48,639::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:25:48,640::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:25:48,640::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:25:48,640::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:25:48,640::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:25:48,641::task::993::Storage.TaskManager.Task::(_decref) Task=`c3c73a95-23c6-4907-9fee-6458374a3fc3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:50,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:50,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174328 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:25:50,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb0bc141-f09d-4b52-81e3-5de7c667bfe8`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:50,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:25:50,972::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497257', 'lastCheck': '2.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:25:50,973::task::1191::Storage.TaskManager.Task::(prepare) Task=`cb0bc141-f09d-4b52-81e3-5de7c667bfe8`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497257', 'lastCheck': '2.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:25:50,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb0bc141-f09d-4b52-81e3-5de7c667bfe8`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:50,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:50,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:50,974::task::993::Storage.TaskManager.Task::(_decref) Task=`cb0bc141-f09d-4b52-81e3-5de7c667bfe8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:52,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:53,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175389 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:55,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:55,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170911 s, 59.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:25:57,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:57,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174794 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:58,149::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:58,149::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:58,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:58,150::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:58,150::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:58,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:58,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:58,151::__init__::225::IOProcess::(_processLogs) (272850) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:58,151::__init__::225::IOProcess::(_processLogs) (272850) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:58,151::__init__::225::IOProcess::(_processLogs) (272850) Building response >Thread-18::DEBUG::2014-07-08 16:25:58,151::__init__::225::IOProcess::(_processLogs) (272850) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:58,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:58,152::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:25:58,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:25:58,299::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000477981 s, 967 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:25:58,301::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:58,301::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:25:58,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:58,302::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:58,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:58,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:58,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:58,303::__init__::225::IOProcess::(_processLogs) (272851) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:25:58,303::__init__::225::IOProcess::(_processLogs) (272851) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:25:58,304::__init__::225::IOProcess::(_processLogs) (272851) Building response >Thread-18::DEBUG::2014-07-08 16:25:58,304::__init__::225::IOProcess::(_processLogs) (272851) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:58,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:58,304::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:25:58,306::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:58,307::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:25:58,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:58,307::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:58,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:58,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:58,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:58,308::__init__::225::IOProcess::(_processLogs) (272852) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:58,309::__init__::225::IOProcess::(_processLogs) (272852) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:58,309::__init__::225::IOProcess::(_processLogs) (272852) Building response >Thread-18::DEBUG::2014-07-08 16:25:58,309::__init__::225::IOProcess::(_processLogs) (272852) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:58,309::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:58,310::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:58,311::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:58,311::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:25:58,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:58,311::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:58,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:58,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:58,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:58,312::__init__::225::IOProcess::(_processLogs) (272853) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:58,313::__init__::225::IOProcess::(_processLogs) (272853) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:58,313::__init__::225::IOProcess::(_processLogs) (272853) Building response >Thread-18::DEBUG::2014-07-08 16:25:58,313::__init__::225::IOProcess::(_processLogs) (272853) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:58,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:58,314::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:25:58,315::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:25:58,315::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:25:58,315::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:25:58,316::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:25:58,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:25:58,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:25:58,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:25:58,316::__init__::225::IOProcess::(_processLogs) (272854) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:25:58,317::__init__::225::IOProcess::(_processLogs) (272854) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:25:58,317::__init__::225::IOProcess::(_processLogs) (272854) Building response >Thread-18::DEBUG::2014-07-08 16:25:58,317::__init__::225::IOProcess::(_processLogs) (272854) Queuing response >Thread-18::DEBUG::2014-07-08 16:25:58,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:25:58,318::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:25:58,661::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:25:58,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`25045b13-c8fd-48e3-880c-0e4832079fde`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:25:58,663::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:25:58,677::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:58,678::task::1191::Storage.TaskManager.Task::(prepare) Task=`25045b13-c8fd-48e3-880c-0e4832079fde`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:25:58,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`25045b13-c8fd-48e3-880c-0e4832079fde`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:25:58,678::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:25:58,679::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:25:58,679::task::993::Storage.TaskManager.Task::(_decref) Task=`25045b13-c8fd-48e3-880c-0e4832079fde`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:25:58,690::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:25:58,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3e6a391-33b2-49f2-aab3-339aa0033c3b`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:25:58,692::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:25:58,693::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`236d8e11-bbd8-4afc-adc4-7bedabce3c31`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:25:58,693::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:25:58,693::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:25:58,694::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`236d8e11-bbd8-4afc-adc4-7bedabce3c31`::Granted request >Thread-6940::DEBUG::2014-07-08 16:25:58,694::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d3e6a391-33b2-49f2-aab3-339aa0033c3b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:25:58,695::task::993::Storage.TaskManager.Task::(_decref) Task=`d3e6a391-33b2-49f2-aab3-339aa0033c3b`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:25:58,714::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:58,714::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3e6a391-33b2-49f2-aab3-339aa0033c3b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:25:58,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3e6a391-33b2-49f2-aab3-339aa0033c3b`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:25:58,715::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:25:58,715::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:25:58,715::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:25:58,716::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:25:58,716::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:25:58,716::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:25:58,717::task::993::Storage.TaskManager.Task::(_decref) Task=`d3e6a391-33b2-49f2-aab3-339aa0033c3b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:25:59,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:25:59,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288985 s, 35.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:01,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:02,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175808 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:04,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:04,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423699 s, 24.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:26:06,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad9fa825-7f44-4814-a70e-3e937ded8218`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:26:06,124::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:26:06,125::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477981', 'lastCheck': '7.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:26:06,125::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad9fa825-7f44-4814-a70e-3e937ded8218`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477981', 'lastCheck': '7.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:26:06,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad9fa825-7f44-4814-a70e-3e937ded8218`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:26:06,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:26:06,126::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:26:06,126::task::993::Storage.TaskManager.Task::(_decref) Task=`ad9fa825-7f44-4814-a70e-3e937ded8218`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:26:06,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:07,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176166 s, 58.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:26:08,320::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:08,321::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:26:08,321::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:08,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:08,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:08,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:08,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:08,322::__init__::225::IOProcess::(_processLogs) (272855) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:26:08,323::__init__::225::IOProcess::(_processLogs) (272855) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:26:08,323::__init__::225::IOProcess::(_processLogs) (272855) Building response >Thread-18::DEBUG::2014-07-08 16:26:08,323::__init__::225::IOProcess::(_processLogs) (272855) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:08,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:08,324::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:26:08,325::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:26:08,471::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000468762 s, 986 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:26:08,473::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:26:08,473::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:08,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:08,474::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:08,474::__init__::225::IOProcess::(_processLogs) (272856) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:26:08,475::__init__::225::IOProcess::(_processLogs) (272856) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:26:08,475::__init__::225::IOProcess::(_processLogs) (272856) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:08,475::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:08,475::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:26:08,478::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:26:08,478::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:08,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:08,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:08,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:08,479::__init__::225::IOProcess::(_processLogs) (272857) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:08,479::__init__::225::IOProcess::(_processLogs) (272857) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:08,479::__init__::225::IOProcess::(_processLogs) (272857) Building response >Thread-18::DEBUG::2014-07-08 16:26:08,480::__init__::225::IOProcess::(_processLogs) (272857) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:08,480::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:08,480::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:26:08,481::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:26:08,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:08,482::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:08,482::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:08,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:08,483::__init__::225::IOProcess::(_processLogs) (272858) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:08,483::__init__::225::IOProcess::(_processLogs) (272858) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:08,483::__init__::225::IOProcess::(_processLogs) (272858) Building response >Thread-18::DEBUG::2014-07-08 16:26:08,483::__init__::225::IOProcess::(_processLogs) (272858) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:08,484::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:08,484::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:26:08,485::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:26:08,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:08,485::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:08,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:08,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:08,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:08,486::__init__::225::IOProcess::(_processLogs) (272859) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:08,487::__init__::225::IOProcess::(_processLogs) (272859) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:08,487::__init__::225::IOProcess::(_processLogs) (272859) Building response >Thread-18::DEBUG::2014-07-08 16:26:08,487::__init__::225::IOProcess::(_processLogs) (272859) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:08,487::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:08,488::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:26:08,731::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:26:08,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`6379a1c4-621c-4ae1-8b75-6868aeb5d4f4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:26:08,732::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:26:08,747::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:26:08,747::task::1191::Storage.TaskManager.Task::(prepare) Task=`6379a1c4-621c-4ae1-8b75-6868aeb5d4f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:26:08,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`6379a1c4-621c-4ae1-8b75-6868aeb5d4f4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:26:08,748::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:26:08,748::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:26:08,748::task::993::Storage.TaskManager.Task::(_decref) Task=`6379a1c4-621c-4ae1-8b75-6868aeb5d4f4`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:26:08,763::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:26:08,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`738ff0c0-a4b4-426b-b5e0-d78d9501a8ca`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:26:08,765::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:26:08,767::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3476a962-1c78-45af-845c-e9864865558f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:26:08,768::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:26:08,770::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:26:08,772::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3476a962-1c78-45af-845c-e9864865558f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:26:08,773::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`738ff0c0-a4b4-426b-b5e0-d78d9501a8ca`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:26:08,774::task::993::Storage.TaskManager.Task::(_decref) Task=`738ff0c0-a4b4-426b-b5e0-d78d9501a8ca`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:26:08,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:26:08,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`738ff0c0-a4b4-426b-b5e0-d78d9501a8ca`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:26:08,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`738ff0c0-a4b4-426b-b5e0-d78d9501a8ca`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:26:08,794::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:26:08,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:26:08,795::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:26:08,795::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:26:08,795::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:26:08,795::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:26:08,796::task::993::Storage.TaskManager.Task::(_decref) Task=`738ff0c0-a4b4-426b-b5e0-d78d9501a8ca`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:26:09,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:09,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174219 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:11,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:11,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173344 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:13,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:13,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173702 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:15,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:17,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.28754 s, 795 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:26:18,491::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:18,491::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:26:18,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:18,492::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:18,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:18,492::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:18,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:18,493::__init__::225::IOProcess::(_processLogs) (272860) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:26:18,493::__init__::225::IOProcess::(_processLogs) (272860) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:26:18,493::__init__::225::IOProcess::(_processLogs) (272860) Building response >Thread-18::DEBUG::2014-07-08 16:26:18,493::__init__::225::IOProcess::(_processLogs) (272860) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:18,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:18,494::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:26:18,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:26:18,644::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000450047 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:26:18,646::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:18,647::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:26:18,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:18,647::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:18,647::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:18,648::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:18,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:18,648::__init__::225::IOProcess::(_processLogs) (272861) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:26:18,648::__init__::225::IOProcess::(_processLogs) (272861) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:26:18,649::__init__::225::IOProcess::(_processLogs) (272861) Building response >Thread-18::DEBUG::2014-07-08 16:26:18,649::__init__::225::IOProcess::(_processLogs) (272861) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:18,649::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:26:18,650::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:26:18,652::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:18,652::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:26:18,652::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:18,653::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:18,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:18,653::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:18,654::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:18,654::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272862) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:18,654::__init__::225::IOProcess::(_processLogs) (272862) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:18,654::__init__::225::IOProcess::(_processLogs) (272862) Building response >Thread-18::DEBUG::2014-07-08 16:26:18,655::__init__::225::IOProcess::(_processLogs) (272862) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:18,655::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:26:18,655::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:26:18,657::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:18,657::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:26:18,657::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:18,657::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:18,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:18,658::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:18,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:18,659::__init__::225::IOProcess::(_processLogs) (272863) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:18,659::__init__::225::IOProcess::(_processLogs) (272863) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:18,659::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272863) Building response >Thread-18::DEBUG::2014-07-08 16:26:18,659::__init__::225::IOProcess::(_processLogs) (272863) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:18,660::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:18,660::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:26:18,661::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:18,661::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:26:18,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:18,662::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:18,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:18,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:18,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:18,663::__init__::225::IOProcess::(_processLogs) (272864) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:18,663::__init__::225::IOProcess::(_processLogs) (272864) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:18,663::__init__::225::IOProcess::(_processLogs) (272864) Building response >Thread-18::DEBUG::2014-07-08 16:26:18,663::__init__::225::IOProcess::(_processLogs) (272864) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:18,664::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:26:18,810::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:26:18,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`55d9f3ba-802d-488b-a8fd-308a22ec9fd9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:26:18,812::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:26:18,826::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:26:18,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`55d9f3ba-802d-488b-a8fd-308a22ec9fd9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:26:18,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`55d9f3ba-802d-488b-a8fd-308a22ec9fd9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:26:18,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:26:18,827::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:26:18,828::task::993::Storage.TaskManager.Task::(_decref) Task=`55d9f3ba-802d-488b-a8fd-308a22ec9fd9`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:26:18,841::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:26:18,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c0c90d9-f2ca-4e88-9be2-0fdcf361e1c5`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:26:18,842::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:26:18,843::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a96a783d-f1f4-472e-bb80-be481cee6401`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:26:18,843::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:26:18,844::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:26:18,844::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a96a783d-f1f4-472e-bb80-be481cee6401`::Granted request >Thread-6940::DEBUG::2014-07-08 16:26:18,850::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2c0c90d9-f2ca-4e88-9be2-0fdcf361e1c5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:26:18,851::task::993::Storage.TaskManager.Task::(_decref) Task=`2c0c90d9-f2ca-4e88-9be2-0fdcf361e1c5`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:26:18,870::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:26:18,870::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c0c90d9-f2ca-4e88-9be2-0fdcf361e1c5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:26:18,870::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c0c90d9-f2ca-4e88-9be2-0fdcf361e1c5`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:26:18,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:26:18,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:26:18,871::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:26:18,872::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:26:18,872::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:26:18,872::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:26:18,872::task::993::Storage.TaskManager.Task::(_decref) Task=`2c0c90d9-f2ca-4e88-9be2-0fdcf361e1c5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:26:19,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:19,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174015 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:26:21,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`3edf8e9e-01ae-4920-90e7-d6969655b373`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:26:21,336::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:26:21,336::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450047', 'lastCheck': '2.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:26:21,337::task::1191::Storage.TaskManager.Task::(prepare) Task=`3edf8e9e-01ae-4920-90e7-d6969655b373`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450047', 'lastCheck': '2.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:26:21,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`3edf8e9e-01ae-4920-90e7-d6969655b373`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:26:21,337::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:26:21,337::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:26:21,338::task::993::Storage.TaskManager.Task::(_decref) Task=`3edf8e9e-01ae-4920-90e7-d6969655b373`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:26:21,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:21,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175948 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:23,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:24,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170523 s, 60.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:26,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:26,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017359 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:28,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:28,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176294 s, 58.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:26:28,732::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:26:28,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:28,734::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:28,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:28,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:28,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:28,738::__init__::225::IOProcess::(_processLogs) (272865) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:26:28,739::__init__::225::IOProcess::(_processLogs) (272865) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:26:28,740::__init__::225::IOProcess::(_processLogs) (272865) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:28,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:28,742::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:26:28,747::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:26:28,906::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000537205 s, 860 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:26:28,910::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:26:28,922::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:26:28,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`91597d1b-653a-4dd3-99f3-faf2290b0141`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:26:28,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::INFO::2014-07-08 16:26:28,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:26:28,934::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:28,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:28,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:28,953::__init__::225::IOProcess::(_processLogs) (272866) Finding callback 'statvfs'... >Thread-6941::INFO::2014-07-08 16:26:28,956::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:26:28,956::__init__::225::IOProcess::(_processLogs) (272866) Got request for method 'statvfs' >Thread-6941::DEBUG::2014-07-08 16:26:28,959::task::1191::Storage.TaskManager.Task::(prepare) Task=`91597d1b-653a-4dd3-99f3-faf2290b0141`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:26:28,960::__init__::225::IOProcess::(_processLogs) (272866) Building response >Thread-18::DEBUG::2014-07-08 16:26:28,963::__init__::225::IOProcess::(_processLogs) (272866) Queuing response >Thread-6941::DEBUG::2014-07-08 16:26:28,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`91597d1b-653a-4dd3-99f3-faf2290b0141`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:26:28,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:26:28,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6941::DEBUG::2014-07-08 16:26:28,968::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:26:28,971::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6941::DEBUG::2014-07-08 16:26:28,973::task::993::Storage.TaskManager.Task::(_decref) Task=`91597d1b-653a-4dd3-99f3-faf2290b0141`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:26:28,991::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:26:28,999::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:26:29,003::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:26:29,008::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:26:29,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`0317cf83-9e70-4e7f-890d-e8d30abb26f3`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:26:29,015::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::INFO::2014-07-08 16:26:29,021::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:26:29,022::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:29,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:26:29,029::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`daf5e6cc-a5fd-49d8-b1b1-2f23711db58b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:26:29,030::__init__::225::IOProcess::(_processLogs) (272867) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:26:29,031::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:26:29,033::__init__::225::IOProcess::(_processLogs) (272867) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:26:29,035::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:26:29,036::__init__::225::IOProcess::(_processLogs) (272867) Building response >Thread-6940::DEBUG::2014-07-08 16:26:29,037::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`daf5e6cc-a5fd-49d8-b1b1-2f23711db58b`::Granted request >Thread-18::DEBUG::2014-07-08 16:26:29,039::__init__::225::IOProcess::(_processLogs) (272867) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:29,042::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:26:29,043::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0317cf83-9e70-4e7f-890d-e8d30abb26f3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:26:29,045::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:26:29,046::task::993::Storage.TaskManager.Task::(_decref) Task=`0317cf83-9e70-4e7f-890d-e8d30abb26f3`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:26:29,055::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:29,061::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:26:29,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:29,070::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:29,075::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:29,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:29,079::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:29,080::__init__::225::IOProcess::(_processLogs) (272868) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:29,081::__init__::225::IOProcess::(_processLogs) (272868) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:29,082::__init__::225::IOProcess::(_processLogs) (272868) Building response >Thread-18::DEBUG::2014-07-08 16:26:29,083::__init__::225::IOProcess::(_processLogs) (272868) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:29,084::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:29,085::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:26:29,089::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:29,090::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-6940::INFO::2014-07-08 16:26:29,092::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:26:29,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:26:29,094::task::1191::Storage.TaskManager.Task::(prepare) Task=`0317cf83-9e70-4e7f-890d-e8d30abb26f3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:26:29,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`0317cf83-9e70-4e7f-890d-e8d30abb26f3`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:26:29,097::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-6940::DEBUG::2014-07-08 16:26:29,098::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:26:29,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:26:29,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:26:29,103::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:26:29,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:29,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:26:29,106::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:26:29,108::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:26:29,108::__init__::225::IOProcess::(_processLogs) (272869) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:26:29,110::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:26:29,111::__init__::225::IOProcess::(_processLogs) (272869) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:26:29,113::task::993::Storage.TaskManager.Task::(_decref) Task=`0317cf83-9e70-4e7f-890d-e8d30abb26f3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:26:29,114::__init__::225::IOProcess::(_processLogs) (272869) Building response >Thread-18::DEBUG::2014-07-08 16:26:29,116::__init__::225::IOProcess::(_processLogs) (272869) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:29,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:29,121::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:26:31,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:31,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174593 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:33,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:33,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01788 s, 57.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:35,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:35,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184929 s, 55.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:26:36,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9643692-0e35-48c1-a347-9a2eea5118f4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:26:36,583::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:26:36,584::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537205', 'lastCheck': '7.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:26:36,584::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9643692-0e35-48c1-a347-9a2eea5118f4`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537205', 'lastCheck': '7.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:26:36,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9643692-0e35-48c1-a347-9a2eea5118f4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:26:36,584::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:26:36,585::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:26:36,585::task::993::Storage.TaskManager.Task::(_decref) Task=`e9643692-0e35-48c1-a347-9a2eea5118f4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:26:37,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:38,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172749 s, 59.3 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:26:39,127::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:26:39,142::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:26:39,145::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:26:39,147::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-6941::DEBUG::2014-07-08 16:26:39,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3fc262e-fb43-4d4b-9f38-81f0f7e57a3d`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:26:39,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::INFO::2014-07-08 16:26:39,151::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:26:39,152::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,153::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,154::__init__::225::IOProcess::(_processLogs) (272870) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:26:39,154::__init__::225::IOProcess::(_processLogs) (272870) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:26:39,154::__init__::225::IOProcess::(_processLogs) (272870) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,155::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272870) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,155::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,155::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:26:39,157::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,157::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:26:39,157::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,158::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,158::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,159::__init__::225::IOProcess::(_processLogs) (272871) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:26:39,159::__init__::225::IOProcess::(_processLogs) (272871) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:26:39,159::__init__::225::IOProcess::(_processLogs) (272871) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,159::__init__::225::IOProcess::(_processLogs) (272871) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,160::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:26:39,161::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,162::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:26:39,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,162::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,163::__init__::225::IOProcess::(_processLogs) (272872) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:26:39,163::__init__::225::IOProcess::(_processLogs) (272872) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:26:39,164::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272872) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,164::__init__::225::IOProcess::(_processLogs) (272872) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,164::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,164::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:26:39,165::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,168::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:26:39,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,171::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,173::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,175::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-37::DEBUG::2014-07-08 16:26:39,178::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:26:39,179::__init__::225::IOProcess::(_processLogs) (272873) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:26:39,179::__init__::225::IOProcess::(_processLogs) (272873) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:26:39,180::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272873) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,180::__init__::225::IOProcess::(_processLogs) (272873) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,180::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:26:39,182::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,182::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:26:39,182::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,183::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,184::__init__::225::IOProcess::(_processLogs) (272874) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:26:39,184::__init__::225::IOProcess::(_processLogs) (272874) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:26:39,184::__init__::225::IOProcess::(_processLogs) (272874) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,184::__init__::225::IOProcess::(_processLogs) (272874) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,185::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:26:39,186::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:26:39,186::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,187::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:26:39,187::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,187::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,188::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,188::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,188::__init__::225::IOProcess::(_processLogs) (272875) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:26:39,189::__init__::225::IOProcess::(_processLogs) (272875) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:26:39,189::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(272875) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,189::__init__::225::IOProcess::(_processLogs) (272875) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,190::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:26:39,190::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:26:39,191::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,192::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:26:39,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,192::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,193::__init__::225::IOProcess::(_processLogs) (272876) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:39,193::__init__::225::IOProcess::(_processLogs) (272876) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:39,194::__init__::225::IOProcess::(_processLogs) (272876) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,194::__init__::225::IOProcess::(_processLogs) (272876) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,194::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:26:39,196::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,196::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:26:39,196::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,196::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,197::__init__::225::IOProcess::(_processLogs) (272877) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:26:39,198::__init__::225::IOProcess::(_processLogs) (272877) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:26:39,198::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|(272877) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,198::__init__::225::IOProcess::(_processLogs) (272877) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,198::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,198::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:26:39,199::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:26:39,199::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:26:39,200::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:26:39,201::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,201::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:26:39,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,205::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,206::__init__::225::IOProcess::(_processLogs) (272878) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:26:39,206::__init__::225::IOProcess::(_processLogs) (272878) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:26:39,206::__init__::225::IOProcess::(_processLogs) (272878) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,206::__init__::225::IOProcess::(_processLogs) (272878) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,207::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,207::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:26:39,208::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::INFO::2014-07-08 16:26:39,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:26:39,361::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000548381 s, 842 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:26:39,360::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3fc262e-fb43-4d4b-9f38-81f0f7e57a3d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:26:39,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3fc262e-fb43-4d4b-9f38-81f0f7e57a3d`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:26:39,368::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:26:39,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:26:39,372::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:26:39,373::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:26:39,374::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::DEBUG::2014-07-08 16:26:39,377::task::993::Storage.TaskManager.Task::(_decref) Task=`d3fc262e-fb43-4d4b-9f38-81f0f7e57a3d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:26:39,378::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,382::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,385::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,387::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,389::__init__::225::IOProcess::(_processLogs) (272879) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:26:39,390::__init__::225::IOProcess::(_processLogs) (272879) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:26:39,392::__init__::225::IOProcess::(_processLogs) (272879) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,393::__init__::225::IOProcess::(_processLogs) (272879) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:26:39,400::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:26:39,400::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6940::DEBUG::2014-07-08 16:26:39,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`899664a1-b377-450f-b0d3-c10a263e9255`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:26:39,409::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:26:39,416::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fc035f7c-f5b1-4e92-9d9a-1d68849010d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:26:39,418::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:26:39,419::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-6940::DEBUG::2014-07-08 16:26:39,423::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:26:39,423::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-6940::DEBUG::2014-07-08 16:26:39,425::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fc035f7c-f5b1-4e92-9d9a-1d68849010d4`::Granted request >Thread-18::DEBUG::2014-07-08 16:26:39,426::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,430::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:26:39,431::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`899664a1-b377-450f-b0d3-c10a263e9255`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:26:39,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:26:39,433::task::993::Storage.TaskManager.Task::(_decref) Task=`899664a1-b377-450f-b0d3-c10a263e9255`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:26:39,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,443::__init__::225::IOProcess::(_processLogs) (272880) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:39,447::__init__::225::IOProcess::(_processLogs) (272880) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:39,451::__init__::225::IOProcess::(_processLogs) (272880) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,455::__init__::225::IOProcess::(_processLogs) (272880) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,462::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:26:39,469::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,475::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-6940::INFO::2014-07-08 16:26:39,478::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:26:39,480::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:26:39,482::task::1191::Storage.TaskManager.Task::(prepare) Task=`899664a1-b377-450f-b0d3-c10a263e9255`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:26:39,483::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:26:39,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`899664a1-b377-450f-b0d3-c10a263e9255`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:26:39,486::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:26:39,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:26:39,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:26:39,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:26:39,492::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:26:39,493::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:26:39,495::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:26:39,496::__init__::225::IOProcess::(_processLogs) (272881) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:26:39,497::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:26:39,499::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:26:39,500::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:26:39,503::task::993::Storage.TaskManager.Task::(_decref) Task=`899664a1-b377-450f-b0d3-c10a263e9255`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:26:39,504::__init__::225::IOProcess::(_processLogs) (272881) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,507::__init__::225::IOProcess::(_processLogs) (272881) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,513::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:26:39,519::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:39,520::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:26:39,521::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:39,523::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:39,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:39,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:39,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:39,528::__init__::225::IOProcess::(_processLogs) (272882) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:39,529::__init__::225::IOProcess::(_processLogs) (272882) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:39,531::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|(272882) Building response >Thread-18::DEBUG::2014-07-08 16:26:39,533::__init__::225::IOProcess::(_processLogs) (272882) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:39,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:39,535::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:26:40,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:40,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175747 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:42,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:42,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174602 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:44,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:45,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184656 s, 55.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:47,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:47,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321494 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:49,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:49,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017554 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:26:49,604::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:26:49,608::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:26:49,614::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:26:49,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cc2d9c3-4304-4218-830b-92982810e8ec`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:26:49,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::INFO::2014-07-08 16:26:49,626::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:26:49,628::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:49,632::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:49,634::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:49,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:49,638::__init__::225::IOProcess::(_processLogs) (272883) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:26:49,643::__init__::225::IOProcess::(_processLogs) (272883) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:26:49,645::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|(272883) Building response >Thread-6941::INFO::2014-07-08 16:26:49,647::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:26:49,651::__init__::225::IOProcess::(_processLogs) (272883) Queuing response >Thread-6941::DEBUG::2014-07-08 16:26:49,652::task::1191::Storage.TaskManager.Task::(prepare) Task=`7cc2d9c3-4304-4218-830b-92982810e8ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:26:49,658::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6941::DEBUG::2014-07-08 16:26:49,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cc2d9c3-4304-4218-830b-92982810e8ec`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:26:49,664::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6941::DEBUG::2014-07-08 16:26:49,663::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:26:49,668::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:26:49,674::task::993::Storage.TaskManager.Task::(_decref) Task=`7cc2d9c3-4304-4218-830b-92982810e8ec`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 16:26:49,686::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:26:49,840::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000660682 s, 699 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:26:49,851::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:49,857::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6940::DEBUG::2014-07-08 16:26:49,856::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:26:49,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:26:49,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd57c72a-786c-4122-af05-35b3dedfd47f`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:26:49,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::INFO::2014-07-08 16:26:49,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:26:49,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:49,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:26:49,879::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ea79856e-7c0a-4aae-ba31-731c7ecc4b1f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:26:49,881::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:26:49,882::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:49,887::__init__::225::IOProcess::(_processLogs) (272884) Finding callback 'statvfs'... >Thread-6940::DEBUG::2014-07-08 16:26:49,887::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:26:49,892::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ea79856e-7c0a-4aae-ba31-731c7ecc4b1f`::Granted request >Thread-18::DEBUG::2014-07-08 16:26:49,892::__init__::225::IOProcess::(_processLogs) (272884) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:26:49,898::__init__::225::IOProcess::(_processLogs) (272884) Building response >Thread-6940::DEBUG::2014-07-08 16:26:49,899::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bd57c72a-786c-4122-af05-35b3dedfd47f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:26:49,903::task::993::Storage.TaskManager.Task::(_decref) Task=`bd57c72a-786c-4122-af05-35b3dedfd47f`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:26:49,904::__init__::225::IOProcess::(_processLogs) (272884) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:49,909::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:49,915::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:26:49,944::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:49,950::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:26:49,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:49,962::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:49,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:49,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:49,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::INFO::2014-07-08 16:26:49,973::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:26:49,975::__init__::225::IOProcess::(_processLogs) (272885) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:26:49,977::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd57c72a-786c-4122-af05-35b3dedfd47f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:26:49,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd57c72a-786c-4122-af05-35b3dedfd47f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:26:49,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:26:49,981::__init__::225::IOProcess::(_processLogs) (272885) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:26:49,985::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:26:49,992::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:26:49,991::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|(272885) Building response >Thread-6940::DEBUG::2014-07-08 16:26:49,998::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:26:50,001::__init__::225::IOProcess::(_processLogs) (272885) Queuing response >Thread-6940::DEBUG::2014-07-08 16:26:50,001::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:26:50,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:26:50,005::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:26:50,008::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:26:50,012::task::993::Storage.TaskManager.Task::(_decref) Task=`bd57c72a-786c-4122-af05-35b3dedfd47f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:26:50,025::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:50,029::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:26:50,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:50,036::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:50,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:50,043::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:50,047::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:50,049::__init__::225::IOProcess::(_processLogs) (272886) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:50,052::__init__::225::IOProcess::(_processLogs) (272886) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:50,056::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|(272886) Building response >Thread-18::DEBUG::2014-07-08 16:26:50,058::__init__::225::IOProcess::(_processLogs) (272886) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:50,061::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:50,064::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:26:50,077::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:26:50,081::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:26:50,083::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:26:50,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:26:50,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:26:50,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:26:50,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:26:50,094::__init__::225::IOProcess::(_processLogs) (272887) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:26:50,096::__init__::225::IOProcess::(_processLogs) (272887) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:26:50,099::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|(272887) Building response >Thread-18::DEBUG::2014-07-08 16:26:50,102::__init__::225::IOProcess::(_processLogs) (272887) Queuing response >Thread-18::DEBUG::2014-07-08 16:26:50,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:26:50,107::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:26:51,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`3759faf8-d854-41c9-8e98-d7f92ab50601`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:26:51,799::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:26:51,800::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660682', 'lastCheck': '1.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:26:51,800::task::1191::Storage.TaskManager.Task::(prepare) Task=`3759faf8-d854-41c9-8e98-d7f92ab50601`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660682', 'lastCheck': '1.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:26:51,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`3759faf8-d854-41c9-8e98-d7f92ab50601`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:26:51,800::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:26:51,801::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:26:51,801::task::993::Storage.TaskManager.Task::(_decref) Task=`3759faf8-d854-41c9-8e98-d7f92ab50601`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:26:52,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:52,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172364 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:54,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:54,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017292 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:56,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:57,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268262 s, 38.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:26:59,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:26:59,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017309 s, 59.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:27:00,046::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:27:00,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`35b91611-df3b-44e9-af91-0fe9c360df61`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:00,047::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:27:00,062::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:00,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`35b91611-df3b-44e9-af91-0fe9c360df61`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:00,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`35b91611-df3b-44e9-af91-0fe9c360df61`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:00,063::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:00,063::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:00,064::task::993::Storage.TaskManager.Task::(_decref) Task=`35b91611-df3b-44e9-af91-0fe9c360df61`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:27:00,075::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:27:00,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca5127db-d8aa-4585-a328-9e7982356781`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:27:00,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:27:00,077::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`005b2c8c-8b9b-4063-9adb-2237c0344063`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:27:00,077::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:27:00,078::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:27:00,078::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`005b2c8c-8b9b-4063-9adb-2237c0344063`::Granted request >Thread-6940::DEBUG::2014-07-08 16:27:00,079::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ca5127db-d8aa-4585-a328-9e7982356781`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:27:00,079::task::993::Storage.TaskManager.Task::(_decref) Task=`ca5127db-d8aa-4585-a328-9e7982356781`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:27:00,098::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:00,099::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca5127db-d8aa-4585-a328-9e7982356781`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:00,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca5127db-d8aa-4585-a328-9e7982356781`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:27:00,099::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:27:00,099::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:27:00,100::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:27:00,100::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:27:00,100::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:27:00,101::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:27:00,101::task::993::Storage.TaskManager.Task::(_decref) Task=`ca5127db-d8aa-4585-a328-9e7982356781`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:27:00,115::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:00,116::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:00,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:00,116::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:00,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:00,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:00,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:00,117::__init__::225::IOProcess::(_processLogs) (272888) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:00,117::__init__::225::IOProcess::(_processLogs) (272888) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:00,118::__init__::225::IOProcess::(_processLogs) (272888) Building response >Thread-18::DEBUG::2014-07-08 16:27:00,118::__init__::225::IOProcess::(_processLogs) (272888) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:00,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:00,118::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:27:00,120::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:27:00,274::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000489714 s, 943 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:27:00,279::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:00,281::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:00,283::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:00,285::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:00,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:00,289::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:00,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:00,292::__init__::225::IOProcess::(_processLogs) (272889) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:00,294::__init__::225::IOProcess::(_processLogs) (272889) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:00,296::__init__::225::IOProcess::(_processLogs) (272889) Building response >Thread-18::DEBUG::2014-07-08 16:27:00,297::__init__::225::IOProcess::(_processLogs) (272889) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:00,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:00,300::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:27:00,311::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:00,313::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:27:00,314::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:00,316::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:00,317::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:00,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:00,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:00,322::__init__::225::IOProcess::(_processLogs) (272890) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:00,323::__init__::225::IOProcess::(_processLogs) (272890) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:00,324::__init__::225::IOProcess::(_processLogs) (272890) Building response >Thread-18::DEBUG::2014-07-08 16:27:00,325::__init__::225::IOProcess::(_processLogs) (272890) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:00,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:00,328::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:00,334::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:00,336::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:27:00,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:00,338::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:00,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:00,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:00,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:00,344::__init__::225::IOProcess::(_processLogs) (272891) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:00,345::__init__::225::IOProcess::(_processLogs) (272891) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:00,346::__init__::225::IOProcess::(_processLogs) (272891) Building response >Thread-18::DEBUG::2014-07-08 16:27:00,348::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|(272891) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:00,350::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:00,351::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:00,356::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:00,357::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:27:00,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:00,360::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:00,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:00,363::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:00,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:00,367::__init__::225::IOProcess::(_processLogs) (272892) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:00,368::__init__::225::IOProcess::(_processLogs) (272892) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:00,369::__init__::225::IOProcess::(_processLogs) (272892) Building response >Thread-18::DEBUG::2014-07-08 16:27:00,370::__init__::225::IOProcess::(_processLogs) (272892) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:00,372::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:00,373::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:27:01,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:01,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.021101 s, 48.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:03,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:03,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370283 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:06,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:06,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172191 s, 59.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:27:06,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`81a4aa2c-9965-4f1e-bfdc-3fb740e748ae`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:06,978::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:27:06,978::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489714', 'lastCheck': '6.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:27:06,978::task::1191::Storage.TaskManager.Task::(prepare) Task=`81a4aa2c-9965-4f1e-bfdc-3fb740e748ae`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489714', 'lastCheck': '6.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:27:06,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`81a4aa2c-9965-4f1e-bfdc-3fb740e748ae`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:06,979::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:06,979::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:06,979::task::993::Storage.TaskManager.Task::(_decref) Task=`81a4aa2c-9965-4f1e-bfdc-3fb740e748ae`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:27:08,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:08,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174987 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:27:10,114::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:27:10,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe82e6cf-0eb5-4c23-b157-11f7c3101e04`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:10,116::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:27:10,130::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:10,131::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe82e6cf-0eb5-4c23-b157-11f7c3101e04`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:10,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe82e6cf-0eb5-4c23-b157-11f7c3101e04`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:10,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:10,132::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:10,132::task::993::Storage.TaskManager.Task::(_decref) Task=`fe82e6cf-0eb5-4c23-b157-11f7c3101e04`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:27:10,145::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:27:10,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f0b357e-190f-4774-9175-4d3389d4a4ee`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:27:10,146::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:27:10,147::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cb24a1ae-1fce-4ca7-bf05-67c4918e85be`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:27:10,147::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:27:10,151::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:27:10,152::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cb24a1ae-1fce-4ca7-bf05-67c4918e85be`::Granted request >Thread-6940::DEBUG::2014-07-08 16:27:10,153::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0f0b357e-190f-4774-9175-4d3389d4a4ee`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:27:10,153::task::993::Storage.TaskManager.Task::(_decref) Task=`0f0b357e-190f-4774-9175-4d3389d4a4ee`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:27:10,172::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:10,172::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f0b357e-190f-4774-9175-4d3389d4a4ee`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:10,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f0b357e-190f-4774-9175-4d3389d4a4ee`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:27:10,173::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:27:10,173::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:27:10,173::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:27:10,174::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:27:10,174::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:27:10,174::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:27:10,174::task::993::Storage.TaskManager.Task::(_decref) Task=`0f0b357e-190f-4774-9175-4d3389d4a4ee`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:27:10,379::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:10,379::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:10,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:10,380::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:10,380::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:10,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:10,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:10,381::__init__::225::IOProcess::(_processLogs) (272893) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:10,381::__init__::225::IOProcess::(_processLogs) (272893) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:10,381::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|(272893) Building response >Thread-18::DEBUG::2014-07-08 16:27:10,382::__init__::225::IOProcess::(_processLogs) (272893) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:10,382::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:10,382::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:27:10,384::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:27:10,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000459544 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:27:10,539::__init__::225::IOProcess::(_processLogs) (272881) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:10,540::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:10,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:10,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:10,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:10,546::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:10,547::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:10,548::__init__::225::IOProcess::(_processLogs) (272894) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:10,550::__init__::225::IOProcess::(_processLogs) (272894) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:10,551::__init__::225::IOProcess::(_processLogs) (272894) Building response >Thread-18::DEBUG::2014-07-08 16:27:10,552::__init__::225::IOProcess::(_processLogs) (272894) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:10,553::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:10,554::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:27:10,565::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:10,566::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:27:10,568::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:10,569::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:10,570::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:10,572::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:10,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:10,575::__init__::225::IOProcess::(_processLogs) (272895) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:10,577::__init__::225::IOProcess::(_processLogs) (272895) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:10,579::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(272895) Building response >Thread-18::DEBUG::2014-07-08 16:27:10,580::__init__::225::IOProcess::(_processLogs) (272895) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:10,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:10,583::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:10,589::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:10,590::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:27:10,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:10,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:10,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:10,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:10,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:10,599::__init__::225::IOProcess::(_processLogs) (272896) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:10,601::__init__::225::IOProcess::(_processLogs) (272896) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:10,602::__init__::225::IOProcess::(_processLogs) (272896) Building response >Thread-18::DEBUG::2014-07-08 16:27:10,604::__init__::225::IOProcess::(_processLogs) (272896) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:10,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:10,606::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:10,612::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:10,614::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:27:10,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:10,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:10,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:10,619::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:10,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:10,623::__init__::225::IOProcess::(_processLogs) (272897) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:10,624::__init__::225::IOProcess::(_processLogs) (272897) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:10,626::__init__::225::IOProcess::(_processLogs) DEBUG|(272897) Building response >Thread-18::DEBUG::2014-07-08 16:27:10,627::__init__::225::IOProcess::(_processLogs) (272897) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:10,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:10,630::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:27:10,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:10,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174638 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:12,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:13,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173191 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:15,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:15,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174305 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:17,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:17,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0427393 s, 24.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:19,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:20,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173101 s, 59.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:27:20,188::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:27:20,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`79d230f5-5eaf-4f6b-af4b-e57e8b3625c0`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:20,190::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:27:20,205::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:20,206::task::1191::Storage.TaskManager.Task::(prepare) Task=`79d230f5-5eaf-4f6b-af4b-e57e8b3625c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:20,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`79d230f5-5eaf-4f6b-af4b-e57e8b3625c0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:20,206::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:20,206::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:20,207::task::993::Storage.TaskManager.Task::(_decref) Task=`79d230f5-5eaf-4f6b-af4b-e57e8b3625c0`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:27:20,217::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:27:20,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f61a68d-8a39-4a53-94c8-5b17ebcef6a9`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:27:20,219::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:27:20,220::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9b611614-4fe7-4351-ac2e-e3a186adc9b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:27:20,220::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:27:20,221::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:27:20,221::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9b611614-4fe7-4351-ac2e-e3a186adc9b6`::Granted request >Thread-6940::DEBUG::2014-07-08 16:27:20,222::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3f61a68d-8a39-4a53-94c8-5b17ebcef6a9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:27:20,222::task::993::Storage.TaskManager.Task::(_decref) Task=`3f61a68d-8a39-4a53-94c8-5b17ebcef6a9`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:27:20,241::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:20,241::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f61a68d-8a39-4a53-94c8-5b17ebcef6a9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:20,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f61a68d-8a39-4a53-94c8-5b17ebcef6a9`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:27:20,242::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:27:20,242::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:27:20,243::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:27:20,243::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:27:20,243::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:27:20,243::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:27:20,244::task::993::Storage.TaskManager.Task::(_decref) Task=`3f61a68d-8a39-4a53-94c8-5b17ebcef6a9`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:27:20,636::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:20,636::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:20,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:20,637::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:20,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:20,637::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:20,638::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:20,638::__init__::225::IOProcess::(_processLogs) (272898) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:20,638::__init__::225::IOProcess::(_processLogs) (272898) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:20,638::__init__::225::IOProcess::(_processLogs) (272898) Building response >Thread-18::DEBUG::2014-07-08 16:27:20,639::__init__::225::IOProcess::(_processLogs) (272898) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:20,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:20,639::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:27:20,641::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:27:20,787::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000673812 s, 686 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:27:20,793::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:20,796::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:20,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:20,800::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:20,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:20,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:20,805::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:20,807::__init__::225::IOProcess::(_processLogs) (272899) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:20,809::__init__::225::IOProcess::(_processLogs) DEBUG|(272899) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:20,810::__init__::225::IOProcess::(_processLogs) (272899) Building response >Thread-18::DEBUG::2014-07-08 16:27:20,812::__init__::225::IOProcess::(_processLogs) (272899) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:20,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:20,815::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:27:20,828::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:20,830::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:27:20,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:20,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:20,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:20,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:20,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:20,838::__init__::225::IOProcess::(_processLogs) (272900) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:20,839::__init__::225::IOProcess::(_processLogs) (272900) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:20,840::__init__::225::IOProcess::(_processLogs) (272900) Building response >Thread-18::DEBUG::2014-07-08 16:27:20,842::__init__::225::IOProcess::(_processLogs) (272900) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:20,843::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:27:20,845::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:20,850::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:20,852::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:27:20,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:20,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:20,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:20,857::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:20,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:20,860::__init__::225::IOProcess::(_processLogs) (272901) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:20,861::__init__::225::IOProcess::(_processLogs) (272901) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:20,862::__init__::225::IOProcess::(_processLogs) (272901) Building response >Thread-18::DEBUG::2014-07-08 16:27:20,864::__init__::225::IOProcess::(_processLogs) (272901) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:20,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:20,866::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:20,871::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:20,873::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:27:20,874::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:20,875::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:20,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:20,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:20,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:20,881::__init__::225::IOProcess::(_processLogs) (272902) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:20,882::__init__::225::IOProcess::(_processLogs) (272902) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:20,883::__init__::225::IOProcess::(_processLogs) (272902) Building response >Thread-18::DEBUG::2014-07-08 16:27:20,885::__init__::225::IOProcess::(_processLogs) (272902) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:20,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:20,887::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:27:22,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:27:22,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`9be1d3b6-3158-4b85-8b90-d69516735abe`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:22,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:27:22,321::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673812', 'lastCheck': '1.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:27:22,323::task::1191::Storage.TaskManager.Task::(prepare) Task=`9be1d3b6-3158-4b85-8b90-d69516735abe`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673812', 'lastCheck': '1.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:27:22,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`9be1d3b6-3158-4b85-8b90-d69516735abe`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:22,325::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:22,326::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:22,327::task::993::Storage.TaskManager.Task::(_decref) Task=`9be1d3b6-3158-4b85-8b90-d69516735abe`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:27:22,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458477 s, 22.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:24,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:24,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176345 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:26,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:26,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018748 s, 54.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:29,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:29,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177032 s, 57.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:27:30,256::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:27:30,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`da7831c2-23f6-4e2b-9364-5de4e6bbbaa6`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:30,258::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:27:30,273::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:30,273::task::1191::Storage.TaskManager.Task::(prepare) Task=`da7831c2-23f6-4e2b-9364-5de4e6bbbaa6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:30,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`da7831c2-23f6-4e2b-9364-5de4e6bbbaa6`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:30,274::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:30,274::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:30,274::task::993::Storage.TaskManager.Task::(_decref) Task=`da7831c2-23f6-4e2b-9364-5de4e6bbbaa6`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:27:30,287::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:27:30,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`874fead1-6c59-47ce-853c-a6f62e93612a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:27:30,289::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:27:30,290::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3ac5d9ed-5e5d-4a41-a66d-d9da97b2c142`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:27:30,290::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:27:30,290::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:27:30,291::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3ac5d9ed-5e5d-4a41-a66d-d9da97b2c142`::Granted request >Thread-6940::DEBUG::2014-07-08 16:27:30,291::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`874fead1-6c59-47ce-853c-a6f62e93612a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:27:30,292::task::993::Storage.TaskManager.Task::(_decref) Task=`874fead1-6c59-47ce-853c-a6f62e93612a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:27:30,311::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:30,311::task::1191::Storage.TaskManager.Task::(prepare) Task=`874fead1-6c59-47ce-853c-a6f62e93612a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:30,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`874fead1-6c59-47ce-853c-a6f62e93612a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:27:30,312::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:27:30,312::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:27:30,313::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:27:30,313::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:27:30,313::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:27:30,313::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:27:30,314::task::993::Storage.TaskManager.Task::(_decref) Task=`874fead1-6c59-47ce-853c-a6f62e93612a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:27:30,893::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:30,893::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:30,894::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:30,894::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:30,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:30,894::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:30,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:30,895::__init__::225::IOProcess::(_processLogs) (272903) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:30,895::__init__::225::IOProcess::(_processLogs) (272903) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:30,895::__init__::225::IOProcess::(_processLogs) (272903) Building response >Thread-18::DEBUG::2014-07-08 16:27:30,896::__init__::225::IOProcess::(_processLogs) (272903) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:30,896::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:30,896::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:27:30,898::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:27:31,046::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000789466 s, 585 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:27:31,052::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:31,053::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:31,054::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:31,055::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:31,057::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:31,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:31,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:31,061::__init__::225::IOProcess::(_processLogs) (272904) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:31,062::__init__::225::IOProcess::(_processLogs) (272904) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:31,063::__init__::225::IOProcess::(_processLogs) (272904) Building response >Thread-18::DEBUG::2014-07-08 16:27:31,065::__init__::225::IOProcess::(_processLogs) (272904) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:31,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:31,066::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:27:31,075::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:31,076::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:27:31,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:31,079::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:31,081::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:31,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:31,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:31,085::__init__::225::IOProcess::(_processLogs) (272905) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:31,086::__init__::225::IOProcess::(_processLogs) (272905) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:31,088::__init__::225::IOProcess::(_processLogs) (272905) Building response >Thread-18::DEBUG::2014-07-08 16:27:31,089::__init__::225::IOProcess::(_processLogs) (272905) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:31,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:31,092::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:31,097::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:27:31,099::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:31,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:31,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:31,104::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:31,105::__init__::225::IOProcess::(_processLogs) (272906) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:31,106::__init__::225::IOProcess::(_processLogs) (272906) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:31,108::__init__::225::IOProcess::(_processLogs) (272906) Building response >Thread-18::DEBUG::2014-07-08 16:27:31,109::__init__::225::IOProcess::(_processLogs) (272906) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:31,110::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:31,112::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:31,118::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:27:31,119::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:31,120::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:31,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:31,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:31,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:31,131::__init__::225::IOProcess::(_processLogs) (272907) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:31,133::__init__::225::IOProcess::(_processLogs) (272907) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:31,134::__init__::225::IOProcess::(_processLogs) (272907) Building response >Thread-18::DEBUG::2014-07-08 16:27:31,136::__init__::225::IOProcess::(_processLogs) (272907) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:31,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:31,139::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:27:31,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:31,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176015 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:33,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:33,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176395 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:35,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:36,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0228615 s, 44.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:27:37,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`2278a738-8dde-47df-9b94-73cfd09499fb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:37,590::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:27:37,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789466', 'lastCheck': '6.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:27:37,590::task::1191::Storage.TaskManager.Task::(prepare) Task=`2278a738-8dde-47df-9b94-73cfd09499fb`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789466', 'lastCheck': '6.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:27:37,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`2278a738-8dde-47df-9b94-73cfd09499fb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:37,591::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:37,591::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:37,591::task::993::Storage.TaskManager.Task::(_decref) Task=`2278a738-8dde-47df-9b94-73cfd09499fb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:27:38,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:38,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.136923 s, 7.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:27:40,327::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:27:40,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5c34c80-15e2-45f7-b75d-1fa9c76c40ac`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:40,329::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:27:40,346::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:40,346::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5c34c80-15e2-45f7-b75d-1fa9c76c40ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:40,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5c34c80-15e2-45f7-b75d-1fa9c76c40ac`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:40,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:40,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:40,347::task::993::Storage.TaskManager.Task::(_decref) Task=`b5c34c80-15e2-45f7-b75d-1fa9c76c40ac`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:27:40,359::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:27:40,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd681ef9-ae28-4c91-9101-5bda10609cd3`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:27:40,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:27:40,362::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`088e36da-5623-41a7-899f-d8d635f62200`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:27:40,362::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:27:40,362::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:27:40,363::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`088e36da-5623-41a7-899f-d8d635f62200`::Granted request >Thread-6940::DEBUG::2014-07-08 16:27:40,363::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dd681ef9-ae28-4c91-9101-5bda10609cd3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:27:40,364::task::993::Storage.TaskManager.Task::(_decref) Task=`dd681ef9-ae28-4c91-9101-5bda10609cd3`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:27:40,382::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:40,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd681ef9-ae28-4c91-9101-5bda10609cd3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:40,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd681ef9-ae28-4c91-9101-5bda10609cd3`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:27:40,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:27:40,384::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:27:40,384::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:27:40,384::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:27:40,385::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:27:40,385::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:27:40,385::task::993::Storage.TaskManager.Task::(_decref) Task=`dd681ef9-ae28-4c91-9101-5bda10609cd3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:27:40,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:40,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017273 s, 59.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:27:41,146::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:41,147::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:41,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:41,149::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:41,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:41,149::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:41,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:41,150::__init__::225::IOProcess::(_processLogs) (272908) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:41,150::__init__::225::IOProcess::(_processLogs) (272908) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:41,150::__init__::225::IOProcess::(_processLogs) (272908) Building response >Thread-18::DEBUG::2014-07-08 16:27:41,150::__init__::225::IOProcess::(_processLogs) (272908) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:41,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:41,151::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:27:41,152::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:27:41,301::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000421831 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:27:41,307::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:41,309::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:41,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:41,312::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:41,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:41,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:41,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:41,318::__init__::225::IOProcess::(_processLogs) (272909) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:41,319::__init__::225::IOProcess::(_processLogs) (272909) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:41,321::__init__::225::IOProcess::(_processLogs) (272909) Building response >Thread-18::DEBUG::2014-07-08 16:27:41,322::__init__::225::IOProcess::(_processLogs) (272909) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:41,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:41,325::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:27:41,334::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:41,336::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:27:41,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:41,339::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:41,340::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:41,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:41,344::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:41,346::__init__::225::IOProcess::(_processLogs) (272910) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:41,347::__init__::225::IOProcess::(_processLogs) (272910) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:41,349::__init__::225::IOProcess::(_processLogs) (272910) Building response >Thread-18::DEBUG::2014-07-08 16:27:41,351::__init__::225::IOProcess::(_processLogs) (272910) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:41,352::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:41,354::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:41,359::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:41,361::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:27:41,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:41,364::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:41,366::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:41,368::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:41,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:41,370::__init__::225::IOProcess::(_processLogs) (272911) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:41,372::__init__::225::IOProcess::(_processLogs) (272911) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:41,373::__init__::225::IOProcess::(_processLogs) (272911) Building response >Thread-18::DEBUG::2014-07-08 16:27:41,375::__init__::225::IOProcess::(_processLogs) (272911) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:41,376::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:41,378::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:41,383::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:27:41,384::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:27:41,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:41,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:41,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:41,391::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:41,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:41,394::__init__::225::IOProcess::(_processLogs) (272912) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:41,395::__init__::225::IOProcess::(_processLogs) (272912) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:41,397::__init__::225::IOProcess::(_processLogs) (272912) Building response >Thread-18::DEBUG::2014-07-08 16:27:41,398::__init__::225::IOProcess::(_processLogs) (272912) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:41,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:41,401::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:27:42,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:43,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176079 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:45,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:45,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017651 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:47,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:47,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173945 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:49,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:49,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177021 s, 57.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:27:50,398::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:27:50,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`66c8fa78-3133-4d59-b878-d563c3b74fc7`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:50,400::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:27:50,415::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:50,416::task::1191::Storage.TaskManager.Task::(prepare) Task=`66c8fa78-3133-4d59-b878-d563c3b74fc7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:27:50,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`66c8fa78-3133-4d59-b878-d563c3b74fc7`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:50,416::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:50,417::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:50,417::task::993::Storage.TaskManager.Task::(_decref) Task=`66c8fa78-3133-4d59-b878-d563c3b74fc7`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:27:50,428::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:27:50,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`68665ec7-6a84-4cd6-9b9f-1276311852eb`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:27:50,429::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:27:50,430::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c4a04ae1-a21f-41e8-a98a-dbdb016d5933`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:27:50,430::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:27:50,431::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:27:50,431::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c4a04ae1-a21f-41e8-a98a-dbdb016d5933`::Granted request >Thread-6940::DEBUG::2014-07-08 16:27:50,432::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`68665ec7-6a84-4cd6-9b9f-1276311852eb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:27:50,432::task::993::Storage.TaskManager.Task::(_decref) Task=`68665ec7-6a84-4cd6-9b9f-1276311852eb`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:27:50,451::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:50,452::task::1191::Storage.TaskManager.Task::(prepare) Task=`68665ec7-6a84-4cd6-9b9f-1276311852eb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:27:50,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`68665ec7-6a84-4cd6-9b9f-1276311852eb`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:27:50,452::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:27:50,452::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:27:50,453::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:27:50,453::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:27:50,453::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:27:50,454::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:27:50,454::task::993::Storage.TaskManager.Task::(_decref) Task=`68665ec7-6a84-4cd6-9b9f-1276311852eb`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:27:51,407::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:51,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:51,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:51,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:51,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:51,408::__init__::225::IOProcess::(_processLogs) (272913) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:51,409::__init__::225::IOProcess::(_processLogs) (272913) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:51,409::__init__::225::IOProcess::(_processLogs) (272913) Building response >Thread-18::DEBUG::2014-07-08 16:27:51,409::__init__::225::IOProcess::(_processLogs) (272913) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:51,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:51,410::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:27:51,411::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:27:51,566::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00858523 s, 53.8 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:27:51,571::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:27:51,572::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:51,573::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:51,574::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:51,575::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:51,577::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:51,578::__init__::225::IOProcess::(_processLogs) (272914) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:27:51,579::__init__::225::IOProcess::(_processLogs) (272914) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:27:51,581::__init__::225::IOProcess::(_processLogs) (272914) Building response >Thread-18::DEBUG::2014-07-08 16:27:51,582::__init__::225::IOProcess::(_processLogs) (272914) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:51,584::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:51,585::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:27:51,594::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:27:51,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:51,596::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:51,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:51,600::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:51,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:51,602::__init__::225::IOProcess::(_processLogs) (272915) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:51,603::__init__::225::IOProcess::(_processLogs) (272915) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:51,605::__init__::225::IOProcess::(_processLogs) (272915) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:51,607::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:51,608::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:51,613::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:27:51,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:51,616::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:51,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:51,619::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:51,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:51,622::__init__::225::IOProcess::(_processLogs) (272916) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:51,624::__init__::225::IOProcess::(_processLogs) (272916) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:51,625::__init__::225::IOProcess::(_processLogs) (272916) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:51,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:51,628::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:27:51,634::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:27:51,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:27:51,638::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:27:51,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:27:51,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:27:51,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:27:51,643::__init__::225::IOProcess::(_processLogs) (272917) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:27:51,645::__init__::225::IOProcess::(_processLogs) (272917) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:27:51,647::__init__::225::IOProcess::(_processLogs) (272917) Queuing response >Thread-18::DEBUG::2014-07-08 16:27:51,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:27:51,650::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:27:51,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:52,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179731 s, 57.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:27:52,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`894ac80b-535d-45d3-95a9-b998f78af810`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:27:52,869::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:27:52,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00858523', 'lastCheck': '1.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:27:52,870::task::1191::Storage.TaskManager.Task::(prepare) Task=`894ac80b-535d-45d3-95a9-b998f78af810`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00858523', 'lastCheck': '1.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:27:52,870::task::595::Storage.TaskManager.Task::(_updateState) Task=`894ac80b-535d-45d3-95a9-b998f78af810`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:27:52,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:27:52,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:27:52,871::task::993::Storage.TaskManager.Task::(_decref) Task=`894ac80b-535d-45d3-95a9-b998f78af810`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:27:54,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:54,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180401 s, 56.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:56,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:56,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175001 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:27:58,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:27:58,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175839 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:28:00,467::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:28:00,468::task::595::Storage.TaskManager.Task::(_updateState) Task=`b838e816-f316-479e-8ea4-513e3f97100f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:00,469::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:28:00,484::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:00,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`b838e816-f316-479e-8ea4-513e3f97100f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:00,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`b838e816-f316-479e-8ea4-513e3f97100f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:00,485::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:00,485::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:00,485::task::993::Storage.TaskManager.Task::(_decref) Task=`b838e816-f316-479e-8ea4-513e3f97100f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:28:00,497::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:28:00,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fe9f161-51f4-4ded-bd21-5c5fab461d95`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:28:00,498::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:28:00,499::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f4140126-65b7-4960-b7f7-43bdf735adfe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:28:00,499::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:28:00,500::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:28:00,500::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f4140126-65b7-4960-b7f7-43bdf735adfe`::Granted request >Thread-6940::DEBUG::2014-07-08 16:28:00,501::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9fe9f161-51f4-4ded-bd21-5c5fab461d95`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:28:00,501::task::993::Storage.TaskManager.Task::(_decref) Task=`9fe9f161-51f4-4ded-bd21-5c5fab461d95`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:28:00,520::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:00,521::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fe9f161-51f4-4ded-bd21-5c5fab461d95`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:00,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fe9f161-51f4-4ded-bd21-5c5fab461d95`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:28:00,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:28:00,521::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:28:00,522::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:28:00,522::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:28:00,522::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:28:00,523::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:28:00,523::task::993::Storage.TaskManager.Task::(_decref) Task=`9fe9f161-51f4-4ded-bd21-5c5fab461d95`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:28:01,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:01,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174808 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:01,657::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:01,657::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:01,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:01,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:01,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:01,658::__init__::225::IOProcess::(_processLogs) (272918) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:01,658::__init__::225::IOProcess::(_processLogs) (272918) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:01,659::__init__::225::IOProcess::(_processLogs) (272918) Building response >Thread-18::DEBUG::2014-07-08 16:28:01,659::__init__::225::IOProcess::(_processLogs) (272918) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:01,659::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:01,659::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:28:01,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:28:01,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000412053 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:01,816::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:01,818::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:01,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:01,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:01,821::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:01,823::__init__::225::IOProcess::(_processLogs) (272919) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:01,824::__init__::225::IOProcess::(_processLogs) (272919) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:01,825::__init__::225::IOProcess::(_processLogs) (272919) Building response >Thread-18::DEBUG::2014-07-08 16:28:01,826::__init__::225::IOProcess::(_processLogs) (272919) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:01,828::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:01,829::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:28:01,837::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:28:01,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:01,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:01,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:01,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:01,848::__init__::225::IOProcess::(_processLogs) (272920) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:01,849::__init__::225::IOProcess::(_processLogs) (272920) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:01,851::__init__::225::IOProcess::(_processLogs) (272920) Building response >Thread-18::DEBUG::2014-07-08 16:28:01,852::__init__::225::IOProcess::(_processLogs) (272920) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:01,854::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:01,855::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:01,861::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:28:01,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:01,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:01,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:01,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:01,867::__init__::225::IOProcess::(_processLogs) (272921) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:01,869::__init__::225::IOProcess::(_processLogs) (272921) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:01,870::__init__::225::IOProcess::(_processLogs) (272921) Building response >Thread-18::DEBUG::2014-07-08 16:28:01,871::__init__::225::IOProcess::(_processLogs) (272921) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:01,872::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:01,874::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:01,878::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:28:01,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:01,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:01,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:01,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:01,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:01,886::__init__::225::IOProcess::(_processLogs) (272922) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:01,887::__init__::225::IOProcess::(_processLogs) (272922) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:01,888::__init__::225::IOProcess::(_processLogs) (272922) Building response >Thread-18::DEBUG::2014-07-08 16:28:01,889::__init__::225::IOProcess::(_processLogs) (272922) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:01,891::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:28:03,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:03,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180189 s, 56.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:05,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:05,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174931 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:07,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:28:08,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`36501b03-328c-4984-9a79-051be9d32ded`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:08,065::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:28:08,067::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412053', 'lastCheck': '6.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:28:08,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`36501b03-328c-4984-9a79-051be9d32ded`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412053', 'lastCheck': '6.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:28:08,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`36501b03-328c-4984-9a79-051be9d32ded`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:08,071::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:08,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:08,073::task::993::Storage.TaskManager.Task::(_decref) Task=`36501b03-328c-4984-9a79-051be9d32ded`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:28:08,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465701 s, 22.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:10,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:10,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176627 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:28:10,537::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:28:10,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b353f4c-2683-45a1-9c6a-4b5669c1d219`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:10,539::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:28:10,554::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:10,554::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b353f4c-2683-45a1-9c6a-4b5669c1d219`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:10,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b353f4c-2683-45a1-9c6a-4b5669c1d219`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:10,555::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:10,555::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:10,555::task::993::Storage.TaskManager.Task::(_decref) Task=`3b353f4c-2683-45a1-9c6a-4b5669c1d219`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:28:10,567::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:28:10,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0e33bae-5182-40ca-974f-b55b08be6e9d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:28:10,568::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:28:10,569::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bb28071c-5403-450a-b186-d9ddc688b73e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:28:10,570::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:28:10,570::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:28:10,570::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bb28071c-5403-450a-b186-d9ddc688b73e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:28:10,571::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b0e33bae-5182-40ca-974f-b55b08be6e9d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:28:10,571::task::993::Storage.TaskManager.Task::(_decref) Task=`b0e33bae-5182-40ca-974f-b55b08be6e9d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:28:10,592::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:10,592::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0e33bae-5182-40ca-974f-b55b08be6e9d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:10,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0e33bae-5182-40ca-974f-b55b08be6e9d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:28:10,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:28:10,593::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:28:10,593::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:28:10,594::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:28:10,594::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:28:10,594::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:28:10,594::task::993::Storage.TaskManager.Task::(_decref) Task=`b0e33bae-5182-40ca-974f-b55b08be6e9d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:28:11,896::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:11,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:11,896::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:11,897::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:11,897::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:11,897::__init__::225::IOProcess::(_processLogs) (272923) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:11,898::__init__::225::IOProcess::(_processLogs) (272923) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:11,898::__init__::225::IOProcess::(_processLogs) (272923) Building response >Thread-18::DEBUG::2014-07-08 16:28:11,898::__init__::225::IOProcess::(_processLogs) (272923) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:11,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:11,899::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:28:11,900::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:28:12,061::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000524354 s, 881 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:12,076::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:12,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:12,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:12,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:12,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:12,078::__init__::225::IOProcess::(_processLogs) (272924) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:12,078::__init__::225::IOProcess::(_processLogs) (272924) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:12,078::__init__::225::IOProcess::(_processLogs) (272924) Building response >Thread-18::DEBUG::2014-07-08 16:28:12,078::__init__::225::IOProcess::(_processLogs) (272924) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:12,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:12,079::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:28:12,084::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:28:12,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:12,085::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:12,085::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:12,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:12,086::__init__::225::IOProcess::(_processLogs) (272925) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:12,086::__init__::225::IOProcess::(_processLogs) (272925) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:12,086::__init__::225::IOProcess::(_processLogs) (272925) Building response >Thread-18::DEBUG::2014-07-08 16:28:12,086::__init__::225::IOProcess::(_processLogs) (272925) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:12,087::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:12,087::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:12,089::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:28:12,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:12,090::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:12,091::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:12,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:12,092::__init__::225::IOProcess::(_processLogs) (272926) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:12,092::__init__::225::IOProcess::(_processLogs) (272926) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:12,092::__init__::225::IOProcess::(_processLogs) (272926) Building response >Thread-18::DEBUG::2014-07-08 16:28:12,093::__init__::225::IOProcess::(_processLogs) (272926) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:12,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:12,093::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:12,096::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:28:12,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:12,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:12,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:12,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:12,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:12,098::__init__::225::IOProcess::(_processLogs) (272927) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:12,099::__init__::225::IOProcess::(_processLogs) (272927) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:12,099::__init__::225::IOProcess::(_processLogs) (272927) Building response >Thread-18::DEBUG::2014-07-08 16:28:12,100::__init__::225::IOProcess::(_processLogs) (272927) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:12,100::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:12,100::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:28:12,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:12,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173481 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:14,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:14,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171892 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:17,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:17,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325768 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:19,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:19,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0221098 s, 46.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:28:20,609::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:28:20,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`87626b15-c5a7-4a28-a6a3-34e06b13f716`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:20,610::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:28:20,625::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:20,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`87626b15-c5a7-4a28-a6a3-34e06b13f716`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:20,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`87626b15-c5a7-4a28-a6a3-34e06b13f716`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:20,626::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:20,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:20,627::task::993::Storage.TaskManager.Task::(_decref) Task=`87626b15-c5a7-4a28-a6a3-34e06b13f716`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:28:20,638::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:28:20,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`3935ccd6-cf8f-4934-b1a5-e0ffa658015d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:28:20,640::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:28:20,641::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`67f32c08-62cb-4a3b-93f8-cebc602c43f6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:28:20,641::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:28:20,641::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:28:20,642::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`67f32c08-62cb-4a3b-93f8-cebc602c43f6`::Granted request >Thread-6940::DEBUG::2014-07-08 16:28:20,642::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3935ccd6-cf8f-4934-b1a5-e0ffa658015d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:28:20,643::task::993::Storage.TaskManager.Task::(_decref) Task=`3935ccd6-cf8f-4934-b1a5-e0ffa658015d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:28:20,662::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:20,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`3935ccd6-cf8f-4934-b1a5-e0ffa658015d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:20,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`3935ccd6-cf8f-4934-b1a5-e0ffa658015d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:28:20,663::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:28:20,663::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:28:20,663::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:28:20,664::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:28:20,664::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:28:20,664::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:28:20,665::task::993::Storage.TaskManager.Task::(_decref) Task=`3935ccd6-cf8f-4934-b1a5-e0ffa658015d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:28:21,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:21,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173238 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:22,104::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:22,105::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:22,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:22,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:22,106::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:22,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:22,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:22,107::__init__::225::IOProcess::(_processLogs) (272928) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:22,107::__init__::225::IOProcess::(_processLogs) (272928) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:22,107::__init__::225::IOProcess::(_processLogs) (272928) Building response >Thread-18::DEBUG::2014-07-08 16:28:22,107::__init__::225::IOProcess::(_processLogs) (272928) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:22,108::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:22,108::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:28:22,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:28:22,261::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000484127 s, 954 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:22,267::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:22,269::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:22,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:22,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:22,273::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:22,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:22,277::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:22,278::__init__::225::IOProcess::(_processLogs) (272929) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:22,279::__init__::225::IOProcess::(_processLogs) (272929) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:22,282::__init__::225::IOProcess::(_processLogs) DEBUG|(272929) Building response >Thread-18::DEBUG::2014-07-08 16:28:22,284::__init__::225::IOProcess::(_processLogs) (272929) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:22,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:22,287::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:28:22,296::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:22,298::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:28:22,300::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:22,301::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:22,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:22,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:22,306::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:22,308::__init__::225::IOProcess::(_processLogs) (272930) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:22,309::__init__::225::IOProcess::(_processLogs) (272930) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:22,311::__init__::225::IOProcess::(_processLogs) (272930) Building response >Thread-18::DEBUG::2014-07-08 16:28:22,312::__init__::225::IOProcess::(_processLogs) (272930) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:22,314::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:22,315::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:22,321::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:22,322::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:28:22,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:22,325::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:22,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:22,328::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:22,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:22,331::__init__::225::IOProcess::(_processLogs) (272931) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:22,333::__init__::225::IOProcess::(_processLogs) (272931) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:22,334::__init__::225::IOProcess::(_processLogs) (272931) Building response >Thread-18::DEBUG::2014-07-08 16:28:22,335::__init__::225::IOProcess::(_processLogs) (272931) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:22,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:22,339::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:22,344::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:22,345::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:28:22,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:22,349::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:22,350::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:22,351::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:22,352::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:22,354::__init__::225::IOProcess::(_processLogs) (272932) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:22,355::__init__::225::IOProcess::(_processLogs) (272932) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:22,357::__init__::225::IOProcess::(_processLogs) (272932) Building response >Thread-18::DEBUG::2014-07-08 16:28:22,358::__init__::225::IOProcess::(_processLogs) (272932) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:22,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:22,364::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:28:23,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe27079a-395f-4704-8722-b1f78c5574ec`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:23,322::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:28:23,322::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484127', 'lastCheck': '1.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:28:23,323::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe27079a-395f-4704-8722-b1f78c5574ec`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484127', 'lastCheck': '1.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:28:23,323::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe27079a-395f-4704-8722-b1f78c5574ec`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:23,323::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:23,323::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:23,324::task::993::Storage.TaskManager.Task::(_decref) Task=`fe27079a-395f-4704-8722-b1f78c5574ec`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:28:23,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:24,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176144 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:26,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:26,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017628 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:28,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:28,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173875 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:30,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:28:30,681::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:28:30,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ac59581-e3b7-4896-8734-9abddc97cd44`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:30,833::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:28:30,856::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:30,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ac59581-e3b7-4896-8734-9abddc97cd44`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:30,859::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ac59581-e3b7-4896-8734-9abddc97cd44`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:30,862::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:30,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:30,943::task::993::Storage.TaskManager.Task::(_decref) Task=`5ac59581-e3b7-4896-8734-9abddc97cd44`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:28:30,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252559 s, 40.5 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:28:30,958::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:28:30,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcb26066-fcb8-4631-a704-19da9b65e53d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:28:30,961::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:28:30,964::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ec5dea2d-4898-43d8-90e7-4d8a8911c8b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:28:30,965::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:28:30,967::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:28:30,968::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ec5dea2d-4898-43d8-90e7-4d8a8911c8b0`::Granted request >Thread-6940::DEBUG::2014-07-08 16:28:30,970::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bcb26066-fcb8-4631-a704-19da9b65e53d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:28:30,971::task::993::Storage.TaskManager.Task::(_decref) Task=`bcb26066-fcb8-4631-a704-19da9b65e53d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:28:31,000::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:31,000::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcb26066-fcb8-4631-a704-19da9b65e53d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:31,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcb26066-fcb8-4631-a704-19da9b65e53d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:28:31,001::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:28:31,001::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:28:31,002::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:28:31,002::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:28:31,002::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:28:31,003::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:28:31,003::task::993::Storage.TaskManager.Task::(_decref) Task=`bcb26066-fcb8-4631-a704-19da9b65e53d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:28:32,371::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:32,371::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:32,371::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:32,372::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:32,372::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:32,372::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:32,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:32,373::__init__::225::IOProcess::(_processLogs) (272933) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:32,373::__init__::225::IOProcess::(_processLogs) (272933) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:32,373::__init__::225::IOProcess::(_processLogs) (272933) Building response >Thread-18::DEBUG::2014-07-08 16:28:32,374::__init__::225::IOProcess::(_processLogs) (272933) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:32,374::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:32,374::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:28:32,376::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:28:32,528::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000558436 s, 827 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:32,540::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:32,544::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:32,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:32,546::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:32,548::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:32,549::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:32,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:32,552::__init__::225::IOProcess::(_processLogs) (272934) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:32,554::__init__::225::IOProcess::(_processLogs) (272934) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:32,555::__init__::225::IOProcess::(_processLogs) DEBUG|(272934) Building response >Thread-18::DEBUG::2014-07-08 16:28:32,556::__init__::225::IOProcess::(_processLogs) (272934) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:32,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:32,560::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:28:32,570::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:32,571::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:28:32,573::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:32,574::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:32,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:32,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:32,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:32,581::__init__::225::IOProcess::(_processLogs) DEBUG|(272935) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:32,583::__init__::225::IOProcess::(_processLogs) (272935) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:32,585::__init__::225::IOProcess::(_processLogs) (272935) Building response >Thread-18::DEBUG::2014-07-08 16:28:32,586::__init__::225::IOProcess::(_processLogs) (272935) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:32,588::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:32,589::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:32,595::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:32,597::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:28:32,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:32,601::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:32,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:32,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:32,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:32,607::__init__::225::IOProcess::(_processLogs) (272936) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:32,609::__init__::225::IOProcess::(_processLogs) (272936) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:32,610::__init__::225::IOProcess::(_processLogs) (272936) Building response >Thread-18::DEBUG::2014-07-08 16:28:32,612::__init__::225::IOProcess::(_processLogs) (272936) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:32,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:32,615::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:32,621::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:32,623::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:28:32,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:32,626::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:32,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:32,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:32,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:32,632::__init__::225::IOProcess::(_processLogs) (272937) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:32,633::__init__::225::IOProcess::(_processLogs) (272937) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:32,634::__init__::225::IOProcess::(_processLogs) (272937) Building response >Thread-18::DEBUG::2014-07-08 16:28:32,636::__init__::225::IOProcess::(_processLogs) (272937) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:32,637::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:32,639::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:28:32,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:33,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0214932 s, 47.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:35,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:35,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417196 s, 24.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:37,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:37,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174219 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:28:38,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`569d5934-8cdd-459c-a99d-a115fbcfb15f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:38,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:28:38,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558436', 'lastCheck': '5.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:28:38,590::task::1191::Storage.TaskManager.Task::(prepare) Task=`569d5934-8cdd-459c-a99d-a115fbcfb15f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558436', 'lastCheck': '5.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:28:38,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`569d5934-8cdd-459c-a99d-a115fbcfb15f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:38,590::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:38,590::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:38,591::task::993::Storage.TaskManager.Task::(_decref) Task=`569d5934-8cdd-459c-a99d-a115fbcfb15f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:28:39,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:40,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173682 s, 59.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:28:41,016::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:28:41,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`43f3e1fe-b00a-4580-9019-1cd3580f76c9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:41,018::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:28:41,033::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:41,033::task::1191::Storage.TaskManager.Task::(prepare) Task=`43f3e1fe-b00a-4580-9019-1cd3580f76c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:41,033::task::595::Storage.TaskManager.Task::(_updateState) Task=`43f3e1fe-b00a-4580-9019-1cd3580f76c9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:41,034::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:41,034::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:41,034::task::993::Storage.TaskManager.Task::(_decref) Task=`43f3e1fe-b00a-4580-9019-1cd3580f76c9`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:28:41,045::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:28:41,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bf16541-f9ca-4285-b6d0-1accfc493680`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:28:41,047::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:28:41,048::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`647b8ee2-2fad-4e4c-93bf-6096aba76d1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:28:41,048::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:28:41,049::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:28:41,049::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`647b8ee2-2fad-4e4c-93bf-6096aba76d1a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:28:41,050::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6bf16541-f9ca-4285-b6d0-1accfc493680`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:28:41,050::task::993::Storage.TaskManager.Task::(_decref) Task=`6bf16541-f9ca-4285-b6d0-1accfc493680`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:28:41,069::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:41,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`6bf16541-f9ca-4285-b6d0-1accfc493680`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:41,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bf16541-f9ca-4285-b6d0-1accfc493680`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:28:41,070::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:28:41,070::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:28:41,070::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:28:41,071::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:28:41,071::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:28:41,071::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:28:41,072::task::993::Storage.TaskManager.Task::(_decref) Task=`6bf16541-f9ca-4285-b6d0-1accfc493680`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:28:42,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:42,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0209658 s, 48.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:42,645::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:42,646::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:42,646::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:42,646::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:42,646::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:42,647::__init__::225::IOProcess::(_processLogs) (272938) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:42,647::__init__::225::IOProcess::(_processLogs) (272938) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:42,647::__init__::225::IOProcess::(_processLogs) (272938) Building response >Thread-18::DEBUG::2014-07-08 16:28:42,647::__init__::225::IOProcess::(_processLogs) (272938) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:42,647::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:42,648::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:28:42,649::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:28:42,801::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00335677 s, 138 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:42,806::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:42,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:42,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:42,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:42,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:42,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:42,814::__init__::225::IOProcess::(_processLogs) (272939) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:42,815::__init__::225::IOProcess::(_processLogs) (272939) Building response >Thread-18::DEBUG::2014-07-08 16:28:42,816::__init__::225::IOProcess::(_processLogs) (272939) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:42,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:42,819::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:28:42,827::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:28:42,828::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:42,829::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:42,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:42,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:42,833::__init__::225::IOProcess::(_processLogs) (272940) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:42,834::__init__::225::IOProcess::(_processLogs) (272940) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:42,835::__init__::225::IOProcess::(_processLogs) (272940) Building response >Thread-18::DEBUG::2014-07-08 16:28:42,837::__init__::225::IOProcess::(_processLogs) (272940) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:42,839::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:42,840::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:42,844::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:28:42,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:42,848::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:42,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:42,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:42,851::__init__::225::IOProcess::(_processLogs) (272941) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:42,852::__init__::225::IOProcess::(_processLogs) (272941) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:42,854::__init__::225::IOProcess::(_processLogs) (272941) Building response >Thread-18::DEBUG::2014-07-08 16:28:42,855::__init__::225::IOProcess::(_processLogs) (272941) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:42,856::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:42,857::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:42,862::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:28:42,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:42,865::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:42,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:42,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:42,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:42,870::__init__::225::IOProcess::(_processLogs) (272942) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:42,872::__init__::225::IOProcess::(_processLogs) (272942) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:42,873::__init__::225::IOProcess::(_processLogs) (272942) Building response >Thread-18::DEBUG::2014-07-08 16:28:42,874::__init__::225::IOProcess::(_processLogs) (272942) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:42,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:42,877::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:28:44,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:44,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174107 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:46,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:46,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178135 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:48,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:49,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174663 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:28:51,084::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:28:51,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`386f348f-bbcf-49a1-8117-0e7a51c33e20`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:51,087::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:28:51,103::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:51,103::task::1191::Storage.TaskManager.Task::(prepare) Task=`386f348f-bbcf-49a1-8117-0e7a51c33e20`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:28:51,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`386f348f-bbcf-49a1-8117-0e7a51c33e20`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:51,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:51,104::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:51,104::task::993::Storage.TaskManager.Task::(_decref) Task=`386f348f-bbcf-49a1-8117-0e7a51c33e20`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:28:51,116::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:28:51,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f0fd39c-47b8-46fc-80f5-b0eb8041615f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:28:51,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:28:51,118::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4fe5bba6-26f0-48a3-90a9-6dbc155b58b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:28:51,118::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:28:51,119::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:28:51,119::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4fe5bba6-26f0-48a3-90a9-6dbc155b58b0`::Granted request >Thread-6940::DEBUG::2014-07-08 16:28:51,120::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2f0fd39c-47b8-46fc-80f5-b0eb8041615f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:28:51,120::task::993::Storage.TaskManager.Task::(_decref) Task=`2f0fd39c-47b8-46fc-80f5-b0eb8041615f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:28:51,139::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:51,140::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f0fd39c-47b8-46fc-80f5-b0eb8041615f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:28:51,140::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f0fd39c-47b8-46fc-80f5-b0eb8041615f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:28:51,140::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:28:51,141::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:28:51,141::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:28:51,141::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:28:51,142::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:28:51,142::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:28:51,142::task::993::Storage.TaskManager.Task::(_decref) Task=`2f0fd39c-47b8-46fc-80f5-b0eb8041615f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:28:51,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:51,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211806 s, 48.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:52,883::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:52,883::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:52,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:52,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:52,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:52,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:52,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:52,885::__init__::225::IOProcess::(_processLogs) (272943) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:52,885::__init__::225::IOProcess::(_processLogs) (272943) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:52,885::__init__::225::IOProcess::(_processLogs) (272943) Building response >Thread-18::DEBUG::2014-07-08 16:28:52,885::__init__::225::IOProcess::(_processLogs) (272943) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:52,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:52,886::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:28:52,887::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:28:53,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000572124 s, 808 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:28:53,045::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:28:53,046::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:53,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:53,049::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:53,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:53,051::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:53,053::__init__::225::IOProcess::(_processLogs) (272944) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:28:53,054::__init__::225::IOProcess::(_processLogs) (272944) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:28:53,056::__init__::225::IOProcess::(_processLogs) (272944) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:53,057::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:53,058::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:28:53,070::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:28:53,072::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:53,073::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:53,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:53,075::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:53,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:53,078::__init__::225::IOProcess::(_processLogs) (272945) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:53,079::__init__::225::IOProcess::(_processLogs) (272945) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:53,081::__init__::225::IOProcess::(_processLogs) (272945) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:53,082::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:53,084::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:53,088::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:28:53,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:53,091::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:53,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:53,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:53,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:53,097::__init__::225::IOProcess::(_processLogs) (272946) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:53,099::__init__::225::IOProcess::(_processLogs) (272946) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:53,100::__init__::225::IOProcess::(_processLogs) (272946) Building response >Thread-18::DEBUG::2014-07-08 16:28:53,101::__init__::225::IOProcess::(_processLogs) (272946) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:53,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:53,104::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:28:53,109::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:28:53,110::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:28:53,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:28:53,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:28:53,114::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:28:53,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:28:53,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:28:53,118::__init__::225::IOProcess::(_processLogs) DEBUG|(272947) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:28:53,119::__init__::225::IOProcess::(_processLogs) (272947) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:28:53,121::__init__::225::IOProcess::(_processLogs) (272947) Building response >Thread-18::DEBUG::2014-07-08 16:28:53,122::__init__::225::IOProcess::(_processLogs) (272947) Queuing response >Thread-18::DEBUG::2014-07-08 16:28:53,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:28:53,124::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:28:53,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:53,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347309 s, 29.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:28:53,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`786a3dfc-f528-4dad-9f7a-51688521b895`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:28:53,765::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:28:53,766::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572124', 'lastCheck': '0.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:28:53,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`786a3dfc-f528-4dad-9f7a-51688521b895`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572124', 'lastCheck': '0.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:28:53,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`786a3dfc-f528-4dad-9f7a-51688521b895`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:28:53,769::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:28:53,770::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:28:53,771::task::993::Storage.TaskManager.Task::(_decref) Task=`786a3dfc-f528-4dad-9f7a-51688521b895`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:28:55,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:56,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0929896 s, 11.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:28:58,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:28:58,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176719 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:00,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:00,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177032 s, 57.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:29:01,155::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:29:01,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c24ebfb-e489-45c2-a0f8-a33d03bef0fb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:01,157::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:29:01,172::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:01,172::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c24ebfb-e489-45c2-a0f8-a33d03bef0fb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:01,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c24ebfb-e489-45c2-a0f8-a33d03bef0fb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:01,173::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:01,173::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:01,173::task::993::Storage.TaskManager.Task::(_decref) Task=`3c24ebfb-e489-45c2-a0f8-a33d03bef0fb`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:29:01,184::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:29:01,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c4dc0a0-a32a-4585-bd5f-26d07c2ba57f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:29:01,185::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:29:01,186::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1ada6d11-2e4e-4e6b-8c54-bed2eab7fe3c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:29:01,186::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:29:01,187::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:29:01,187::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1ada6d11-2e4e-4e6b-8c54-bed2eab7fe3c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:29:01,188::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3c4dc0a0-a32a-4585-bd5f-26d07c2ba57f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:29:01,188::task::993::Storage.TaskManager.Task::(_decref) Task=`3c4dc0a0-a32a-4585-bd5f-26d07c2ba57f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:29:01,208::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:01,208::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c4dc0a0-a32a-4585-bd5f-26d07c2ba57f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:01,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c4dc0a0-a32a-4585-bd5f-26d07c2ba57f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:29:01,209::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:29:01,209::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:29:01,210::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:29:01,210::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:29:01,210::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:29:01,210::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:29:01,211::task::993::Storage.TaskManager.Task::(_decref) Task=`3c4dc0a0-a32a-4585-bd5f-26d07c2ba57f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:29:02,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:03,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176959 s, 57.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:03,131::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:03,132::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:03,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:03,132::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:03,133::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:03,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:03,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:03,134::__init__::225::IOProcess::(_processLogs) (272948) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:03,134::__init__::225::IOProcess::(_processLogs) (272948) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:03,134::__init__::225::IOProcess::(_processLogs) (272948) Building response >Thread-18::DEBUG::2014-07-08 16:29:03,134::__init__::225::IOProcess::(_processLogs) (272948) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:03,135::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:03,135::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:29:03,137::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:29:03,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00045228 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:03,291::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:03,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:03,296::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:03,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:03,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:03,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:03,302::__init__::225::IOProcess::(_processLogs) (272949) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:03,303::__init__::225::IOProcess::(_processLogs) (272949) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:03,305::__init__::225::IOProcess::(_processLogs) (272949) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:03,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:03,308::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:29:03,317::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:29:03,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:03,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:03,321::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:03,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:03,324::__init__::225::IOProcess::(_processLogs) (272950) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:03,325::__init__::225::IOProcess::(_processLogs) (272950) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:03,327::__init__::225::IOProcess::(_processLogs) (272950) Building response >Thread-18::DEBUG::2014-07-08 16:29:03,328::__init__::225::IOProcess::(_processLogs) (272950) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:03,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:03,332::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:03,337::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:29:03,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:03,340::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:03,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:03,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:03,345::__init__::225::IOProcess::(_processLogs) (272951) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:03,347::__init__::225::IOProcess::(_processLogs) (272951) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:03,348::__init__::225::IOProcess::(_processLogs) (272951) Building response >Thread-18::DEBUG::2014-07-08 16:29:03,350::__init__::225::IOProcess::(_processLogs) (272951) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:03,351::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:03,353::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:03,358::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:29:03,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:03,361::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:03,363::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:03,368::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:03,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:03,381::__init__::225::IOProcess::(_processLogs) (272952) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:03,385::__init__::225::IOProcess::(_processLogs) (272952) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:03,386::__init__::225::IOProcess::(_processLogs) (272952) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:03,388::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:03,389::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:29:05,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:05,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177647 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:07,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:07,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176814 s, 57.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:29:08,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`64a74b1f-fb6b-41b0-a723-853881ea3aa4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:08,976::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:29:08,976::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045228', 'lastCheck': '5.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:29:08,977::task::1191::Storage.TaskManager.Task::(prepare) Task=`64a74b1f-fb6b-41b0-a723-853881ea3aa4`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045228', 'lastCheck': '5.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:29:08,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`64a74b1f-fb6b-41b0-a723-853881ea3aa4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:08,977::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:08,977::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:08,978::task::993::Storage.TaskManager.Task::(_decref) Task=`64a74b1f-fb6b-41b0-a723-853881ea3aa4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:29:09,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:09,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174283 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:29:11,224::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:29:11,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`943ecb70-590c-46ad-8c8a-3d4ea71acb0d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:11,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:29:11,240::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:11,241::task::1191::Storage.TaskManager.Task::(prepare) Task=`943ecb70-590c-46ad-8c8a-3d4ea71acb0d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:11,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`943ecb70-590c-46ad-8c8a-3d4ea71acb0d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:11,241::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:11,241::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:11,242::task::993::Storage.TaskManager.Task::(_decref) Task=`943ecb70-590c-46ad-8c8a-3d4ea71acb0d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:29:11,253::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:29:11,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`17d5934b-b0e3-4c81-8e7d-7ba6205ce0c0`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:29:11,254::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:29:11,255::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b74792a3-1a10-448b-b320-f81decdd991f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:29:11,255::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:29:11,256::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:29:11,256::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b74792a3-1a10-448b-b320-f81decdd991f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:29:11,257::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`17d5934b-b0e3-4c81-8e7d-7ba6205ce0c0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:29:11,257::task::993::Storage.TaskManager.Task::(_decref) Task=`17d5934b-b0e3-4c81-8e7d-7ba6205ce0c0`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:29:11,276::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:11,276::task::1191::Storage.TaskManager.Task::(prepare) Task=`17d5934b-b0e3-4c81-8e7d-7ba6205ce0c0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:11,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`17d5934b-b0e3-4c81-8e7d-7ba6205ce0c0`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:29:11,277::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:29:11,277::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:29:11,278::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:29:11,278::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:29:11,278::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:29:11,278::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:29:11,279::task::993::Storage.TaskManager.Task::(_decref) Task=`17d5934b-b0e3-4c81-8e7d-7ba6205ce0c0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:29:11,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:12,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0226666 s, 45.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:13,395::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:13,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:13,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:13,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:13,396::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:13,396::__init__::225::IOProcess::(_processLogs) (272953) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:13,397::__init__::225::IOProcess::(_processLogs) (272953) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:13,397::__init__::225::IOProcess::(_processLogs) (272953) Building response >Thread-18::DEBUG::2014-07-08 16:29:13,397::__init__::225::IOProcess::(_processLogs) (272953) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:13,397::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:13,398::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:29:13,399::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:29:13,552::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000790024 s, 585 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:13,557::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:13,558::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:13,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:13,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:13,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:13,563::__init__::225::IOProcess::(_processLogs) (272954) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:13,565::__init__::225::IOProcess::(_processLogs) (272954) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:13,566::__init__::225::IOProcess::(_processLogs) (272954) Building response >Thread-18::DEBUG::2014-07-08 16:29:13,567::__init__::225::IOProcess::(_processLogs) (272954) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:13,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:13,570::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:29:13,578::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:29:13,580::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:13,581::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:13,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:13,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:13,586::__init__::225::IOProcess::(_processLogs) (272955) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:13,587::__init__::225::IOProcess::(_processLogs) (272955) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:13,589::__init__::225::IOProcess::(_processLogs) (272955) Building response >Thread-18::DEBUG::2014-07-08 16:29:13,590::__init__::225::IOProcess::(_processLogs) (272955) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:13,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:13,593::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:13,599::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:29:13,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:13,602::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:13,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:13,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:13,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:13,608::__init__::225::IOProcess::(_processLogs) (272956) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:13,610::__init__::225::IOProcess::(_processLogs) (272956) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:13,611::__init__::225::IOProcess::(_processLogs) (272956) Building response >Thread-18::DEBUG::2014-07-08 16:29:13,613::__init__::225::IOProcess::(_processLogs) (272956) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:13,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:13,616::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:13,623::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:13,624::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:29:13,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:13,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:13,629::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:13,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:13,632::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:13,633::__init__::225::IOProcess::(_processLogs) (272957) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:13,635::__init__::225::IOProcess::(_processLogs) (272957) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:13,636::__init__::225::IOProcess::(_processLogs) DEBUG|(272957) Building response >Thread-18::DEBUG::2014-07-08 16:29:13,637::__init__::225::IOProcess::(_processLogs) (272957) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:13,638::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:13,640::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:29:14,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:14,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174174 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:16,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:16,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176415 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:18,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:18,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174599 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:21,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:21,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196486 s, 52.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:29:21,292::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:29:21,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e99195b-904d-440f-8a78-040a884eecdc`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:21,294::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:29:21,309::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:21,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e99195b-904d-440f-8a78-040a884eecdc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:21,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e99195b-904d-440f-8a78-040a884eecdc`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:21,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:21,311::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:21,311::task::993::Storage.TaskManager.Task::(_decref) Task=`9e99195b-904d-440f-8a78-040a884eecdc`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:29:21,321::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:29:21,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dc3b5c5-7293-4ef8-8dca-5bb528248a20`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:29:21,322::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:29:21,323::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`63b74020-3071-4620-9463-d1b579dceff4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:29:21,323::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:29:21,324::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:29:21,324::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`63b74020-3071-4620-9463-d1b579dceff4`::Granted request >Thread-6940::DEBUG::2014-07-08 16:29:21,325::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5dc3b5c5-7293-4ef8-8dca-5bb528248a20`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:29:21,325::task::993::Storage.TaskManager.Task::(_decref) Task=`5dc3b5c5-7293-4ef8-8dca-5bb528248a20`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:29:21,344::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:21,345::task::1191::Storage.TaskManager.Task::(prepare) Task=`5dc3b5c5-7293-4ef8-8dca-5bb528248a20`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:21,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dc3b5c5-7293-4ef8-8dca-5bb528248a20`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:29:21,345::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:29:21,346::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:29:21,346::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:29:21,346::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:29:21,347::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:29:21,347::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:29:21,347::task::993::Storage.TaskManager.Task::(_decref) Task=`5dc3b5c5-7293-4ef8-8dca-5bb528248a20`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:29:23,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:23,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173979 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:23,646::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:23,647::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:23,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:23,647::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:23,647::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:23,648::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:23,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:23,648::__init__::225::IOProcess::(_processLogs) (272958) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:23,648::__init__::225::IOProcess::(_processLogs) (272958) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:23,649::__init__::225::IOProcess::(_processLogs) (272958) Building response >Thread-18::DEBUG::2014-07-08 16:29:23,649::__init__::225::IOProcess::(_processLogs) (272958) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:23,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:23,649::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:29:23,651::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:29:23,804::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000433843 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:23,808::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:23,809::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:23,809::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:23,809::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:23,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:23,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:23,811::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:23,811::__init__::225::IOProcess::(_processLogs) (272959) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:23,811::__init__::225::IOProcess::(_processLogs) (272959) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:23,812::__init__::225::IOProcess::(_processLogs) (272959) Building response >Thread-18::DEBUG::2014-07-08 16:29:23,812::__init__::225::IOProcess::(_processLogs) (272959) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:23,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:23,813::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:29:23,817::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:23,818::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:29:23,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:23,820::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:23,821::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:23,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:23,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:23,825::__init__::225::IOProcess::(_processLogs) (272960) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:23,827::__init__::225::IOProcess::(_processLogs) (272960) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:23,828::__init__::225::IOProcess::(_processLogs) (272960) Building response >Thread-18::DEBUG::2014-07-08 16:29:23,829::__init__::225::IOProcess::(_processLogs) (272960) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:23,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:23,831::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:23,836::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:23,837::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:29:23,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:23,837::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:23,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:23,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:23,839::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:23,839::__init__::225::IOProcess::(_processLogs) (272961) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:23,839::__init__::225::IOProcess::(_processLogs) (272961) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:23,840::__init__::225::IOProcess::(_processLogs) (272961) Building response >Thread-18::DEBUG::2014-07-08 16:29:23,841::__init__::225::IOProcess::(_processLogs) (272961) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:23,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:23,844::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:23,850::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:23,850::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:29:23,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:23,852::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:23,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:23,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:23,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:23,858::__init__::225::IOProcess::(_processLogs) (272962) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:23,859::__init__::225::IOProcess::(_processLogs) (272962) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:23,860::__init__::225::IOProcess::(_processLogs) (272962) Building response >Thread-18::DEBUG::2014-07-08 16:29:23,861::__init__::225::IOProcess::(_processLogs) (272962) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:23,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:23,864::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:29:24,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`35498860-3261-495a-acbe-3f5732ae55a1`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:24,198::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:29:24,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433843', 'lastCheck': '0.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:29:24,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`35498860-3261-495a-acbe-3f5732ae55a1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433843', 'lastCheck': '0.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:29:24,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`35498860-3261-495a-acbe-3f5732ae55a1`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:24,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:24,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:24,206::task::993::Storage.TaskManager.Task::(_decref) Task=`35498860-3261-495a-acbe-3f5732ae55a1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:29:25,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:25,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172191 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:27,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:28,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176104 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:30,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:30,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415743 s, 24.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:29:31,360::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:29:31,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`ace6f981-d1a6-4052-9165-4f32d18f4ce8`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:31,361::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:29:31,376::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:31,377::task::1191::Storage.TaskManager.Task::(prepare) Task=`ace6f981-d1a6-4052-9165-4f32d18f4ce8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:31,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`ace6f981-d1a6-4052-9165-4f32d18f4ce8`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:31,377::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:31,377::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:31,378::task::993::Storage.TaskManager.Task::(_decref) Task=`ace6f981-d1a6-4052-9165-4f32d18f4ce8`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:29:31,388::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:29:31,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f3cf395-3d09-4142-9fa3-b71b680daf4f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:29:31,390::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:29:31,395::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`22f6da46-cd99-4d32-9a21-4654d51c36aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:29:31,395::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:29:31,396::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:29:31,396::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`22f6da46-cd99-4d32-9a21-4654d51c36aa`::Granted request >Thread-6940::DEBUG::2014-07-08 16:29:31,397::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5f3cf395-3d09-4142-9fa3-b71b680daf4f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:29:31,397::task::993::Storage.TaskManager.Task::(_decref) Task=`5f3cf395-3d09-4142-9fa3-b71b680daf4f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:29:31,416::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:31,416::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f3cf395-3d09-4142-9fa3-b71b680daf4f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:31,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f3cf395-3d09-4142-9fa3-b71b680daf4f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:29:31,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:29:31,417::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:29:31,418::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:29:31,418::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:29:31,418::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:29:31,418::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:29:31,419::task::993::Storage.TaskManager.Task::(_decref) Task=`5f3cf395-3d09-4142-9fa3-b71b680daf4f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:29:32,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:32,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175194 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:33,871::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:33,872::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:33,874::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:33,875::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:33,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:33,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:33,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:33,881::__init__::225::IOProcess::(_processLogs) (272963) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:33,882::__init__::225::IOProcess::(_processLogs) (272963) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:33,883::__init__::225::IOProcess::(_processLogs) (272963) Building response >Thread-18::DEBUG::2014-07-08 16:29:33,884::__init__::225::IOProcess::(_processLogs) (272963) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:33,885::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:33,887::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:29:33,892::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:29:34,045::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000508152 s, 909 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:34,055::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:34,059::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:34,063::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:34,067::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:34,071::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:34,075::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:34,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:34,081::__init__::225::IOProcess::(_processLogs) (272964) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:34,083::__init__::225::IOProcess::(_processLogs) (272964) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:34,085::__init__::225::IOProcess::(_processLogs) (272964) Building response >Thread-18::DEBUG::2014-07-08 16:29:34,088::__init__::225::IOProcess::(_processLogs) (272964) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:34,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:34,094::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:29:34,110::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:34,113::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:29:34,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:34,118::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:34,120::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:34,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:34,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:34,128::__init__::225::IOProcess::(_processLogs) (272965) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:34,130::__init__::225::IOProcess::(_processLogs) (272965) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:34,132::__init__::225::IOProcess::(_processLogs) (272965) Building response >Thread-18::DEBUG::2014-07-08 16:29:34,135::__init__::225::IOProcess::(_processLogs) (272965) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:34,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:34,140::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:34,149::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:34,152::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:29:34,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:34,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:34,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:34,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:34,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:34,169::__init__::225::IOProcess::(_processLogs) (272966) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:34,172::__init__::225::IOProcess::(_processLogs) (272966) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:34,176::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(272966) Building response >Thread-18::DEBUG::2014-07-08 16:29:34,178::__init__::225::IOProcess::(_processLogs) (272966) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:34,181::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:34,184::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:34,194::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:34,197::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:29:34,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:34,203::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:34,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:34,209::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:34,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:34,214::__init__::225::IOProcess::(_processLogs) (272967) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:34,218::__init__::225::IOProcess::(_processLogs) (272967) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:34,221::__init__::225::IOProcess::(_processLogs) (272967) Building response >Thread-18::DEBUG::2014-07-08 16:29:34,223::__init__::225::IOProcess::(_processLogs) (272967) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:34,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:34,228::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:29:34,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:34,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174797 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:36,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:37,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174314 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:39,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:39,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0213443 s, 48.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:29:39,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`6cd5a35e-16ec-4126-98d4-fcc30d571e80`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:39,506::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:29:39,507::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508152', 'lastCheck': '5.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:29:39,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`6cd5a35e-16ec-4126-98d4-fcc30d571e80`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508152', 'lastCheck': '5.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:29:39,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`6cd5a35e-16ec-4126-98d4-fcc30d571e80`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:39,510::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:39,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:39,512::task::993::Storage.TaskManager.Task::(_decref) Task=`6cd5a35e-16ec-4126-98d4-fcc30d571e80`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:29:41,432::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:29:41,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7a59c2a-53da-436f-94f7-6d34129cd137`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:41,433::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:29:41,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:41,449::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7a59c2a-53da-436f-94f7-6d34129cd137`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:41,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7a59c2a-53da-436f-94f7-6d34129cd137`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:41,449::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:41,449::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:41,450::task::993::Storage.TaskManager.Task::(_decref) Task=`c7a59c2a-53da-436f-94f7-6d34129cd137`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:29:41,461::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:29:41,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3b811f4-8a74-4689-9467-af201813265d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:29:41,462::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:29:41,463::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bd7b9237-e7fd-4db2-a05c-4b6315033622`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:29:41,463::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:29:41,463::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:29:41,464::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bd7b9237-e7fd-4db2-a05c-4b6315033622`::Granted request >Thread-6940::DEBUG::2014-07-08 16:29:41,464::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f3b811f4-8a74-4689-9467-af201813265d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:29:41,465::task::993::Storage.TaskManager.Task::(_decref) Task=`f3b811f4-8a74-4689-9467-af201813265d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:29:41,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:41,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3b811f4-8a74-4689-9467-af201813265d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:41,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3b811f4-8a74-4689-9467-af201813265d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:29:41,485::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:29:41,485::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:29:41,485::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:29:41,486::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:29:41,486::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:29:41,486::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:29:41,487::task::993::Storage.TaskManager.Task::(_decref) Task=`f3b811f4-8a74-4689-9467-af201813265d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:29:41,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:41,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175755 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:43,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:44,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175912 s, 58.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:44,237::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:44,237::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:44,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:44,238::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:44,238::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:44,238::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:44,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:44,239::__init__::225::IOProcess::(_processLogs) (272968) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:44,239::__init__::225::IOProcess::(_processLogs) (272968) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:44,239::__init__::225::IOProcess::(_processLogs) (272968) Building response >Thread-18::DEBUG::2014-07-08 16:29:44,240::__init__::225::IOProcess::(_processLogs) (272968) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:44,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:44,240::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:29:44,242::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:29:44,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000511504 s, 903 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:44,391::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:44,391::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:44,391::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:44,392::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:44,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:44,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:44,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:44,393::__init__::225::IOProcess::(_processLogs) (272969) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:44,393::__init__::225::IOProcess::(_processLogs) (272969) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:44,393::__init__::225::IOProcess::(_processLogs) (272969) Building response >Thread-18::DEBUG::2014-07-08 16:29:44,394::__init__::225::IOProcess::(_processLogs) (272969) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:44,394::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:44,394::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:29:44,396::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:44,396::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:29:44,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:44,397::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:44,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:44,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:44,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:44,398::__init__::225::IOProcess::(_processLogs) (272970) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:44,398::__init__::225::IOProcess::(_processLogs) (272970) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:44,398::__init__::225::IOProcess::(_processLogs) (272970) Building response >Thread-18::DEBUG::2014-07-08 16:29:44,399::__init__::225::IOProcess::(_processLogs) (272970) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:44,399::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:44,399::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:44,400::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:44,401::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:29:44,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:44,401::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:44,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:44,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:44,402::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:44,402::__init__::225::IOProcess::(_processLogs) (272971) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:44,402::__init__::225::IOProcess::(_processLogs) (272971) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:44,402::__init__::225::IOProcess::(_processLogs) (272971) Building response >Thread-18::DEBUG::2014-07-08 16:29:44,403::__init__::225::IOProcess::(_processLogs) (272971) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:44,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:44,403::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:44,404::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:44,405::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:29:44,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:44,405::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:44,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:44,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:44,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:44,406::__init__::225::IOProcess::(_processLogs) (272972) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:44,406::__init__::225::IOProcess::(_processLogs) (272972) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:44,407::__init__::225::IOProcess::(_processLogs) (272972) Building response >Thread-18::DEBUG::2014-07-08 16:29:44,407::__init__::225::IOProcess::(_processLogs) (272972) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:44,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:44,407::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:29:46,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:46,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01748 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:48,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:48,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0216838 s, 47.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:50,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:50,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421216 s, 24.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:29:51,502::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:29:51,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8f7b02e-6e4b-49ac-8006-0810148c3e75`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:51,504::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:29:51,520::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:51,520::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8f7b02e-6e4b-49ac-8006-0810148c3e75`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:29:51,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8f7b02e-6e4b-49ac-8006-0810148c3e75`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:51,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:51,521::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:51,521::task::993::Storage.TaskManager.Task::(_decref) Task=`e8f7b02e-6e4b-49ac-8006-0810148c3e75`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:29:51,533::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:29:51,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`25e4958c-d288-417e-8de8-0f7926e8a5b4`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:29:51,542::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:29:51,543::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6d18f9ff-c926-4991-9d28-a0895844ae25`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:29:51,544::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:29:51,544::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:29:51,544::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6d18f9ff-c926-4991-9d28-a0895844ae25`::Granted request >Thread-6940::DEBUG::2014-07-08 16:29:51,545::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`25e4958c-d288-417e-8de8-0f7926e8a5b4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:29:51,545::task::993::Storage.TaskManager.Task::(_decref) Task=`25e4958c-d288-417e-8de8-0f7926e8a5b4`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:29:51,565::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:51,566::task::1191::Storage.TaskManager.Task::(prepare) Task=`25e4958c-d288-417e-8de8-0f7926e8a5b4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:29:51,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`25e4958c-d288-417e-8de8-0f7926e8a5b4`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:29:51,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:29:51,566::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:29:51,567::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:29:51,567::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:29:51,567::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:29:51,567::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:29:51,568::task::993::Storage.TaskManager.Task::(_decref) Task=`25e4958c-d288-417e-8de8-0f7926e8a5b4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:29:52,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:53,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100879 s, 10.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:54,411::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:54,412::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:54,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:54,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:54,413::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:54,413::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:54,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:54,413::__init__::225::IOProcess::(_processLogs) (272973) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:54,414::__init__::225::IOProcess::(_processLogs) (272973) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:54,414::__init__::225::IOProcess::(_processLogs) (272973) Building response >Thread-18::DEBUG::2014-07-08 16:29:54,414::__init__::225::IOProcess::(_processLogs) (272973) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:54,414::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:54,414::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:29:54,416::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:29:54,580::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000490273 s, 942 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:29:54,585::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:29:54,587::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:29:54,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:54,590::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:54,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:54,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:54,595::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:54,596::__init__::225::IOProcess::(_processLogs) (272974) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:29:54,598::__init__::225::IOProcess::(_processLogs) (272974) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:29:54,599::__init__::225::IOProcess::(_processLogs) (272974) Building response >Thread-18::DEBUG::2014-07-08 16:29:54,600::__init__::225::IOProcess::(_processLogs) (272974) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:54,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:54,603::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:29:54,612::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:29:54,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:54,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:54,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:54,618::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:54,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:54,621::__init__::225::IOProcess::(_processLogs) (272975) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:54,622::__init__::225::IOProcess::(_processLogs) (272975) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:54,624::__init__::225::IOProcess::(_processLogs) (272975) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:54,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:54,627::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:54,631::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:29:54,633::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:54,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:54,636::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:54,637::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:54,639::__init__::225::IOProcess::(_processLogs) (272976) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:54,640::__init__::225::IOProcess::(_processLogs) (272976) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:54,642::__init__::225::IOProcess::(_processLogs) (272976) Building response >Thread-18::DEBUG::2014-07-08 16:29:54,643::__init__::225::IOProcess::(_processLogs) (272976) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:54,645::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:29:54,646::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:29:54,651::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:29:54,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:29:54,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:29:54,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:29:54,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:29:54,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:29:54,663::__init__::225::IOProcess::(_processLogs) (272977) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:29:54,664::__init__::225::IOProcess::(_processLogs) (272977) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:29:54,665::__init__::225::IOProcess::(_processLogs) (272977) Building response >Thread-18::DEBUG::2014-07-08 16:29:54,667::__init__::225::IOProcess::(_processLogs) (272977) Queuing response >Thread-18::DEBUG::2014-07-08 16:29:54,669::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:29:54,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce58785f-8205-4370-afcf-eed12849119d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:29:54,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:29:54,693::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490273', 'lastCheck': '0.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:29:54,694::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce58785f-8205-4370-afcf-eed12849119d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490273', 'lastCheck': '0.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:29:54,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce58785f-8205-4370-afcf-eed12849119d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:29:54,696::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:29:54,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:29:54,698::task::993::Storage.TaskManager.Task::(_decref) Task=`ce58785f-8205-4370-afcf-eed12849119d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:29:55,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:55,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175864 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:57,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:29:57,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179817 s, 56.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:29:59,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:00,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0234063 s, 43.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:30:01,580::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:30:01,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`987561d8-966f-4def-848f-c85dc033f355`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:01,582::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:30:01,597::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:01,597::task::1191::Storage.TaskManager.Task::(prepare) Task=`987561d8-966f-4def-848f-c85dc033f355`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:01,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`987561d8-966f-4def-848f-c85dc033f355`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:01,598::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:01,598::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:01,599::task::993::Storage.TaskManager.Task::(_decref) Task=`987561d8-966f-4def-848f-c85dc033f355`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:30:01,609::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:30:01,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bd2a23d-fc1c-4d3e-841f-516465d7e406`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:30:01,611::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:30:01,612::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55fd9028-b24a-434f-bc60-173dfb667879`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:30:01,612::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:30:01,612::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:30:01,613::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55fd9028-b24a-434f-bc60-173dfb667879`::Granted request >Thread-6940::DEBUG::2014-07-08 16:30:01,613::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1bd2a23d-fc1c-4d3e-841f-516465d7e406`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:30:01,614::task::993::Storage.TaskManager.Task::(_decref) Task=`1bd2a23d-fc1c-4d3e-841f-516465d7e406`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:30:01,633::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:01,634::task::1191::Storage.TaskManager.Task::(prepare) Task=`1bd2a23d-fc1c-4d3e-841f-516465d7e406`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:01,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bd2a23d-fc1c-4d3e-841f-516465d7e406`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:30:01,634::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:30:01,634::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:30:01,635::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:30:01,635::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:30:01,635::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:30:01,636::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:30:01,636::task::993::Storage.TaskManager.Task::(_decref) Task=`1bd2a23d-fc1c-4d3e-841f-516465d7e406`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:30:02,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:02,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017775 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:04,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:04,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374784 s, 27.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:04,694::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:04,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:04,700::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:04,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:04,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:04,709::__init__::225::IOProcess::(_processLogs) (272978) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:04,711::__init__::225::IOProcess::(_processLogs) (272978) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:04,714::__init__::225::IOProcess::(_processLogs) (272978) Building response >Thread-18::DEBUG::2014-07-08 16:30:04,716::__init__::225::IOProcess::(_processLogs) (272978) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:04,719::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:04,722::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:30:04,734::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:30:04,891::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000508432 s, 909 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:04,901::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:04,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:04,908::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:04,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:04,916::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:04,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:04,921::__init__::225::IOProcess::(_processLogs) (272979) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:04,923::__init__::225::IOProcess::(_processLogs) (272979) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:04,926::__init__::225::IOProcess::(_processLogs) (272979) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:04,928::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:04,930::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:30:04,946::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:30:04,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:04,950::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:04,952::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:04,954::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:04,956::__init__::225::IOProcess::(_processLogs) (272980) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:04,959::__init__::225::IOProcess::(_processLogs) (272980) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:04,961::__init__::225::IOProcess::(_processLogs) (272980) Building response >Thread-18::DEBUG::2014-07-08 16:30:04,963::__init__::225::IOProcess::(_processLogs) (272980) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:04,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:04,967::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:04,975::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:30:04,977::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:04,979::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:04,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:04,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:04,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:04,989::__init__::225::IOProcess::(_processLogs) (272981) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:04,991::__init__::225::IOProcess::(_processLogs) (272981) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:04,994::__init__::225::IOProcess::(_processLogs) (272981) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:04,996::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:04,998::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:05,006::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:30:05,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:05,011::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:05,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:05,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:05,019::__init__::225::IOProcess::(_processLogs) (272982) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:05,021::__init__::225::IOProcess::(_processLogs) (272982) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:05,023::__init__::225::IOProcess::(_processLogs) (272982) Building response >Thread-18::DEBUG::2014-07-08 16:30:05,026::__init__::225::IOProcess::(_processLogs) (272982) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:05,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:05,032::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:30:07,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:07,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017109 s, 59.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:09,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:09,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186944 s, 54.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:30:09,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`02bdd12a-5c44-40c4-857e-e3038edfccba`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:09,900::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:30:09,900::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508432', 'lastCheck': '4.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:30:09,901::task::1191::Storage.TaskManager.Task::(prepare) Task=`02bdd12a-5c44-40c4-857e-e3038edfccba`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508432', 'lastCheck': '4.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:30:09,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`02bdd12a-5c44-40c4-857e-e3038edfccba`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:09,901::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:09,901::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:09,902::task::993::Storage.TaskManager.Task::(_decref) Task=`02bdd12a-5c44-40c4-857e-e3038edfccba`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:30:11,650::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:30:11,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`e59f8bcc-6d2a-4932-bb4d-057b210749de`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:11,651::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:30:11,666::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:11,666::task::1191::Storage.TaskManager.Task::(prepare) Task=`e59f8bcc-6d2a-4932-bb4d-057b210749de`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:11,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`e59f8bcc-6d2a-4932-bb4d-057b210749de`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:11,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:11,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:11,667::task::993::Storage.TaskManager.Task::(_decref) Task=`e59f8bcc-6d2a-4932-bb4d-057b210749de`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:30:11,678::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:30:11,679::task::595::Storage.TaskManager.Task::(_updateState) Task=`41c06bd5-94f5-4493-881f-0d67bdde3f15`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:30:11,680::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:30:11,681::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a3bad950-82b3-4f36-bc3b-c1570fef271a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:30:11,681::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:30:11,681::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:30:11,682::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a3bad950-82b3-4f36-bc3b-c1570fef271a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:30:11,682::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`41c06bd5-94f5-4493-881f-0d67bdde3f15`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:30:11,683::task::993::Storage.TaskManager.Task::(_decref) Task=`41c06bd5-94f5-4493-881f-0d67bdde3f15`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:30:11,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:11,702::task::1191::Storage.TaskManager.Task::(prepare) Task=`41c06bd5-94f5-4493-881f-0d67bdde3f15`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:11,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`41c06bd5-94f5-4493-881f-0d67bdde3f15`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:30:11,702::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:30:11,703::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:30:11,703::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:30:11,703::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:30:11,704::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:30:11,704::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:30:11,704::task::993::Storage.TaskManager.Task::(_decref) Task=`41c06bd5-94f5-4493-881f-0d67bdde3f15`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:30:11,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:12,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173428 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:14,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:14,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174487 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:15,040::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:15,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:15,041::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:15,041::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:15,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:15,042::__init__::225::IOProcess::(_processLogs) (272983) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:15,042::__init__::225::IOProcess::(_processLogs) (272983) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:15,042::__init__::225::IOProcess::(_processLogs) (272983) Building response >Thread-18::DEBUG::2014-07-08 16:30:15,042::__init__::225::IOProcess::(_processLogs) (272983) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:15,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:15,043::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:30:15,045::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:30:15,194::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000496698 s, 930 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:15,196::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:15,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:15,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:15,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:15,198::__init__::225::IOProcess::(_processLogs) (272984) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:15,199::__init__::225::IOProcess::(_processLogs) (272984) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:15,201::__init__::225::IOProcess::(_processLogs) (272984) Building response >Thread-18::DEBUG::2014-07-08 16:30:15,203::__init__::225::IOProcess::(_processLogs) (272984) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:15,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:15,206::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:30:15,218::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:30:15,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:15,221::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:15,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:15,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:15,224::__init__::225::IOProcess::(_processLogs) (272985) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:15,225::__init__::225::IOProcess::(_processLogs) (272985) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:15,226::__init__::225::IOProcess::(_processLogs) (272985) Building response >Thread-18::DEBUG::2014-07-08 16:30:15,227::__init__::225::IOProcess::(_processLogs) (272985) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:15,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:15,229::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:15,233::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:30:15,234::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:15,235::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:15,237::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:15,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:15,244::__init__::225::IOProcess::(_processLogs) (272986) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:15,249::__init__::225::IOProcess::(_processLogs) (272986) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:15,253::__init__::225::IOProcess::(_processLogs) (272986) Building response >Thread-18::DEBUG::2014-07-08 16:30:15,258::__init__::225::IOProcess::(_processLogs) (272986) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:15,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:15,263::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:15,283::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:30:15,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:15,286::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:15,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:15,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:15,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:15,291::__init__::225::IOProcess::(_processLogs) (272987) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:15,292::__init__::225::IOProcess::(_processLogs) (272987) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:15,294::__init__::225::IOProcess::(_processLogs) (272987) Building response >Thread-18::DEBUG::2014-07-08 16:30:15,295::__init__::225::IOProcess::(_processLogs) (272987) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:15,297::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:30:16,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:16,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174227 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:18,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:18,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177426 s, 57.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:20,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:21,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175769 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:30:21,718::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:30:21,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`486d0353-f2d7-47da-8aca-908112338fc4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:21,719::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:30:21,736::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:21,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`486d0353-f2d7-47da-8aca-908112338fc4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:21,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`486d0353-f2d7-47da-8aca-908112338fc4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:21,740::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:21,740::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:21,740::task::993::Storage.TaskManager.Task::(_decref) Task=`486d0353-f2d7-47da-8aca-908112338fc4`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:30:21,752::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:30:21,753::task::595::Storage.TaskManager.Task::(_updateState) Task=`b113262d-464e-4fa5-9dd3-76b4ca662471`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:30:21,753::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:30:21,754::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a70299c9-886a-4a67-9255-5b65f36c9967`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:30:21,754::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:30:21,755::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:30:21,755::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a70299c9-886a-4a67-9255-5b65f36c9967`::Granted request >Thread-6940::DEBUG::2014-07-08 16:30:21,756::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b113262d-464e-4fa5-9dd3-76b4ca662471`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:30:21,756::task::993::Storage.TaskManager.Task::(_decref) Task=`b113262d-464e-4fa5-9dd3-76b4ca662471`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:30:21,775::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:21,776::task::1191::Storage.TaskManager.Task::(prepare) Task=`b113262d-464e-4fa5-9dd3-76b4ca662471`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:21,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`b113262d-464e-4fa5-9dd3-76b4ca662471`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:30:21,776::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:30:21,776::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:30:21,777::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:30:21,777::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:30:21,777::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:30:21,778::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:30:21,778::task::993::Storage.TaskManager.Task::(_decref) Task=`b113262d-464e-4fa5-9dd3-76b4ca662471`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:30:23,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:23,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0238851 s, 42.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:30:25,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4beb529-10df-4c0c-b83d-399f63676d8b`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:25,089::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:30:25,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496698', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:30:25,090::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4beb529-10df-4c0c-b83d-399f63676d8b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496698', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:30:25,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4beb529-10df-4c0c-b83d-399f63676d8b`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:25,090::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:25,091::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:25,091::task::993::Storage.TaskManager.Task::(_decref) Task=`e4beb529-10df-4c0c-b83d-399f63676d8b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:30:25,303::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:25,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:25,304::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:25,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:25,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:25,304::__init__::225::IOProcess::(_processLogs) (272988) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:25,305::__init__::225::IOProcess::(_processLogs) (272988) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:25,305::__init__::225::IOProcess::(_processLogs) (272988) Building response >Thread-18::DEBUG::2014-07-08 16:30:25,305::__init__::225::IOProcess::(_processLogs) (272988) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:25,305::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:25,306::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:30:25,307::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:25,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:30:25,463::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000533294 s, 866 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:25,645::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:25,651::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:25,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:25,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:25,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:25,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:25,681::__init__::225::IOProcess::(_processLogs) (272989) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:25,688::__init__::225::IOProcess::(_processLogs) (272989) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:25,694::__init__::225::IOProcess::(_processLogs) (272989) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:25,700::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:25,707::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:30:25,737::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:30:25,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:25,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:25,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:25,764::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:25,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:25,780::__init__::225::IOProcess::(_processLogs) (272990) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:25,785::__init__::225::IOProcess::(_processLogs) (272990) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:25,871::__init__::225::IOProcess::(_processLogs) (272990) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:30:25,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.162701 s, 6.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:25,874::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:25,876::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:25,885::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:30:25,888::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:25,890::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:25,893::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:25,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:25,897::__init__::225::IOProcess::(_processLogs) (272991) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:25,899::__init__::225::IOProcess::(_processLogs) (272991) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:25,901::__init__::225::IOProcess::(_processLogs) (272991) Building response >Thread-18::DEBUG::2014-07-08 16:30:25,903::__init__::225::IOProcess::(_processLogs) (272991) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:25,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:25,908::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:25,916::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:30:25,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:25,921::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:25,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:25,927::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:25,929::__init__::225::IOProcess::(_processLogs) (272992) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:25,932::__init__::225::IOProcess::(_processLogs) (272992) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:25,934::__init__::225::IOProcess::(_processLogs) (272992) Building response >Thread-18::DEBUG::2014-07-08 16:30:25,937::__init__::225::IOProcess::(_processLogs) (272992) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:25,939::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:25,941::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:30:28,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:28,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.019588 s, 52.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:30,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:30,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176199 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:30:31,790::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:30:31,792::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1c92b5f-3112-4e2a-b6d1-f7f179a60027`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:31,792::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:30:31,807::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:31,807::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1c92b5f-3112-4e2a-b6d1-f7f179a60027`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:31,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1c92b5f-3112-4e2a-b6d1-f7f179a60027`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:31,808::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:31,808::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:31,808::task::993::Storage.TaskManager.Task::(_decref) Task=`a1c92b5f-3112-4e2a-b6d1-f7f179a60027`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:30:31,820::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:30:31,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`273ba034-6260-42dc-9df4-acdae0fbe21a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:30:31,822::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:30:31,827::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7bdef122-cbed-4d76-8125-711dd360f3d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:30:31,829::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:30:31,832::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:30:31,834::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7bdef122-cbed-4d76-8125-711dd360f3d9`::Granted request >Thread-6940::DEBUG::2014-07-08 16:30:31,838::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`273ba034-6260-42dc-9df4-acdae0fbe21a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:30:31,840::task::993::Storage.TaskManager.Task::(_decref) Task=`273ba034-6260-42dc-9df4-acdae0fbe21a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:30:31,869::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:31,870::task::1191::Storage.TaskManager.Task::(prepare) Task=`273ba034-6260-42dc-9df4-acdae0fbe21a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:31,870::task::595::Storage.TaskManager.Task::(_updateState) Task=`273ba034-6260-42dc-9df4-acdae0fbe21a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:30:31,870::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:30:31,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:30:31,871::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:30:31,872::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:30:31,872::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:30:31,872::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:30:31,872::task::993::Storage.TaskManager.Task::(_decref) Task=`273ba034-6260-42dc-9df4-acdae0fbe21a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:30:32,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:32,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178778 s, 57.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:34,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:35,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174057 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:35,949::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:35,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:35,951::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:35,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:35,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:35,952::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:35,952::__init__::225::IOProcess::(_processLogs) (272993) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:35,952::__init__::225::IOProcess::(_processLogs) (272993) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:35,952::__init__::225::IOProcess::(_processLogs) (272993) Building response >Thread-18::DEBUG::2014-07-08 16:30:35,953::__init__::225::IOProcess::(_processLogs) (272993) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:35,953::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:35,953::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:30:35,955::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:30:36,101::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000478261 s, 966 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:36,103::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:36,104::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:36,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:36,104::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:36,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:36,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:36,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:36,105::__init__::225::IOProcess::(_processLogs) (272994) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:36,105::__init__::225::IOProcess::(_processLogs) (272994) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:36,106::__init__::225::IOProcess::(_processLogs) (272994) Building response >Thread-18::DEBUG::2014-07-08 16:30:36,106::__init__::225::IOProcess::(_processLogs) (272994) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:36,106::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:30:36,106::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:30:36,109::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:36,109::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:30:36,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:36,109::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:36,110::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:36,110::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:36,110::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:36,110::__init__::225::IOProcess::(_processLogs) (272995) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:36,111::__init__::225::IOProcess::(_processLogs) (272995) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:36,111::__init__::225::IOProcess::(_processLogs) (272995) Building response >Thread-18::DEBUG::2014-07-08 16:30:36,111::__init__::225::IOProcess::(_processLogs) (272995) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:36,111::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:36,112::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:36,113::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:36,113::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:30:36,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:36,113::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:36,114::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:36,114::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:36,114::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:36,114::__init__::225::IOProcess::(_processLogs) (272996) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:36,115::__init__::225::IOProcess::(_processLogs) (272996) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:36,115::__init__::225::IOProcess::(_processLogs) (272996) Building response >Thread-18::DEBUG::2014-07-08 16:30:36,115::__init__::225::IOProcess::(_processLogs) (272996) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:36,115::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:36,116::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:36,117::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:36,117::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:30:36,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:36,118::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:36,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:36,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:36,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:36,118::__init__::225::IOProcess::(_processLogs) (272997) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:36,119::__init__::225::IOProcess::(_processLogs) (272997) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:36,119::__init__::225::IOProcess::(_processLogs) (272997) Building response >Thread-18::DEBUG::2014-07-08 16:30:36,119::__init__::225::IOProcess::(_processLogs) (272997) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:36,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:36,120::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:30:37,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:37,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0202702 s, 50.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:39,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:39,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172576 s, 59.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:30:40,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cf779ed-1a65-412e-b2e7-237a01453d80`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:40,382::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:30:40,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478261', 'lastCheck': '4.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:30:40,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`7cf779ed-1a65-412e-b2e7-237a01453d80`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478261', 'lastCheck': '4.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:30:40,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cf779ed-1a65-412e-b2e7-237a01453d80`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:40,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:40,383::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:40,384::task::993::Storage.TaskManager.Task::(_decref) Task=`7cf779ed-1a65-412e-b2e7-237a01453d80`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:30:41,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:30:42,009::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:30:42,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`8593190e-8b00-4817-9d44-09f535419e74`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:42,018::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:30:42,037::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:42,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`8593190e-8b00-4817-9d44-09f535419e74`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:42,044::task::595::Storage.TaskManager.Task::(_updateState) Task=`8593190e-8b00-4817-9d44-09f535419e74`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:42,047::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:42,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:42,055::task::993::Storage.TaskManager.Task::(_decref) Task=`8593190e-8b00-4817-9d44-09f535419e74`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:30:42,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0681061 s, 15.0 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:30:42,156::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:30:42,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6bc4c71-53ed-4d17-a681-4abac448b2a5`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:30:42,159::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:30:42,162::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2a47454e-5e82-49e8-bd63-df049c29b127`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:30:42,162::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:30:42,164::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:30:42,165::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2a47454e-5e82-49e8-bd63-df049c29b127`::Granted request >Thread-6940::DEBUG::2014-07-08 16:30:42,167::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d6bc4c71-53ed-4d17-a681-4abac448b2a5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:30:42,168::task::993::Storage.TaskManager.Task::(_decref) Task=`d6bc4c71-53ed-4d17-a681-4abac448b2a5`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:30:42,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:42,207::task::1191::Storage.TaskManager.Task::(prepare) Task=`d6bc4c71-53ed-4d17-a681-4abac448b2a5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579672576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:42,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6bc4c71-53ed-4d17-a681-4abac448b2a5`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:30:42,208::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:30:42,208::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:30:42,209::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:30:42,209::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:30:42,209::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:30:42,209::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:30:42,210::task::993::Storage.TaskManager.Task::(_decref) Task=`d6bc4c71-53ed-4d17-a681-4abac448b2a5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:30:44,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:44,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172769 s, 59.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:46,123::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:46,123::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:46,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:46,124::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:46,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:46,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:46,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:46,125::__init__::225::IOProcess::(_processLogs) (272998) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:46,125::__init__::225::IOProcess::(_processLogs) (272998) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:46,125::__init__::225::IOProcess::(_processLogs) (272998) Building response >Thread-18::DEBUG::2014-07-08 16:30:46,126::__init__::225::IOProcess::(_processLogs) (272998) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:46,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:46,126::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:30:46,128::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:30:46,280::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000539719 s, 856 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:46,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:46,288::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:46,290::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:46,292::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:46,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:46,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:46,297::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:46,299::__init__::225::IOProcess::(_processLogs) (272999) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:46,300::__init__::225::IOProcess::(_processLogs) (272999) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:46,302::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(272999) Building response >Thread-18::DEBUG::2014-07-08 16:30:46,304::__init__::225::IOProcess::(_processLogs) (272999) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:46,305::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:46,306::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:30:46,316::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:46,318::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:30:46,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:46,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:46,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:46,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:46,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:46,327::__init__::225::IOProcess::(_processLogs) (273000) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:46,329::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273000) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:46,330::__init__::225::IOProcess::(_processLogs) (273000) Building response >Thread-18::DEBUG::2014-07-08 16:30:46,331::__init__::225::IOProcess::(_processLogs) (273000) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:46,333::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:46,334::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:46,339::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:46,341::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:30:46,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:46,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:46,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:46,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:46,349::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:46,350::__init__::225::IOProcess::(_processLogs) (273001) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:46,352::__init__::225::IOProcess::(_processLogs) (273001) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:46,353::__init__::225::IOProcess::(_processLogs) (273001) Building response >Thread-18::DEBUG::2014-07-08 16:30:46,354::__init__::225::IOProcess::(_processLogs) (273001) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:46,355::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:46,356::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:46,361::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:46,362::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:30:46,363::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:46,365::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:46,366::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:46,368::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:46,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:46,370::__init__::225::IOProcess::(_processLogs) (273002) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:46,371::__init__::225::IOProcess::(_processLogs) (273002) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:46,372::__init__::225::IOProcess::(_processLogs) (273002) Building response >Thread-18::DEBUG::2014-07-08 16:30:46,377::__init__::225::IOProcess::(_processLogs) (273002) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:46,378::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:46,380::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:30:46,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:46,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172559 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:48,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:49,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266083 s, 38.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:51,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:51,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01984 s, 51.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:30:52,222::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:30:52,224::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad5f8340-3906-4c94-8a19-e590fa89b81b`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:52,224::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:30:52,240::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:52,242::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad5f8340-3906-4c94-8a19-e590fa89b81b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:30:52,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad5f8340-3906-4c94-8a19-e590fa89b81b`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:52,244::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:52,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:52,246::task::993::Storage.TaskManager.Task::(_decref) Task=`ad5f8340-3906-4c94-8a19-e590fa89b81b`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:30:52,262::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:30:52,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff721def-69c3-4493-b4e4-3dc05740ddfa`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:30:52,263::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:30:52,264::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1441b8c7-0922-4f2f-b0b9-027aa21f533c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:30:52,264::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:30:52,265::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:30:52,265::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1441b8c7-0922-4f2f-b0b9-027aa21f533c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:30:52,266::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff721def-69c3-4493-b4e4-3dc05740ddfa`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:30:52,266::task::993::Storage.TaskManager.Task::(_decref) Task=`ff721def-69c3-4493-b4e4-3dc05740ddfa`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:30:52,285::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579607040', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:52,285::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff721def-69c3-4493-b4e4-3dc05740ddfa`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847579607040', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:30:52,286::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff721def-69c3-4493-b4e4-3dc05740ddfa`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:30:52,286::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:30:52,286::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:30:52,287::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:30:52,287::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:30:52,287::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:30:52,287::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:30:52,288::task::993::Storage.TaskManager.Task::(_decref) Task=`ff721def-69c3-4493-b4e4-3dc05740ddfa`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:30:53,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:53,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176091 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:30:55,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:30:55,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea3f2874-66b5-47ad-a502-152b1b95c15c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:30:55,731::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:30:55,732::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539719', 'lastCheck': '9.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:30:55,732::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea3f2874-66b5-47ad-a502-152b1b95c15c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539719', 'lastCheck': '9.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:30:55,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea3f2874-66b5-47ad-a502-152b1b95c15c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:30:55,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:30:55,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:30:55,738::task::993::Storage.TaskManager.Task::(_decref) Task=`ea3f2874-66b5-47ad-a502-152b1b95c15c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:30:55,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405647 s, 25.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:56,386::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:56,386::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:56,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:56,387::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:56,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:56,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:56,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:56,388::__init__::225::IOProcess::(_processLogs) (273003) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:56,388::__init__::225::IOProcess::(_processLogs) (273003) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:56,388::__init__::225::IOProcess::(_processLogs) (273003) Building response >Thread-18::DEBUG::2014-07-08 16:30:56,389::__init__::225::IOProcess::(_processLogs) (273003) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:56,389::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:56,389::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:30:56,391::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:30:56,543::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000468204 s, 987 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:30:56,549::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:56,552::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:30:56,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:56,556::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:56,558::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:56,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:56,563::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:56,564::__init__::225::IOProcess::(_processLogs) (273004) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:30:56,566::__init__::225::IOProcess::(_processLogs) (273004) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:30:56,568::__init__::225::IOProcess::(_processLogs) (273004) Building response >Thread-18::DEBUG::2014-07-08 16:30:56,570::__init__::225::IOProcess::(_processLogs) (273004) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:56,572::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:56,573::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:30:56,582::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:56,583::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:30:56,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:56,586::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:56,588::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:56,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:56,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:56,592::__init__::225::IOProcess::(_processLogs) (273005) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:56,593::__init__::225::IOProcess::(_processLogs) (273005) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:56,595::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273005) Building response >Thread-18::DEBUG::2014-07-08 16:30:56,597::__init__::225::IOProcess::(_processLogs) (273005) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:56,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:56,600::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:56,605::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:56,606::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:30:56,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:56,608::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:56,610::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:56,611::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:56,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:56,614::__init__::225::IOProcess::(_processLogs) (273006) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:56,615::__init__::225::IOProcess::(_processLogs) (273006) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:56,616::__init__::225::IOProcess::(_processLogs) (273006) Building response >Thread-18::DEBUG::2014-07-08 16:30:56,618::__init__::225::IOProcess::(_processLogs) (273006) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:56,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:56,620::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:30:56,624::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:30:56,626::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:30:56,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:30:56,629::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:30:56,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:30:56,632::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:30:56,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:30:56,635::__init__::225::IOProcess::(_processLogs) (273007) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:30:56,636::__init__::225::IOProcess::(_processLogs) (273007) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:30:56,637::__init__::225::IOProcess::(_processLogs) (273007) Building response >Thread-18::DEBUG::2014-07-08 16:30:56,638::__init__::225::IOProcess::(_processLogs) (273007) Queuing response >Thread-18::DEBUG::2014-07-08 16:30:56,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:30:56,641::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:30:57,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:30:58,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017616 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:00,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:00,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173565 s, 59.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:02,301::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:31:02,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeacd0de-a53b-4c6c-a13c-6f223814adee`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:02,303::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:31:02,318::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:02,318::task::1191::Storage.TaskManager.Task::(prepare) Task=`eeacd0de-a53b-4c6c-a13c-6f223814adee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:02,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeacd0de-a53b-4c6c-a13c-6f223814adee`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:02,319::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:02,319::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:02,319::task::993::Storage.TaskManager.Task::(_decref) Task=`eeacd0de-a53b-4c6c-a13c-6f223814adee`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:31:02,336::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:31:02,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`26695dfd-e172-4d6a-af5c-faa887b9f35a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:31:02,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:31:02,339::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a4a7178b-12a1-4175-8549-f195e30f77fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:31:02,339::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:31:02,340::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:31:02,340::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a4a7178b-12a1-4175-8549-f195e30f77fc`::Granted request >Thread-6940::DEBUG::2014-07-08 16:31:02,341::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`26695dfd-e172-4d6a-af5c-faa887b9f35a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:31:02,341::task::993::Storage.TaskManager.Task::(_decref) Task=`26695dfd-e172-4d6a-af5c-faa887b9f35a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:31:02,360::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847577444352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:02,360::task::1191::Storage.TaskManager.Task::(prepare) Task=`26695dfd-e172-4d6a-af5c-faa887b9f35a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847577444352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:02,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`26695dfd-e172-4d6a-af5c-faa887b9f35a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:31:02,361::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:31:02,361::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:31:02,362::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:31:02,362::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:31:02,362::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:31:02,363::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:31:02,363::task::993::Storage.TaskManager.Task::(_decref) Task=`26695dfd-e172-4d6a-af5c-faa887b9f35a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:31:02,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:02,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017706 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:04,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:04,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0190324 s, 53.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:06,647::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:06,648::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:06,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:06,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:06,649::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:06,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:06,649::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:06,650::__init__::225::IOProcess::(_processLogs) (273008) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:06,650::__init__::225::IOProcess::(_processLogs) (273008) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:06,650::__init__::225::IOProcess::(_processLogs) (273008) Building response >Thread-18::DEBUG::2014-07-08 16:31:06,650::__init__::225::IOProcess::(_processLogs) (273008) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:06,650::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:06,651::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:31:06,654::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:31:06,812::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000416802 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:06,823::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:06,827::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:06,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:06,837::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:06,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:06,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:06,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:06,854::__init__::225::IOProcess::(_processLogs) (273009) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:06,858::__init__::225::IOProcess::(_processLogs) (273009) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:06,862::__init__::225::IOProcess::(_processLogs) DEBUG|(273009) Building response >Thread-18::DEBUG::2014-07-08 16:31:06,865::__init__::225::IOProcess::(_processLogs) (273009) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:06,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:06,872::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:31:06,892::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:06,894::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:31:06,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:06,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:06,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:06,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:06,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:06,902::__init__::225::IOProcess::(_processLogs) (273010) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:06,903::__init__::225::IOProcess::(_processLogs) (273010) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:06,905::__init__::225::IOProcess::(_processLogs) DEBUG|(273010) Building response >Thread-18::DEBUG::2014-07-08 16:31:06,906::__init__::225::IOProcess::(_processLogs) (273010) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:06,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:06,908::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:06,913::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:06,914::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:31:06,915::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:06,916::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:06,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:06,919::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:06,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:06,921::__init__::225::IOProcess::(_processLogs) (273011) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:06,922::__init__::225::IOProcess::(_processLogs) (273011) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:06,923::__init__::225::IOProcess::(_processLogs) (273011) Building response >Thread-18::DEBUG::2014-07-08 16:31:06,925::__init__::225::IOProcess::(_processLogs) (273011) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:06,926::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:06,927::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:06,932::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:06,934::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:31:06,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:06,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:06,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:06,939::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:06,940::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:06,942::__init__::225::IOProcess::(_processLogs) (273012) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:06,943::__init__::225::IOProcess::(_processLogs) (273012) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:06,944::__init__::225::IOProcess::(_processLogs) (273012) Building response >Thread-18::DEBUG::2014-07-08 16:31:06,946::__init__::225::IOProcess::(_processLogs) (273012) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:06,947::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:31:06,948::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:31:07,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:07,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180527 s, 56.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:09,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:09,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173738 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:11,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc173553-8c4b-42eb-ab66-cc80b003d66d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:11,012::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:31:11,013::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416802', 'lastCheck': '4.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:31:11,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc173553-8c4b-42eb-ab66-cc80b003d66d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416802', 'lastCheck': '4.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:31:11,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc173553-8c4b-42eb-ab66-cc80b003d66d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:11,014::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:11,014::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:11,014::task::993::Storage.TaskManager.Task::(_decref) Task=`bc173553-8c4b-42eb-ab66-cc80b003d66d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:31:11,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:11,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175144 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:12,377::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:31:12,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`192e5274-b70a-47fc-9fbd-2f1019df10ac`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:12,379::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:31:12,394::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:12,395::task::1191::Storage.TaskManager.Task::(prepare) Task=`192e5274-b70a-47fc-9fbd-2f1019df10ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:12,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`192e5274-b70a-47fc-9fbd-2f1019df10ac`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:12,395::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:12,395::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:12,396::task::993::Storage.TaskManager.Task::(_decref) Task=`192e5274-b70a-47fc-9fbd-2f1019df10ac`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:31:12,407::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:31:12,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9c24007-2011-426b-b98a-80294f10e69f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:31:12,408::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:31:12,409::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`15542510-de8c-461d-b8b1-e7ec5447288f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:31:12,410::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:31:12,410::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:31:12,411::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`15542510-de8c-461d-b8b1-e7ec5447288f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:31:12,411::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e9c24007-2011-426b-b98a-80294f10e69f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:31:12,412::task::993::Storage.TaskManager.Task::(_decref) Task=`e9c24007-2011-426b-b98a-80294f10e69f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:31:12,431::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847577444352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:12,431::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9c24007-2011-426b-b98a-80294f10e69f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847577444352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:12,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9c24007-2011-426b-b98a-80294f10e69f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:31:12,432::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:31:12,432::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:31:12,432::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:31:12,433::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:31:12,433::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:31:12,433::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:31:12,433::task::993::Storage.TaskManager.Task::(_decref) Task=`e9c24007-2011-426b-b98a-80294f10e69f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:31:13,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:14,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173487 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:16,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:16,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0220193 s, 46.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:16,954::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:16,954::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:16,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:16,955::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:16,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:16,955::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:16,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:16,956::__init__::225::IOProcess::(_processLogs) (273013) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:16,956::__init__::225::IOProcess::(_processLogs) (273013) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:16,956::__init__::225::IOProcess::(_processLogs) (273013) Building response >Thread-18::DEBUG::2014-07-08 16:31:16,957::__init__::225::IOProcess::(_processLogs) (273013) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:16,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:16,957::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:31:16,959::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:31:17,109::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000472954 s, 977 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:17,119::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:17,123::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:17,133::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:17,146::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:17,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:17,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:17,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:17,168::__init__::225::IOProcess::(_processLogs) (273014) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:17,172::__init__::225::IOProcess::(_processLogs) (273014) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:17,175::__init__::225::IOProcess::(_processLogs) (273014) Building response >Thread-18::DEBUG::2014-07-08 16:31:17,178::__init__::225::IOProcess::(_processLogs) (273014) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:17,181::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:17,184::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:31:17,207::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:31:17,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:17,215::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:17,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:17,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:17,219::__init__::225::IOProcess::(_processLogs) (273015) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:17,221::__init__::225::IOProcess::(_processLogs) (273015) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:17,222::__init__::225::IOProcess::(_processLogs) (273015) Building response >Thread-18::DEBUG::2014-07-08 16:31:17,223::__init__::225::IOProcess::(_processLogs) (273015) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:17,224::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:17,225::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:17,230::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:31:17,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:17,233::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:17,235::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:17,236::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:17,237::__init__::225::IOProcess::(_processLogs) (273016) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:17,239::__init__::225::IOProcess::(_processLogs) (273016) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:17,240::__init__::225::IOProcess::(_processLogs) (273016) Building response >Thread-18::DEBUG::2014-07-08 16:31:17,242::__init__::225::IOProcess::(_processLogs) (273016) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:17,243::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:17,244::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:17,250::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:31:17,251::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:17,252::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:17,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:17,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:17,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:17,258::__init__::225::IOProcess::(_processLogs) (273017) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:17,259::__init__::225::IOProcess::(_processLogs) (273017) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:17,260::__init__::225::IOProcess::(_processLogs) (273017) Building response >Thread-18::DEBUG::2014-07-08 16:31:17,262::__init__::225::IOProcess::(_processLogs) (273017) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:17,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:17,265::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:31:18,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:18,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176336 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:20,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:20,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0233758 s, 43.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:22,446::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:31:22,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`1249f004-df05-4b31-81cf-f999e90d90d0`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:22,448::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:31:22,463::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:22,464::task::1191::Storage.TaskManager.Task::(prepare) Task=`1249f004-df05-4b31-81cf-f999e90d90d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:22,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`1249f004-df05-4b31-81cf-f999e90d90d0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:22,464::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:22,465::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:22,465::task::993::Storage.TaskManager.Task::(_decref) Task=`1249f004-df05-4b31-81cf-f999e90d90d0`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:31:22,477::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:31:22,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`608d3c0b-02f7-4f07-80d5-962e75a19396`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:31:22,478::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:31:22,479::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ee2b33a5-b523-4156-9641-862140fed1f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:31:22,479::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:31:22,480::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:31:22,480::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ee2b33a5-b523-4156-9641-862140fed1f5`::Granted request >Thread-6940::DEBUG::2014-07-08 16:31:22,481::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`608d3c0b-02f7-4f07-80d5-962e75a19396`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:31:22,481::task::993::Storage.TaskManager.Task::(_decref) Task=`608d3c0b-02f7-4f07-80d5-962e75a19396`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:31:22,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847577444352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:22,501::task::1191::Storage.TaskManager.Task::(prepare) Task=`608d3c0b-02f7-4f07-80d5-962e75a19396`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847577444352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:22,501::task::595::Storage.TaskManager.Task::(_updateState) Task=`608d3c0b-02f7-4f07-80d5-962e75a19396`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:31:22,501::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:31:22,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:31:22,502::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:31:22,502::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:31:22,502::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:31:22,503::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:31:22,503::task::993::Storage.TaskManager.Task::(_decref) Task=`608d3c0b-02f7-4f07-80d5-962e75a19396`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:31:22,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:23,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174736 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:25,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:25,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472721 s, 21.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:26,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`155b6f4b-a45d-44ed-8a7a-d22fb06b3d4d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:26,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:31:26,197::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472954', 'lastCheck': '8.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:31:26,197::task::1191::Storage.TaskManager.Task::(prepare) Task=`155b6f4b-a45d-44ed-8a7a-d22fb06b3d4d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472954', 'lastCheck': '8.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:31:26,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`155b6f4b-a45d-44ed-8a7a-d22fb06b3d4d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:26,198::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:26,198::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:26,198::task::993::Storage.TaskManager.Task::(_decref) Task=`155b6f4b-a45d-44ed-8a7a-d22fb06b3d4d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:31:27,270::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:27,271::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:27,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:27,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:27,272::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:27,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:27,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:27,273::__init__::225::IOProcess::(_processLogs) (273018) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:27,273::__init__::225::IOProcess::(_processLogs) (273018) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:27,273::__init__::225::IOProcess::(_processLogs) (273018) Building response >Thread-18::DEBUG::2014-07-08 16:31:27,273::__init__::225::IOProcess::(_processLogs) (273018) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:27,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:27,274::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:31:27,276::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:31:27,424::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000465691 s, 992 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:27,431::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:27,432::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:27,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:27,435::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:27,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:27,438::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:27,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:27,441::__init__::225::IOProcess::(_processLogs) (273019) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:27,442::__init__::225::IOProcess::(_processLogs) (273019) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:27,443::__init__::225::IOProcess::(_processLogs) (273019) Building response >Thread-18::DEBUG::2014-07-08 16:31:27,444::__init__::225::IOProcess::(_processLogs) (273019) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:27,445::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:27,446::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:31:27,454::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:27,456::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:31:27,457::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:27,458::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:27,460::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:27,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:27,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:27,464::__init__::225::IOProcess::(_processLogs) (273020) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:27,465::__init__::225::IOProcess::(_processLogs) (273020) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:27,467::__init__::225::IOProcess::(_processLogs) (273020) Building response >Thread-18::DEBUG::2014-07-08 16:31:27,468::__init__::225::IOProcess::(_processLogs) (273020) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:27,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:27,471::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:27,484::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:27,488::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:31:27,499::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:27,504::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-6860::DEBUG::2014-07-08 16:31:27,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:31:27,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:27,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:27,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:27,680::__init__::225::IOProcess::(_processLogs) (273021) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:27,690::__init__::225::IOProcess::(_processLogs) (273021) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:27,699::__init__::225::IOProcess::(_processLogs) (273021) Building response >Thread-18::DEBUG::2014-07-08 16:31:27,706::__init__::225::IOProcess::(_processLogs) (273021) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:27,714::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:31:27,720::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:27,744::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:27,753::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:31:27,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:27,764::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:27,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:27,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:27,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:27,775::__init__::225::IOProcess::(_processLogs) (273022) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:27,778::__init__::225::IOProcess::(_processLogs) (273022) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:27,780::__init__::225::IOProcess::(_processLogs) (273022) Building response >Thread-18::DEBUG::2014-07-08 16:31:27,783::__init__::225::IOProcess::(_processLogs) (273022) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:27,866::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-6860::DEBUG::2014-07-08 16:31:27,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.12167 s, 8.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:27,869::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:31:30,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:30,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174183 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:32,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:32,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174758 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:32,580::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:31:32,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`4897542f-5cf7-41b6-8a6a-a64344057adb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:32,584::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:31:32,599::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:32,600::task::1191::Storage.TaskManager.Task::(prepare) Task=`4897542f-5cf7-41b6-8a6a-a64344057adb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:32,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`4897542f-5cf7-41b6-8a6a-a64344057adb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:32,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:32,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:32,604::task::993::Storage.TaskManager.Task::(_decref) Task=`4897542f-5cf7-41b6-8a6a-a64344057adb`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:31:32,618::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:31:32,618::task::595::Storage.TaskManager.Task::(_updateState) Task=`396f1059-65e5-4bfd-a8da-e8d2d7ea24ea`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:31:32,619::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:31:32,620::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7a9aa68d-6cce-4bcf-87a7-401171ffb8ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:31:32,620::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:31:32,621::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:31:32,621::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7a9aa68d-6cce-4bcf-87a7-401171ffb8ec`::Granted request >Thread-6940::DEBUG::2014-07-08 16:31:32,622::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`396f1059-65e5-4bfd-a8da-e8d2d7ea24ea`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:31:32,622::task::993::Storage.TaskManager.Task::(_decref) Task=`396f1059-65e5-4bfd-a8da-e8d2d7ea24ea`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:31:32,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847577444352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:32,642::task::1191::Storage.TaskManager.Task::(prepare) Task=`396f1059-65e5-4bfd-a8da-e8d2d7ea24ea`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847577444352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:32,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`396f1059-65e5-4bfd-a8da-e8d2d7ea24ea`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:31:32,642::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:31:32,642::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:31:32,643::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:31:32,643::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:31:32,643::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:31:32,644::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:31:32,644::task::993::Storage.TaskManager.Task::(_decref) Task=`396f1059-65e5-4bfd-a8da-e8d2d7ea24ea`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:31:34,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:34,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382405 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:36,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:37,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175697 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:37,879::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:37,880::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:37,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:37,880::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:37,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:37,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:37,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:37,881::__init__::225::IOProcess::(_processLogs) (273023) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:37,882::__init__::225::IOProcess::(_processLogs) (273023) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:37,882::__init__::225::IOProcess::(_processLogs) (273023) Building response >Thread-18::DEBUG::2014-07-08 16:31:37,882::__init__::225::IOProcess::(_processLogs) (273023) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:37,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:37,883::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:31:37,884::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:31:38,030::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000445017 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:38,032::__init__::225::IOProcess::(_processLogs) (273017) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:31:38,033::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:38,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:38,034::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:38,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:38,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:38,034::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:38,035::__init__::225::IOProcess::(_processLogs) (273024) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:38,035::__init__::225::IOProcess::(_processLogs) (273024) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:38,035::__init__::225::IOProcess::(_processLogs) (273024) Building response >Thread-18::DEBUG::2014-07-08 16:31:38,035::__init__::225::IOProcess::(_processLogs) (273024) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:38,036::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:38,036::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:31:38,038::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:31:38,038::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:38,039::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:38,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:38,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:38,039::__init__::225::IOProcess::(_processLogs) (273025) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:38,039::__init__::225::IOProcess::(_processLogs) (273025) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:38,040::__init__::225::IOProcess::(_processLogs) (273025) Building response >Thread-18::DEBUG::2014-07-08 16:31:38,040::__init__::225::IOProcess::(_processLogs) (273025) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:38,040::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:38,040::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:38,042::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:31:38,042::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:38,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:38,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:38,043::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:38,043::__init__::225::IOProcess::(_processLogs) (273026) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:38,043::__init__::225::IOProcess::(_processLogs) (273026) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:38,043::__init__::225::IOProcess::(_processLogs) (273026) Building response >Thread-18::DEBUG::2014-07-08 16:31:38,044::__init__::225::IOProcess::(_processLogs) (273026) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:38,044::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:38,044::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:38,045::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:31:38,045::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:38,046::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:38,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:38,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:38,046::__init__::225::IOProcess::(_processLogs) (273027) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:38,047::__init__::225::IOProcess::(_processLogs) (273027) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:38,047::__init__::225::IOProcess::(_processLogs) (273027) Building response >Thread-18::DEBUG::2014-07-08 16:31:38,047::__init__::225::IOProcess::(_processLogs) (273027) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:38,047::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:38,048::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:31:39,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:39,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172316 s, 59.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:41,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`29391bd5-f1e5-46ec-bbb2-fdbf2218f25c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:41,352::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:31:41,352::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445017', 'lastCheck': '3.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:31:41,353::task::1191::Storage.TaskManager.Task::(prepare) Task=`29391bd5-f1e5-46ec-bbb2-fdbf2218f25c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445017', 'lastCheck': '3.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:31:41,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`29391bd5-f1e5-46ec-bbb2-fdbf2218f25c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:41,353::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:41,353::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:41,354::task::993::Storage.TaskManager.Task::(_decref) Task=`29391bd5-f1e5-46ec-bbb2-fdbf2218f25c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:31:41,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:41,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174534 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:42,657::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:31:42,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`e78c704d-fd0a-4515-9a2a-2319c235f8aa`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:42,659::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:31:42,674::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:42,674::task::1191::Storage.TaskManager.Task::(prepare) Task=`e78c704d-fd0a-4515-9a2a-2319c235f8aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:42,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`e78c704d-fd0a-4515-9a2a-2319c235f8aa`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:42,675::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:42,675::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:42,675::task::993::Storage.TaskManager.Task::(_decref) Task=`e78c704d-fd0a-4515-9a2a-2319c235f8aa`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:31:42,687::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:31:42,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`f119fa6c-b1ab-41cf-8e20-a57ed145898b`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:31:42,688::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:31:42,690::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e602951c-716a-42c1-b276-bc60fe594ecf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:31:42,690::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:31:42,690::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:31:42,691::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e602951c-716a-42c1-b276-bc60fe594ecf`::Granted request >Thread-6940::DEBUG::2014-07-08 16:31:42,691::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f119fa6c-b1ab-41cf-8e20-a57ed145898b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:31:42,692::task::993::Storage.TaskManager.Task::(_decref) Task=`f119fa6c-b1ab-41cf-8e20-a57ed145898b`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:31:42,711::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:42,711::task::1191::Storage.TaskManager.Task::(prepare) Task=`f119fa6c-b1ab-41cf-8e20-a57ed145898b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:42,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`f119fa6c-b1ab-41cf-8e20-a57ed145898b`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:31:42,712::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:31:42,712::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:31:42,713::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:31:42,713::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:31:42,713::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:31:42,713::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:31:42,714::task::993::Storage.TaskManager.Task::(_decref) Task=`f119fa6c-b1ab-41cf-8e20-a57ed145898b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:31:43,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:43,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173655 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:46,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:46,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177202 s, 57.8 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:31:48,049::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:31:48,056::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:31:48,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,062::__init__::225::IOProcess::(_processLogs) (273028) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:31:48,063::__init__::225::IOProcess::(_processLogs) (273028) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:31:48,063::__init__::225::IOProcess::(_processLogs) (273028) Building response >Thread-18::DEBUG::2014-07-08 16:31:48,065::__init__::225::IOProcess::(_processLogs) (273028) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,065::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:31:48,066::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:31:48,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,068::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,068::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,068::__init__::225::IOProcess::(_processLogs) (273029) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:31:48,069::__init__::225::IOProcess::(_processLogs) (273029) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:31:48,069::__init__::225::IOProcess::(_processLogs) (273029) Building response >Thread-18::DEBUG::2014-07-08 16:31:48,069::__init__::225::IOProcess::(_processLogs) (273029) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,069::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,069::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:31:48,070::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:31:48,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,072::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,072::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,072::__init__::225::IOProcess::(_processLogs) (273030) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:31:48,073::__init__::225::IOProcess::(_processLogs) (273030) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:31:48,073::__init__::225::IOProcess::(_processLogs) (273030) Building response >Thread-18::DEBUG::2014-07-08 16:31:48,073::__init__::225::IOProcess::(_processLogs) (273030) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,073::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,074::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:31:48,075::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:31:48,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,079::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,081::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,087::__init__::225::IOProcess::(_processLogs) (273031) Finding callback 'glob'... >Thread-37::DEBUG::2014-07-08 16:31:48,087::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:31:48,089::__init__::225::IOProcess::(_processLogs) (273031) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:31:48,089::__init__::225::IOProcess::(_processLogs) (273031) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,090::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:31:48,091::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:31:48,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,092::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,093::__init__::225::IOProcess::(_processLogs) (273032) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:31:48,093::__init__::225::IOProcess::(_processLogs) (273032) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:31:48,093::__init__::225::IOProcess::(_processLogs) (273032) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,094::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:31:48,094::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:31:48,096::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:31:48,096::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,097::__init__::225::IOProcess::(_processLogs) (273033) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:31:48,098::__init__::225::IOProcess::(_processLogs) (273033) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,098::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:31:48,099::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:31:48,101::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:31:48,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,102::__init__::225::IOProcess::(_processLogs) (273034) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:48,102::__init__::225::IOProcess::(_processLogs) (273034) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:48,103::__init__::225::IOProcess::(_processLogs) (273034) Building response >Thread-18::DEBUG::2014-07-08 16:31:48,103::__init__::225::IOProcess::(_processLogs) (273034) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,103::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:48,104::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:31:48,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,106::__init__::225::IOProcess::(_processLogs) (273035) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:31:48,106::__init__::225::IOProcess::(_processLogs) (273035) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:31:48,106::__init__::225::IOProcess::(_processLogs) (273035) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,106::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,107::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:31:48,107::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:31:48,108::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:31:48,108::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:31:48,109::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:48,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,110::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,110::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,110::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,110::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,110::__init__::225::IOProcess::(_processLogs) (273036) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:48,111::__init__::225::IOProcess::(_processLogs) (273036) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:48,111::__init__::225::IOProcess::(_processLogs) (273036) Building response >Thread-18::DEBUG::2014-07-08 16:31:48,111::__init__::225::IOProcess::(_processLogs) (273036) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,111::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,112::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:31:48,113::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:31:48,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000428815 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:48,279::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:48,283::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,287::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,303::__init__::225::IOProcess::(_processLogs) (273037) Finding callback 'statvfs'... >Dummy-6860::DEBUG::2014-07-08 16:31:48,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:31:48,311::__init__::225::IOProcess::(_processLogs) (273037) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:48,469::__init__::225::IOProcess::(_processLogs) (273037) Building response >Thread-18::DEBUG::2014-07-08 16:31:48,474::__init__::225::IOProcess::(_processLogs) (273037) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,522::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:31:48,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,548::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,554::__init__::225::IOProcess::(_processLogs) (273038) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:48,558::__init__::225::IOProcess::(_processLogs) (273038) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:48,562::__init__::225::IOProcess::(_processLogs) (273038) Building response >Thread-18::DEBUG::2014-07-08 16:31:48,565::__init__::225::IOProcess::(_processLogs) (273038) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,568::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,571::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:48,665::__init__::225::IOProcess::(_processLogs) Message size is 168 >Dummy-6860::DEBUG::2014-07-08 16:31:48,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.113389 s, 9.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:48,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,670::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,676::__init__::225::IOProcess::(_processLogs) (273039) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:48,678::__init__::225::IOProcess::(_processLogs) (273039) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:48,680::__init__::225::IOProcess::(_processLogs) (273039) Building response >Thread-18::DEBUG::2014-07-08 16:31:48,682::__init__::225::IOProcess::(_processLogs) (273039) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,684::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,686::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:48,696::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:31:48,699::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:48,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:48,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:48,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:48,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:48,710::__init__::225::IOProcess::(_processLogs) (273040) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:48,712::__init__::225::IOProcess::(_processLogs) (273040) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:48,715::__init__::225::IOProcess::(_processLogs) (273040) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:48,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:48,719::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:31:50,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:51,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176308 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:52,728::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:31:52,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3b45cfa-3e87-4611-bb69-d451fefd9bda`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:52,730::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:31:52,746::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:52,747::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3b45cfa-3e87-4611-bb69-d451fefd9bda`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:31:52,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3b45cfa-3e87-4611-bb69-d451fefd9bda`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:52,747::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:52,747::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:52,748::task::993::Storage.TaskManager.Task::(_decref) Task=`d3b45cfa-3e87-4611-bb69-d451fefd9bda`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:31:52,759::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:31:52,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`2952bf1b-8aef-454f-b8ed-506cdd31c2d9`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:31:52,761::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:31:52,762::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ed66cfc8-321c-44ba-88ef-1feb3dbf9894`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:31:52,762::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:31:52,762::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:31:52,763::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ed66cfc8-321c-44ba-88ef-1feb3dbf9894`::Granted request >Thread-6940::DEBUG::2014-07-08 16:31:52,763::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2952bf1b-8aef-454f-b8ed-506cdd31c2d9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:31:52,764::task::993::Storage.TaskManager.Task::(_decref) Task=`2952bf1b-8aef-454f-b8ed-506cdd31c2d9`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:31:52,783::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:52,783::task::1191::Storage.TaskManager.Task::(prepare) Task=`2952bf1b-8aef-454f-b8ed-506cdd31c2d9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:31:52,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`2952bf1b-8aef-454f-b8ed-506cdd31c2d9`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:31:52,784::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:31:52,784::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:31:52,785::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:31:52,785::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:31:52,785::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:31:52,785::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:31:52,786::task::993::Storage.TaskManager.Task::(_decref) Task=`2952bf1b-8aef-454f-b8ed-506cdd31c2d9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:31:53,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:53,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174521 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:31:55,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:55,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204758 s, 50.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:31:56,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`6988b76a-4977-4bed-9fd9-bad7cb60e1e2`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:31:56,504::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:31:56,504::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428815', 'lastCheck': '7.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:31:56,505::task::1191::Storage.TaskManager.Task::(prepare) Task=`6988b76a-4977-4bed-9fd9-bad7cb60e1e2`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428815', 'lastCheck': '7.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:31:56,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`6988b76a-4977-4bed-9fd9-bad7cb60e1e2`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:31:56,505::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:31:56,505::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:31:56,506::task::993::Storage.TaskManager.Task::(_decref) Task=`6988b76a-4977-4bed-9fd9-bad7cb60e1e2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:31:57,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:31:57,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0203426 s, 50.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:58,727::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:58,728::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:58,728::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:58,728::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:58,728::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:58,729::__init__::225::IOProcess::(_processLogs) (273041) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:58,729::__init__::225::IOProcess::(_processLogs) (273041) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:58,729::__init__::225::IOProcess::(_processLogs) (273041) Building response >Thread-18::DEBUG::2014-07-08 16:31:58,729::__init__::225::IOProcess::(_processLogs) (273041) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:58,730::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:58,730::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:31:58,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:31:58,878::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000504241 s, 916 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:31:58,880::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:31:58,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:58,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:58,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:58,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:58,881::__init__::225::IOProcess::(_processLogs) (273042) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:31:58,882::__init__::225::IOProcess::(_processLogs) (273042) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:31:58,882::__init__::225::IOProcess::(_processLogs) (273042) Building response >Thread-18::DEBUG::2014-07-08 16:31:58,882::__init__::225::IOProcess::(_processLogs) (273042) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:58,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:58,883::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:31:58,885::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:31:58,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:58,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:58,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:58,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:58,886::__init__::225::IOProcess::(_processLogs) (273043) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:58,887::__init__::225::IOProcess::(_processLogs) (273043) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:58,887::__init__::225::IOProcess::(_processLogs) (273043) Building response >Thread-18::DEBUG::2014-07-08 16:31:58,887::__init__::225::IOProcess::(_processLogs) (273043) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:58,887::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:58,888::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:31:58,889::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:58,889::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:58,889::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:58,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:58,890::__init__::225::IOProcess::(_processLogs) (273044) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:58,890::__init__::225::IOProcess::(_processLogs) (273044) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:58,890::__init__::225::IOProcess::(_processLogs) (273044) Building response >Thread-18::DEBUG::2014-07-08 16:31:58,891::__init__::225::IOProcess::(_processLogs) (273044) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:58,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:58,891::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:31:58,892::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:31:58,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:31:58,893::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:31:58,893::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:31:58,893::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:31:58,894::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:31:58,894::__init__::225::IOProcess::(_processLogs) (273045) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:31:58,894::__init__::225::IOProcess::(_processLogs) (273045) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:31:58,894::__init__::225::IOProcess::(_processLogs) (273045) Building response >Thread-18::DEBUG::2014-07-08 16:31:58,895::__init__::225::IOProcess::(_processLogs) (273045) Queuing response >Thread-18::DEBUG::2014-07-08 16:31:58,895::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:31:58,895::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:31:59,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:00,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178219 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:02,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:02,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177797 s, 57.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:32:02,799::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:32:02,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7417d43-b3ba-458a-b1de-bd57f2cad665`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:02,800::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:32:02,815::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:02,816::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7417d43-b3ba-458a-b1de-bd57f2cad665`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:02,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7417d43-b3ba-458a-b1de-bd57f2cad665`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:02,816::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:02,817::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:02,817::task::993::Storage.TaskManager.Task::(_decref) Task=`e7417d43-b3ba-458a-b1de-bd57f2cad665`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:32:02,830::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:32:02,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`2781ce1b-7d82-4f9d-89ff-a593310030ba`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:32:02,832::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:32:02,833::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`07c83d05-222b-40dd-9f85-58d44a0d3d57`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:32:02,833::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:32:02,833::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:32:02,834::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`07c83d05-222b-40dd-9f85-58d44a0d3d57`::Granted request >Thread-6940::DEBUG::2014-07-08 16:32:02,834::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2781ce1b-7d82-4f9d-89ff-a593310030ba`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:32:02,834::task::993::Storage.TaskManager.Task::(_decref) Task=`2781ce1b-7d82-4f9d-89ff-a593310030ba`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:32:02,854::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:02,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`2781ce1b-7d82-4f9d-89ff-a593310030ba`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:02,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`2781ce1b-7d82-4f9d-89ff-a593310030ba`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:32:02,856::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:32:02,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:32:02,859::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:32:02,935::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:32:02,937::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:32:02,938::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:32:02,942::task::993::Storage.TaskManager.Task::(_decref) Task=`2781ce1b-7d82-4f9d-89ff-a593310030ba`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:32:04,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:04,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0679256 s, 15.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:06,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:07,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175166 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:08,898::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:08,898::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:08,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:08,899::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:08,899::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:08,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:08,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:08,900::__init__::225::IOProcess::(_processLogs) (273046) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:08,900::__init__::225::IOProcess::(_processLogs) (273046) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:08,901::__init__::225::IOProcess::(_processLogs) (273046) Building response >Thread-18::DEBUG::2014-07-08 16:32:08,901::__init__::225::IOProcess::(_processLogs) (273046) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:08,901::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:08,901::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:32:08,903::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:32:09,051::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000416244 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:09,056::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:09,058::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:09,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:09,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:09,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:09,063::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:09,064::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:09,066::__init__::225::IOProcess::(_processLogs) (273047) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:09,067::__init__::225::IOProcess::(_processLogs) (273047) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:09,068::__init__::225::IOProcess::(_processLogs) (273047) Building response >Thread-18::DEBUG::2014-07-08 16:32:09,069::__init__::225::IOProcess::(_processLogs) (273047) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:09,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:09,072::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:32:09,085::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:09,086::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:32:09,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:09,089::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:09,090::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:09,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:09,093::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:09,094::__init__::225::IOProcess::(_processLogs) (273048) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:09,096::__init__::225::IOProcess::(_processLogs) (273048) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:09,098::__init__::225::IOProcess::(_processLogs) (273048) Building response >Thread-18::DEBUG::2014-07-08 16:32:09,099::__init__::225::IOProcess::(_processLogs) (273048) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:09,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:09,102::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:09,107::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:09,108::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:32:09,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:09,111::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:09,113::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:09,114::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:09,116::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:09,117::__init__::225::IOProcess::(_processLogs) (273049) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:09,118::__init__::225::IOProcess::(_processLogs) (273049) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:09,120::__init__::225::IOProcess::(_processLogs) (273049) Building response >Thread-18::DEBUG::2014-07-08 16:32:09,121::__init__::225::IOProcess::(_processLogs) (273049) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:09,122::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:09,124::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:09,128::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:09,129::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:32:09,131::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:09,132::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:09,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:09,135::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:09,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:09,138::__init__::225::IOProcess::(_processLogs) (273050) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:09,139::__init__::225::IOProcess::(_processLogs) (273050) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:09,141::__init__::225::IOProcess::(_processLogs) (273050) Building response >Thread-18::DEBUG::2014-07-08 16:32:09,142::__init__::225::IOProcess::(_processLogs) (273050) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:09,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:09,145::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:32:09,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:09,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306109 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:11,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:11,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171252 s, 59.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:32:11,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdb368d9-3873-4850-a74b-d06955384e9e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:11,724::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:32:11,725::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416244', 'lastCheck': '2.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:32:11,726::task::1191::Storage.TaskManager.Task::(prepare) Task=`cdb368d9-3873-4850-a74b-d06955384e9e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416244', 'lastCheck': '2.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:32:11,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdb368d9-3873-4850-a74b-d06955384e9e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:11,728::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:11,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:11,730::task::993::Storage.TaskManager.Task::(_decref) Task=`cdb368d9-3873-4850-a74b-d06955384e9e`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:32:12,958::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:32:12,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`a579e501-286f-4d85-8c23-e7f93be74d7d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:12,959::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:32:12,974::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:12,975::task::1191::Storage.TaskManager.Task::(prepare) Task=`a579e501-286f-4d85-8c23-e7f93be74d7d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:12,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`a579e501-286f-4d85-8c23-e7f93be74d7d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:12,975::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:12,975::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:12,976::task::993::Storage.TaskManager.Task::(_decref) Task=`a579e501-286f-4d85-8c23-e7f93be74d7d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:32:12,988::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:32:12,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`477a08be-818b-44f3-b40c-061f3d11af44`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:32:12,990::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:32:12,991::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7c080bdc-f47e-42a2-b3ba-6baded98d37b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:32:12,991::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:32:12,991::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:32:12,992::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7c080bdc-f47e-42a2-b3ba-6baded98d37b`::Granted request >Thread-6940::DEBUG::2014-07-08 16:32:12,992::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`477a08be-818b-44f3-b40c-061f3d11af44`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:32:12,993::task::993::Storage.TaskManager.Task::(_decref) Task=`477a08be-818b-44f3-b40c-061f3d11af44`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:32:13,012::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:13,012::task::1191::Storage.TaskManager.Task::(prepare) Task=`477a08be-818b-44f3-b40c-061f3d11af44`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:13,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`477a08be-818b-44f3-b40c-061f3d11af44`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:32:13,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:32:13,013::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:32:13,013::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:32:13,014::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:32:13,014::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:32:13,014::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:32:13,015::task::993::Storage.TaskManager.Task::(_decref) Task=`477a08be-818b-44f3-b40c-061f3d11af44`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:32:13,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:14,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174954 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:16,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:16,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017359 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:18,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:18,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0836951 s, 12.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:19,151::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:19,151::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:19,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:19,152::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:19,152::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:19,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:19,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:19,153::__init__::225::IOProcess::(_processLogs) (273051) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:19,153::__init__::225::IOProcess::(_processLogs) (273051) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:19,153::__init__::225::IOProcess::(_processLogs) (273051) Building response >Thread-18::DEBUG::2014-07-08 16:32:19,153::__init__::225::IOProcess::(_processLogs) (273051) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:19,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:19,154::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:32:19,155::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:32:19,305::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00049139 s, 940 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:19,307::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:19,308::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:19,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:19,308::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:19,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:19,309::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:19,309::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:19,309::__init__::225::IOProcess::(_processLogs) (273052) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:19,309::__init__::225::IOProcess::(_processLogs) (273052) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:19,310::__init__::225::IOProcess::(_processLogs) (273052) Building response >Thread-18::DEBUG::2014-07-08 16:32:19,310::__init__::225::IOProcess::(_processLogs) (273052) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:19,310::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:19,310::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:32:19,312::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:19,313::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:32:19,313::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:19,313::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:19,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:19,314::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:19,314::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:19,314::__init__::225::IOProcess::(_processLogs) (273053) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:19,315::__init__::225::IOProcess::(_processLogs) (273053) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:19,315::__init__::225::IOProcess::(_processLogs) (273053) Building response >Thread-18::DEBUG::2014-07-08 16:32:19,315::__init__::225::IOProcess::(_processLogs) (273053) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:19,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:19,315::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:19,317::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:19,317::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:32:19,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:19,317::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:19,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:19,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:19,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:19,318::__init__::225::IOProcess::(_processLogs) (273054) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:19,319::__init__::225::IOProcess::(_processLogs) (273054) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:19,319::__init__::225::IOProcess::(_processLogs) (273054) Building response >Thread-18::DEBUG::2014-07-08 16:32:19,319::__init__::225::IOProcess::(_processLogs) (273054) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:19,319::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:19,320::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:19,321::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:19,321::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:32:19,321::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:19,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:19,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:19,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:19,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:19,322::__init__::225::IOProcess::(_processLogs) (273055) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:19,323::__init__::225::IOProcess::(_processLogs) (273055) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:19,323::__init__::225::IOProcess::(_processLogs) (273055) Building response >Thread-18::DEBUG::2014-07-08 16:32:19,323::__init__::225::IOProcess::(_processLogs) (273055) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:19,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:19,324::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:32:20,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:21,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476015 s, 21.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:32:23,029::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:32:23,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c8f8abf-0f51-417f-955f-1cdf843fb82f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:23,033::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Dummy-6860::DEBUG::2014-07-08 16:32:23,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::INFO::2014-07-08 16:32:23,194::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:23,197::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c8f8abf-0f51-417f-955f-1cdf843fb82f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:23,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c8f8abf-0f51-417f-955f-1cdf843fb82f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:23,200::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:23,201::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:23,201::task::993::Storage.TaskManager.Task::(_decref) Task=`1c8f8abf-0f51-417f-955f-1cdf843fb82f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:32:23,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176135 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:32:23,293::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:32:23,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`420c57c4-f73c-4e9a-bb76-e8eb38feafb2`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:32:23,298::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:32:23,301::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7b6f7815-7e0d-4eb8-b560-414a0afb8fd3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:32:23,301::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:32:23,303::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:32:23,304::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7b6f7815-7e0d-4eb8-b560-414a0afb8fd3`::Granted request >Thread-6940::DEBUG::2014-07-08 16:32:23,307::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`420c57c4-f73c-4e9a-bb76-e8eb38feafb2`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:32:23,308::task::993::Storage.TaskManager.Task::(_decref) Task=`420c57c4-f73c-4e9a-bb76-e8eb38feafb2`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:32:23,337::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:23,338::task::1191::Storage.TaskManager.Task::(prepare) Task=`420c57c4-f73c-4e9a-bb76-e8eb38feafb2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:23,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`420c57c4-f73c-4e9a-bb76-e8eb38feafb2`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:32:23,340::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:32:23,340::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:32:23,342::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:32:23,343::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:32:23,344::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:32:23,344::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:32:23,346::task::993::Storage.TaskManager.Task::(_decref) Task=`420c57c4-f73c-4e9a-bb76-e8eb38feafb2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:32:25,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:25,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174895 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:32:26,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`5700fcf0-b4dd-45ac-8cb0-2d9f9a5e6e04`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:26,946::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:32:26,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049139', 'lastCheck': '7.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:32:26,947::task::1191::Storage.TaskManager.Task::(prepare) Task=`5700fcf0-b4dd-45ac-8cb0-2d9f9a5e6e04`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049139', 'lastCheck': '7.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:32:26,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`5700fcf0-b4dd-45ac-8cb0-2d9f9a5e6e04`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:26,948::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:26,948::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:26,948::task::993::Storage.TaskManager.Task::(_decref) Task=`5700fcf0-b4dd-45ac-8cb0-2d9f9a5e6e04`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:32:27,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:27,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173688 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:29,327::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:29,327::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:29,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:29,328::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:29,328::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:29,328::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:29,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:29,329::__init__::225::IOProcess::(_processLogs) (273056) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:29,329::__init__::225::IOProcess::(_processLogs) (273056) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:29,329::__init__::225::IOProcess::(_processLogs) (273056) Building response >Thread-18::DEBUG::2014-07-08 16:32:29,330::__init__::225::IOProcess::(_processLogs) (273056) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:29,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:29,330::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:32:29,332::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:32:29,482::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000440269 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:29,487::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:29,489::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:29,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:29,492::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:29,493::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:29,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:29,496::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:29,497::__init__::225::IOProcess::(_processLogs) (273057) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:29,499::__init__::225::IOProcess::(_processLogs) (273057) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:29,500::__init__::225::IOProcess::(_processLogs) (273057) Building response >Thread-18::DEBUG::2014-07-08 16:32:29,501::__init__::225::IOProcess::(_processLogs) (273057) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:29,503::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:29,504::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:32:29,511::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:29,513::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:32:29,514::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:29,515::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:29,516::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:29,518::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:29,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:29,520::__init__::225::IOProcess::(_processLogs) (273058) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:29,522::__init__::225::IOProcess::(_processLogs) (273058) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:29,524::__init__::225::IOProcess::(_processLogs) (273058) Building response >Thread-18::DEBUG::2014-07-08 16:32:29,525::__init__::225::IOProcess::(_processLogs) (273058) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:29,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:29,528::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:29,533::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:29,534::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:32:29,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:29,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:29,538::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:29,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:29,541::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:29,543::__init__::225::IOProcess::(_processLogs) (273059) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:29,544::__init__::225::IOProcess::(_processLogs) (273059) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:29,545::__init__::225::IOProcess::(_processLogs) (273059) Building response >Thread-18::DEBUG::2014-07-08 16:32:29,546::__init__::225::IOProcess::(_processLogs) (273059) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:29,548::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:29,549::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:29,554::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:29,555::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:32:29,556::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:29,558::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:29,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:29,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:29,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:29,563::__init__::225::IOProcess::(_processLogs) (273060) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:29,565::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(273060) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:29,566::__init__::225::IOProcess::(_processLogs) (273060) Building response >Thread-18::DEBUG::2014-07-08 16:32:29,568::__init__::225::IOProcess::(_processLogs) (273060) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:29,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:29,570::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:32:29,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:30,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245396 s, 41.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:32,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:32,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177945 s, 57.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:32:33,361::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:32:33,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`f66b2f46-82d5-437c-b5ed-910b51c8af4f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:33,363::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:32:33,378::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:33,378::task::1191::Storage.TaskManager.Task::(prepare) Task=`f66b2f46-82d5-437c-b5ed-910b51c8af4f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:33,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`f66b2f46-82d5-437c-b5ed-910b51c8af4f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:33,379::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:33,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:33,380::task::993::Storage.TaskManager.Task::(_decref) Task=`f66b2f46-82d5-437c-b5ed-910b51c8af4f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:32:33,392::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:32:33,393::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac93a052-b925-47b0-a895-a80d98fc3045`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:32:33,393::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:32:33,394::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`be42761c-ca45-4bbf-ab88-9ea8ab69786a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:32:33,395::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:32:33,395::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:32:33,396::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`be42761c-ca45-4bbf-ab88-9ea8ab69786a`::Granted request >Thread-6940::DEBUG::2014-07-08 16:32:33,396::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac93a052-b925-47b0-a895-a80d98fc3045`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:32:33,397::task::993::Storage.TaskManager.Task::(_decref) Task=`ac93a052-b925-47b0-a895-a80d98fc3045`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:32:33,416::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:33,416::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac93a052-b925-47b0-a895-a80d98fc3045`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:33,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac93a052-b925-47b0-a895-a80d98fc3045`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:32:33,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:32:33,417::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:32:33,418::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:32:33,418::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:32:33,418::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:32:33,418::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:32:33,419::task::993::Storage.TaskManager.Task::(_decref) Task=`ac93a052-b925-47b0-a895-a80d98fc3045`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:32:34,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:34,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354631 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:36,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:37,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172699 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:39,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:39,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310012 s, 33.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:39,576::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:39,576::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:39,577::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:39,577::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:39,577::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:39,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:39,578::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:39,578::__init__::225::IOProcess::(_processLogs) (273061) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:39,578::__init__::225::IOProcess::(_processLogs) (273061) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:39,579::__init__::225::IOProcess::(_processLogs) (273061) Building response >Thread-18::DEBUG::2014-07-08 16:32:39,579::__init__::225::IOProcess::(_processLogs) (273061) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:39,579::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:39,579::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:32:39,581::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:32:39,728::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000636098 s, 726 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:39,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:39,735::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:39,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:39,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:39,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:39,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:39,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:39,744::__init__::225::IOProcess::(_processLogs) (273062) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:39,745::__init__::225::IOProcess::(_processLogs) (273062) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:39,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(273062) Building response >Thread-18::DEBUG::2014-07-08 16:32:39,749::__init__::225::IOProcess::(_processLogs) (273062) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:39,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:39,752::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:32:39,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:39,764::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:32:39,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:39,767::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:39,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:39,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:39,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:39,774::__init__::225::IOProcess::(_processLogs) (273063) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:39,775::__init__::225::IOProcess::(_processLogs) (273063) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:39,777::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(273063) Building response >Thread-18::DEBUG::2014-07-08 16:32:39,779::__init__::225::IOProcess::(_processLogs) (273063) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:39,780::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:39,782::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:39,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:39,789::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:32:39,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:39,793::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:39,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:39,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:39,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:39,798::__init__::225::IOProcess::(_processLogs) (273064) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:39,800::__init__::225::IOProcess::(_processLogs) (273064) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:39,801::__init__::225::IOProcess::(_processLogs) (273064) Building response >Thread-18::DEBUG::2014-07-08 16:32:39,803::__init__::225::IOProcess::(_processLogs) (273064) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:39,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:32:39,805::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:39,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:39,811::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:32:39,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:39,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:39,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:39,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:39,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:39,820::__init__::225::IOProcess::(_processLogs) (273065) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:39,821::__init__::225::IOProcess::(_processLogs) (273065) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:39,823::__init__::225::IOProcess::(_processLogs) (273065) Building response >Thread-18::DEBUG::2014-07-08 16:32:39,824::__init__::225::IOProcess::(_processLogs) (273065) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:39,826::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:39,827::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:32:41,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:41,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170204 s, 60.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:32:42,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`364b2202-45dc-4d2b-8f77-515e6429d579`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:42,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:32:42,130::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636098', 'lastCheck': '2.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:32:42,130::task::1191::Storage.TaskManager.Task::(prepare) Task=`364b2202-45dc-4d2b-8f77-515e6429d579`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636098', 'lastCheck': '2.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:32:42,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`364b2202-45dc-4d2b-8f77-515e6429d579`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:42,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:42,131::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:42,131::task::993::Storage.TaskManager.Task::(_decref) Task=`364b2202-45dc-4d2b-8f77-515e6429d579`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:32:43,433::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:32:43,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bbe9546-6c38-4943-bbdd-c852c314e683`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:43,439::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:32:43,456::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:43,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`8bbe9546-6c38-4943-bbdd-c852c314e683`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:43,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bbe9546-6c38-4943-bbdd-c852c314e683`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:43,460::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:43,460::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:43,460::task::993::Storage.TaskManager.Task::(_decref) Task=`8bbe9546-6c38-4943-bbdd-c852c314e683`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:32:43,471::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:32:43,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`57bddf2d-47bd-490e-9c84-99bc8dfb429c`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:32:43,473::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:32:43,474::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`221c3ef3-a59f-4fa6-a878-49bdae34dec6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:32:43,474::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:32:43,474::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:32:43,478::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`221c3ef3-a59f-4fa6-a878-49bdae34dec6`::Granted request >Thread-6940::DEBUG::2014-07-08 16:32:43,479::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`57bddf2d-47bd-490e-9c84-99bc8dfb429c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:32:43,479::task::993::Storage.TaskManager.Task::(_decref) Task=`57bddf2d-47bd-490e-9c84-99bc8dfb429c`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:32:43,498::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:43,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`57bddf2d-47bd-490e-9c84-99bc8dfb429c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:43,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`57bddf2d-47bd-490e-9c84-99bc8dfb429c`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:32:43,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:32:43,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:32:43,500::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:32:43,501::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:32:43,501::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:32:43,501::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:32:43,501::task::993::Storage.TaskManager.Task::(_decref) Task=`57bddf2d-47bd-490e-9c84-99bc8dfb429c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:32:43,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:44,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173414 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:46,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:46,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172604 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:48,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:48,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173618 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:49,833::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:49,834::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:49,834::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:49,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:49,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:49,835::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:49,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:49,835::__init__::225::IOProcess::(_processLogs) (273066) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:49,836::__init__::225::IOProcess::(_processLogs) (273066) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:49,836::__init__::225::IOProcess::(_processLogs) (273066) Building response >Thread-18::DEBUG::2014-07-08 16:32:49,836::__init__::225::IOProcess::(_processLogs) (273066) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:49,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:49,837::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:32:49,838::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:32:49,989::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000411494 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:32:49,994::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:49,995::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:32:49,996::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:49,998::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:49,999::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:50,000::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:50,001::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:50,002::__init__::225::IOProcess::(_processLogs) (273067) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:32:50,003::__init__::225::IOProcess::(_processLogs) (273067) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:32:50,005::__init__::225::IOProcess::(_processLogs) (273067) Building response >Thread-18::DEBUG::2014-07-08 16:32:50,006::__init__::225::IOProcess::(_processLogs) (273067) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:50,007::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:50,008::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:32:50,015::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:50,017::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:32:50,018::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:50,019::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:50,021::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:50,022::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:50,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:50,024::__init__::225::IOProcess::(_processLogs) (273068) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:50,025::__init__::225::IOProcess::(_processLogs) (273068) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:50,027::__init__::225::IOProcess::(_processLogs) (273068) Building response >Thread-18::DEBUG::2014-07-08 16:32:50,028::__init__::225::IOProcess::(_processLogs) (273068) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:50,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:50,031::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:50,035::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:50,037::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:32:50,038::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:50,039::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:50,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:50,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:50,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:50,044::__init__::225::IOProcess::(_processLogs) DEBUG|(273069) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:50,045::__init__::225::IOProcess::(_processLogs) (273069) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:50,046::__init__::225::IOProcess::(_processLogs) (273069) Building response >Thread-18::DEBUG::2014-07-08 16:32:50,048::__init__::225::IOProcess::(_processLogs) (273069) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:50,049::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:50,051::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:32:50,056::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:32:50,058::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:32:50,060::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:32:50,062::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:32:50,063::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:32:50,065::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:32:50,066::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:32:50,067::__init__::225::IOProcess::(_processLogs) (273070) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:32:50,069::__init__::225::IOProcess::(_processLogs) (273070) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:32:50,071::__init__::225::IOProcess::(_processLogs) DEBUG|(273070) Building response >Thread-18::DEBUG::2014-07-08 16:32:50,072::__init__::225::IOProcess::(_processLogs) (273070) Queuing response >Thread-18::DEBUG::2014-07-08 16:32:50,073::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:32:50,074::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:32:50,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:50,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174981 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:52,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:53,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175655 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:32:53,518::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:32:53,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bd0bf08-00bc-442b-99d6-5ad52fb24812`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:53,520::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:32:53,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:53,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`6bd0bf08-00bc-442b-99d6-5ad52fb24812`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:32:53,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bd0bf08-00bc-442b-99d6-5ad52fb24812`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:53,538::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:53,539::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:53,539::task::993::Storage.TaskManager.Task::(_decref) Task=`6bd0bf08-00bc-442b-99d6-5ad52fb24812`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:32:53,556::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:32:53,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`54542425-0ca0-473b-95cd-8888b665b01d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:32:53,560::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:32:53,564::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6829de50-4620-4041-a7ac-f56b58c2f43f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:32:53,565::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:32:53,567::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:32:53,568::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6829de50-4620-4041-a7ac-f56b58c2f43f`::Granted request >Thread-6940::DEBUG::2014-07-08 16:32:53,571::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`54542425-0ca0-473b-95cd-8888b665b01d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:32:53,572::task::993::Storage.TaskManager.Task::(_decref) Task=`54542425-0ca0-473b-95cd-8888b665b01d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:32:53,594::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:53,595::task::1191::Storage.TaskManager.Task::(prepare) Task=`54542425-0ca0-473b-95cd-8888b665b01d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:32:53,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`54542425-0ca0-473b-95cd-8888b665b01d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:32:53,595::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:32:53,595::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:32:53,596::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:32:53,596::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:32:53,596::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:32:53,597::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:32:53,597::task::993::Storage.TaskManager.Task::(_decref) Task=`54542425-0ca0-473b-95cd-8888b665b01d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:32:55,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:55,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176096 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:32:57,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0856379-be46-45fb-a9db-2e3bad77a71c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:32:57,292::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:32:57,292::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411494', 'lastCheck': '7.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:32:57,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0856379-be46-45fb-a9db-2e3bad77a71c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411494', 'lastCheck': '7.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:32:57,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0856379-be46-45fb-a9db-2e3bad77a71c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:32:57,293::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:32:57,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:32:57,294::task::993::Storage.TaskManager.Task::(_decref) Task=`d0856379-be46-45fb-a9db-2e3bad77a71c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:32:57,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:32:57,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017359 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:32:59,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:00,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103254 s, 9.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:00,083::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:00,084::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:00,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:00,086::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:00,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:00,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:00,089::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:00,090::__init__::225::IOProcess::(_processLogs) (273071) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:00,091::__init__::225::IOProcess::(_processLogs) (273071) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:00,092::__init__::225::IOProcess::(_processLogs) (273071) Building response >Thread-18::DEBUG::2014-07-08 16:33:00,093::__init__::225::IOProcess::(_processLogs) (273071) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:00,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:00,095::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:33:00,100::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:33:00,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000484127 s, 954 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:00,264::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:00,266::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:00,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:00,270::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:00,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:00,274::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:00,277::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:00,280::__init__::225::IOProcess::(_processLogs) (273072) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:00,283::__init__::225::IOProcess::(_processLogs) (273072) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:00,287::__init__::225::IOProcess::(_processLogs) DEBUG|(273072) Building response >Thread-18::DEBUG::2014-07-08 16:33:00,289::__init__::225::IOProcess::(_processLogs) (273072) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:00,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:00,294::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:33:00,310::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:00,312::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:33:00,315::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:00,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:00,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:00,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:00,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:00,332::__init__::225::IOProcess::(_processLogs) (273073) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:00,335::__init__::225::IOProcess::(_processLogs) (273073) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:00,338::__init__::225::IOProcess::(_processLogs) DEBUG|(273073) Building response >Thread-18::DEBUG::2014-07-08 16:33:00,340::__init__::225::IOProcess::(_processLogs) (273073) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:00,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:00,345::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:00,355::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:00,358::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:33:00,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:00,365::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:00,367::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:00,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:00,374::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:00,377::__init__::225::IOProcess::(_processLogs) (273074) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:00,380::__init__::225::IOProcess::(_processLogs) (273074) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:00,384::__init__::225::IOProcess::(_processLogs) DEBUG|(273074) Building response >Thread-18::DEBUG::2014-07-08 16:33:00,387::__init__::225::IOProcess::(_processLogs) (273074) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:00,390::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:00,396::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:00,415::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:00,419::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:33:00,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:00,425::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:00,428::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:00,430::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:00,433::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:00,436::__init__::225::IOProcess::(_processLogs) (273075) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:00,439::__init__::225::IOProcess::(_processLogs) (273075) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:00,443::__init__::225::IOProcess::(_processLogs) (273075) Building response >Thread-18::DEBUG::2014-07-08 16:33:00,445::__init__::225::IOProcess::(_processLogs) (273075) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:00,448::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:00,450::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:33:02,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:02,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017932 s, 57.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:33:03,610::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:33:03,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`29eb0b5a-7415-477b-8b04-0078c78d2ca0`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:03,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:33:03,626::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:03,627::task::1191::Storage.TaskManager.Task::(prepare) Task=`29eb0b5a-7415-477b-8b04-0078c78d2ca0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:03,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`29eb0b5a-7415-477b-8b04-0078c78d2ca0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:03,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:03,628::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:03,628::task::993::Storage.TaskManager.Task::(_decref) Task=`29eb0b5a-7415-477b-8b04-0078c78d2ca0`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:33:03,639::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:33:03,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`c460b32e-3008-4a5a-af53-3281ee364032`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:33:03,641::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:33:03,642::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cd607e59-3224-47c8-a5ff-1969de42d1ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:33:03,642::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:33:03,643::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:33:03,643::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cd607e59-3224-47c8-a5ff-1969de42d1ed`::Granted request >Thread-6940::DEBUG::2014-07-08 16:33:03,644::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c460b32e-3008-4a5a-af53-3281ee364032`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:33:03,644::task::993::Storage.TaskManager.Task::(_decref) Task=`c460b32e-3008-4a5a-af53-3281ee364032`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:33:03,663::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:03,664::task::1191::Storage.TaskManager.Task::(prepare) Task=`c460b32e-3008-4a5a-af53-3281ee364032`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:03,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`c460b32e-3008-4a5a-af53-3281ee364032`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:33:03,664::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:33:03,665::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:33:03,665::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:33:03,665::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:33:03,666::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:33:03,666::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:33:03,666::task::993::Storage.TaskManager.Task::(_decref) Task=`c460b32e-3008-4a5a-af53-3281ee364032`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:33:04,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:05,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172663 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:07,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:07,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171864 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:09,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:09,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175079 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:10,459::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:10,460::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:10,460::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:10,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:10,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:10,461::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:10,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:10,461::__init__::225::IOProcess::(_processLogs) (273076) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:10,462::__init__::225::IOProcess::(_processLogs) (273076) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:10,462::__init__::225::IOProcess::(_processLogs) (273076) Building response >Thread-18::DEBUG::2014-07-08 16:33:10,462::__init__::225::IOProcess::(_processLogs) (273076) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:10,462::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:10,463::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:33:10,464::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:33:10,631::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0161005 s, 28.7 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:10,636::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:10,638::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:10,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:10,640::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:10,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:10,643::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:10,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:10,646::__init__::225::IOProcess::(_processLogs) (273077) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:10,647::__init__::225::IOProcess::(_processLogs) (273077) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:10,648::__init__::225::IOProcess::(_processLogs) (273077) Building response >Thread-18::DEBUG::2014-07-08 16:33:10,650::__init__::225::IOProcess::(_processLogs) (273077) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:10,651::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:10,653::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:33:10,662::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:10,663::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:33:10,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:10,666::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:10,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:10,669::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:10,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:10,672::__init__::225::IOProcess::(_processLogs) (273078) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:10,674::__init__::225::IOProcess::(_processLogs) (273078) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:10,675::__init__::225::IOProcess::(_processLogs) (273078) Building response >Thread-18::DEBUG::2014-07-08 16:33:10,676::__init__::225::IOProcess::(_processLogs) (273078) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:10,678::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:33:10,679::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:10,685::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:10,686::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:33:10,687::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:10,689::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:10,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:10,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:10,693::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:10,695::__init__::225::IOProcess::(_processLogs) (273079) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:10,697::__init__::225::IOProcess::(_processLogs) (273079) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:10,698::__init__::225::IOProcess::(_processLogs) (273079) Building response >Thread-18::DEBUG::2014-07-08 16:33:10,700::__init__::225::IOProcess::(_processLogs) (273079) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:10,701::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:33:10,703::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:10,708::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:10,709::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:33:10,711::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:10,713::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:10,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:10,716::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:10,717::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:10,719::__init__::225::IOProcess::(_processLogs) (273080) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:10,720::__init__::225::IOProcess::(_processLogs) (273080) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:10,721::__init__::225::IOProcess::(_processLogs) (273080) Building response >Thread-18::DEBUG::2014-07-08 16:33:10,722::__init__::225::IOProcess::(_processLogs) (273080) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:10,723::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:10,724::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:33:11,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:11,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173948 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:33:12,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0b43e40-cd51-4229-b365-60a1f400e3ca`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:12,504::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:33:12,504::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0161005', 'lastCheck': '1.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:33:12,504::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0b43e40-cd51-4229-b365-60a1f400e3ca`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0161005', 'lastCheck': '1.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:33:12,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0b43e40-cd51-4229-b365-60a1f400e3ca`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:12,505::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:12,505::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:12,505::task::993::Storage.TaskManager.Task::(_decref) Task=`c0b43e40-cd51-4229-b365-60a1f400e3ca`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:33:13,684::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:33:13,685::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b9b481c-ac86-423e-8ea6-45c4c5af188d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:13,685::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:33:13,700::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:13,701::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b9b481c-ac86-423e-8ea6-45c4c5af188d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:13,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b9b481c-ac86-423e-8ea6-45c4c5af188d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:13,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:13,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:13,702::task::993::Storage.TaskManager.Task::(_decref) Task=`6b9b481c-ac86-423e-8ea6-45c4c5af188d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:33:13,713::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:33:13,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc48117b-0ea1-4e69-bfcd-9bb2a5c8f69c`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:33:13,714::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:33:13,715::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8ff5dcbb-b8f2-44c4-8718-9f2f2ad5df98`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:33:13,715::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:33:13,716::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:33:13,716::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8ff5dcbb-b8f2-44c4-8718-9f2f2ad5df98`::Granted request >Thread-6940::DEBUG::2014-07-08 16:33:13,717::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bc48117b-0ea1-4e69-bfcd-9bb2a5c8f69c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:33:13,717::task::993::Storage.TaskManager.Task::(_decref) Task=`bc48117b-0ea1-4e69-bfcd-9bb2a5c8f69c`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:33:13,736::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:13,736::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc48117b-0ea1-4e69-bfcd-9bb2a5c8f69c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:13,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc48117b-0ea1-4e69-bfcd-9bb2a5c8f69c`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:33:13,737::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:33:13,737::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:33:13,737::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:33:13,738::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:33:13,738::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:33:13,738::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:33:13,738::task::993::Storage.TaskManager.Task::(_decref) Task=`bc48117b-0ea1-4e69-bfcd-9bb2a5c8f69c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:33:13,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:14,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430019 s, 23.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:16,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:16,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173333 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:18,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:18,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235211 s, 43.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:20,731::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:20,732::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:20,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:20,732::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:20,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:20,733::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:20,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:20,733::__init__::225::IOProcess::(_processLogs) (273081) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:20,734::__init__::225::IOProcess::(_processLogs) (273081) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:20,734::__init__::225::IOProcess::(_processLogs) (273081) Building response >Thread-18::DEBUG::2014-07-08 16:33:20,734::__init__::225::IOProcess::(_processLogs) (273081) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:20,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:20,735::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Dummy-6860::DEBUG::2014-07-08 16:33:20,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:33:20,910::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:33:21,065::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000695602 s, 664 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:21,072::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:21,075::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:21,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:21,079::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:21,082::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:21,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:21,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:21,090::__init__::225::IOProcess::(_processLogs) (273082) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:21,093::__init__::225::IOProcess::(_processLogs) (273082) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:21,096::__init__::225::IOProcess::(_processLogs) (273082) Building response >Thread-18::DEBUG::2014-07-08 16:33:21,099::__init__::225::IOProcess::(_processLogs) (273082) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:21,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:21,106::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:33:21,123::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:21,127::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:33:21,211::__init__::225::IOProcess::(_processLogs) Marshaling message... >Dummy-6860::DEBUG::2014-07-08 16:33:21,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.235197 s, 4.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:21,214::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:21,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:21,220::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:21,222::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:21,224::__init__::225::IOProcess::(_processLogs) (273083) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:21,226::__init__::225::IOProcess::(_processLogs) (273083) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:21,228::__init__::225::IOProcess::(_processLogs) (273083) Building response >Thread-18::DEBUG::2014-07-08 16:33:21,231::__init__::225::IOProcess::(_processLogs) (273083) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:21,234::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:21,236::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:21,246::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:21,250::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:33:21,253::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:21,256::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:21,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:21,262::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:21,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:21,269::__init__::225::IOProcess::(_processLogs) (273084) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:21,272::__init__::225::IOProcess::(_processLogs) (273084) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:21,275::__init__::225::IOProcess::(_processLogs) (273084) Building response >Thread-18::DEBUG::2014-07-08 16:33:21,278::__init__::225::IOProcess::(_processLogs) (273084) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:21,281::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:21,284::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:21,295::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:21,298::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:33:21,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:21,304::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:21,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:21,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:21,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:21,316::__init__::225::IOProcess::(_processLogs) (273085) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:21,319::__init__::225::IOProcess::(_processLogs) (273085) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:21,323::__init__::225::IOProcess::(_processLogs) (273085) Building response >Thread-18::DEBUG::2014-07-08 16:33:21,326::__init__::225::IOProcess::(_processLogs) (273085) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:21,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:21,331::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:33:23,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:23,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174124 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:33:23,760::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:33:23,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a752937-7846-435c-b910-66aeeeeb519e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:23,762::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:33:23,777::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:23,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a752937-7846-435c-b910-66aeeeeb519e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:23,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a752937-7846-435c-b910-66aeeeeb519e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:23,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:23,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:23,779::task::993::Storage.TaskManager.Task::(_decref) Task=`6a752937-7846-435c-b910-66aeeeeb519e`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:33:23,790::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:33:23,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`47eb5a60-d2e2-4d5c-9b31-084c2f322156`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:33:23,791::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:33:23,792::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c23c8234-4b9e-4b8b-bc91-d84e096ee19e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:33:23,792::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:33:23,793::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:33:23,793::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c23c8234-4b9e-4b8b-bc91-d84e096ee19e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:33:23,794::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`47eb5a60-d2e2-4d5c-9b31-084c2f322156`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:33:23,794::task::993::Storage.TaskManager.Task::(_decref) Task=`47eb5a60-d2e2-4d5c-9b31-084c2f322156`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:33:23,813::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:23,813::task::1191::Storage.TaskManager.Task::(prepare) Task=`47eb5a60-d2e2-4d5c-9b31-084c2f322156`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:23,814::task::595::Storage.TaskManager.Task::(_updateState) Task=`47eb5a60-d2e2-4d5c-9b31-084c2f322156`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:33:23,814::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:33:23,814::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:33:23,814::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:33:23,815::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:33:23,815::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:33:23,815::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:33:23,816::task::993::Storage.TaskManager.Task::(_decref) Task=`47eb5a60-d2e2-4d5c-9b31-084c2f322156`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:33:25,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:26,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0944074 s, 10.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:33:27,751::task::595::Storage.TaskManager.Task::(_updateState) Task=`9739a0df-fd3d-472d-a54e-911ded23fdd2`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:27,751::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:33:27,752::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695602', 'lastCheck': '6.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:33:27,752::task::1191::Storage.TaskManager.Task::(prepare) Task=`9739a0df-fd3d-472d-a54e-911ded23fdd2`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695602', 'lastCheck': '6.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:33:27,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`9739a0df-fd3d-472d-a54e-911ded23fdd2`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:27,753::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:27,753::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:27,753::task::993::Storage.TaskManager.Task::(_decref) Task=`9739a0df-fd3d-472d-a54e-911ded23fdd2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:33:28,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:28,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313071 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:30,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:30,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017723 s, 57.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:31,340::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:31,340::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:31,340::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:31,341::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:31,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:31,341::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:31,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:31,342::__init__::225::IOProcess::(_processLogs) (273086) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:31,342::__init__::225::IOProcess::(_processLogs) (273086) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:31,342::__init__::225::IOProcess::(_processLogs) (273086) Building response >Thread-18::DEBUG::2014-07-08 16:33:31,342::__init__::225::IOProcess::(_processLogs) (273086) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:31,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:31,343::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:33:31,345::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:33:31,509::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000562906 s, 821 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:31,516::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:31,518::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:31,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:31,521::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:31,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:31,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:31,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:31,528::__init__::225::IOProcess::(_processLogs) (273087) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:31,530::__init__::225::IOProcess::(_processLogs) (273087) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:31,531::__init__::225::IOProcess::(_processLogs) (273087) Building response >Thread-18::DEBUG::2014-07-08 16:33:31,533::__init__::225::IOProcess::(_processLogs) (273087) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:31,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:31,536::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:33:31,545::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:31,547::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:33:31,548::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:31,550::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:31,551::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:31,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:31,554::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:31,555::__init__::225::IOProcess::(_processLogs) (273088) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:31,556::__init__::225::IOProcess::(_processLogs) (273088) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:31,558::__init__::225::IOProcess::(_processLogs) (273088) Building response >Thread-18::DEBUG::2014-07-08 16:33:31,559::__init__::225::IOProcess::(_processLogs) (273088) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:31,561::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:31,562::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:31,567::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:31,569::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:33:31,570::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:31,571::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:31,572::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:31,574::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:31,576::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:31,577::__init__::225::IOProcess::(_processLogs) (273089) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:31,578::__init__::225::IOProcess::(_processLogs) (273089) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:31,579::__init__::225::IOProcess::(_processLogs) (273089) Building response >Thread-18::DEBUG::2014-07-08 16:33:31,581::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273089) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:31,583::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:31,584::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:31,589::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:31,591::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:33:31,593::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:31,594::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:31,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:31,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:31,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:31,600::__init__::225::IOProcess::(_processLogs) (273090) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:31,601::__init__::225::IOProcess::(_processLogs) (273090) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:31,602::__init__::225::IOProcess::(_processLogs) (273090) Building response >Thread-18::DEBUG::2014-07-08 16:33:31,603::__init__::225::IOProcess::(_processLogs) (273090) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:31,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:31,607::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:33:32,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:32,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175157 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:33:33,829::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:33:33,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`5650360f-f938-4c17-9f2b-7b1522f14b85`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:33,831::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:33:33,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:33,847::task::1191::Storage.TaskManager.Task::(prepare) Task=`5650360f-f938-4c17-9f2b-7b1522f14b85`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:33,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`5650360f-f938-4c17-9f2b-7b1522f14b85`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:33,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:33,848::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:33,848::task::993::Storage.TaskManager.Task::(_decref) Task=`5650360f-f938-4c17-9f2b-7b1522f14b85`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:33:33,859::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:33:33,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`75e4c42b-f244-4c7a-a162-ddf28fb43277`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:33:33,861::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:33:33,862::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`63e4a017-6f98-4b38-bffa-cb46d254ad16`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:33:33,862::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:33:33,863::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:33:33,863::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`63e4a017-6f98-4b38-bffa-cb46d254ad16`::Granted request >Thread-6940::DEBUG::2014-07-08 16:33:33,864::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`75e4c42b-f244-4c7a-a162-ddf28fb43277`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:33:33,864::task::993::Storage.TaskManager.Task::(_decref) Task=`75e4c42b-f244-4c7a-a162-ddf28fb43277`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:33:33,884::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:33,884::task::1191::Storage.TaskManager.Task::(prepare) Task=`75e4c42b-f244-4c7a-a162-ddf28fb43277`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:33,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`75e4c42b-f244-4c7a-a162-ddf28fb43277`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:33:33,884::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:33:33,885::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:33:33,885::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:33:33,886::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:33:33,886::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:33:33,886::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:33:33,886::task::993::Storage.TaskManager.Task::(_decref) Task=`75e4c42b-f244-4c7a-a162-ddf28fb43277`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:33:34,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:35,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173959 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:37,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:37,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169959 s, 60.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:39,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:39,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171624 s, 59.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:41,613::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:41,613::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:41,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:41,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:41,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:41,614::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:41,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:41,615::__init__::225::IOProcess::(_processLogs) (273091) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:41,615::__init__::225::IOProcess::(_processLogs) (273091) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:41,615::__init__::225::IOProcess::(_processLogs) (273091) Building response >Thread-18::DEBUG::2014-07-08 16:33:41,616::__init__::225::IOProcess::(_processLogs) (273091) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:41,616::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:41,616::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:33:41,618::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:41,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:33:41,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000552571 s, 836 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:41,930::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:41,934::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:41,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:41,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:41,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:41,946::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:41,949::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:41,957::__init__::225::IOProcess::(_processLogs) (273092) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:41,961::__init__::225::IOProcess::(_processLogs) (273092) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:41,965::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273092) Building response >Thread-18::DEBUG::2014-07-08 16:33:41,968::__init__::225::IOProcess::(_processLogs) (273092) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:41,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:41,976::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:33:41,995::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:42,000::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:33:42,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:42,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-6860::DEBUG::2014-07-08 16:33:42,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0735158 s, 13.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:42,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:42,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:42,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:42,095::__init__::225::IOProcess::(_processLogs) (273093) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:42,097::__init__::225::IOProcess::(_processLogs) (273093) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:42,100::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273093) Building response >Thread-18::DEBUG::2014-07-08 16:33:42,102::__init__::225::IOProcess::(_processLogs) (273093) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:42,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:42,107::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:42,116::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:42,119::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:33:42,121::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:42,124::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:42,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:42,129::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:42,132::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:42,134::__init__::225::IOProcess::(_processLogs) (273094) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:42,137::__init__::225::IOProcess::(_processLogs) (273094) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:42,139::__init__::225::IOProcess::(_processLogs) (273094) Building response >Thread-18::DEBUG::2014-07-08 16:33:42,142::__init__::225::IOProcess::(_processLogs) (273094) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:42,144::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:42,146::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:42,154::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:42,157::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:33:42,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:42,162::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:42,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:42,167::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:42,171::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:42,174::__init__::225::IOProcess::(_processLogs) (273095) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:42,176::__init__::225::IOProcess::(_processLogs) (273095) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:42,177::__init__::225::IOProcess::(_processLogs) (273095) Building response >Thread-18::DEBUG::2014-07-08 16:33:42,180::__init__::225::IOProcess::(_processLogs) (273095) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:42,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:42,184::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:33:42,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`14cf7c69-ff41-4516-a73b-9ba1b3f27c1a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:42,951::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:33:42,951::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552571', 'lastCheck': '0.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:33:42,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`14cf7c69-ff41-4516-a73b-9ba1b3f27c1a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552571', 'lastCheck': '0.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:33:42,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`14cf7c69-ff41-4516-a73b-9ba1b3f27c1a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:42,952::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:42,952::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:42,952::task::993::Storage.TaskManager.Task::(_decref) Task=`14cf7c69-ff41-4516-a73b-9ba1b3f27c1a`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:33:43,899::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:33:43,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd7c4188-9131-4a31-8c8a-5cec7597319c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:43,900::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:33:43,915::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:43,915::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd7c4188-9131-4a31-8c8a-5cec7597319c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:43,916::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd7c4188-9131-4a31-8c8a-5cec7597319c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:43,916::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:43,916::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:43,916::task::993::Storage.TaskManager.Task::(_decref) Task=`cd7c4188-9131-4a31-8c8a-5cec7597319c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:33:43,928::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:33:43,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`df6609eb-2849-4155-9a5d-557e05b6604b`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:33:43,929::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:33:43,930::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4846621c-4634-40ee-9034-ca818c63a920`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:33:43,930::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:33:43,931::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:33:43,931::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4846621c-4634-40ee-9034-ca818c63a920`::Granted request >Thread-6940::DEBUG::2014-07-08 16:33:43,932::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`df6609eb-2849-4155-9a5d-557e05b6604b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:33:43,932::task::993::Storage.TaskManager.Task::(_decref) Task=`df6609eb-2849-4155-9a5d-557e05b6604b`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:33:43,951::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:43,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`df6609eb-2849-4155-9a5d-557e05b6604b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:43,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`df6609eb-2849-4155-9a5d-557e05b6604b`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:33:43,952::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:33:43,952::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:33:43,952::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:33:43,953::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:33:43,953::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:33:43,953::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:33:43,954::task::993::Storage.TaskManager.Task::(_decref) Task=`df6609eb-2849-4155-9a5d-557e05b6604b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:33:44,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:44,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350488 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:46,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:46,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173261 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:48,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:49,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0218701 s, 46.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:51,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:51,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174976 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:52,192::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:52,193::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:52,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:52,193::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:52,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:52,194::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:52,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:52,194::__init__::225::IOProcess::(_processLogs) (273096) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:52,195::__init__::225::IOProcess::(_processLogs) (273096) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:52,195::__init__::225::IOProcess::(_processLogs) (273096) Building response >Thread-18::DEBUG::2014-07-08 16:33:52,195::__init__::225::IOProcess::(_processLogs) (273096) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:52,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:52,196::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:33:52,197::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:33:52,344::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000472675 s, 977 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:33:52,346::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:52,346::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:33:52,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:52,347::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:52,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:52,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:52,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:52,348::__init__::225::IOProcess::(_processLogs) (273097) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:33:52,348::__init__::225::IOProcess::(_processLogs) (273097) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:33:52,349::__init__::225::IOProcess::(_processLogs) (273097) Building response >Thread-18::DEBUG::2014-07-08 16:33:52,349::__init__::225::IOProcess::(_processLogs) (273097) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:52,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:52,349::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:33:52,360::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:52,360::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:33:52,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:52,361::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:52,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:52,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:52,362::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:52,363::__init__::225::IOProcess::(_processLogs) (273098) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:52,363::__init__::225::IOProcess::(_processLogs) (273098) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:52,363::__init__::225::IOProcess::(_processLogs) (273098) Building response >Thread-18::DEBUG::2014-07-08 16:33:52,364::__init__::225::IOProcess::(_processLogs) (273098) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:52,364::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:52,365::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:52,368::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:52,378::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:33:52,380::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:52,381::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:52,382::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:52,383::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:52,385::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:52,387::__init__::225::IOProcess::(_processLogs) (273099) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:52,388::__init__::225::IOProcess::(_processLogs) (273099) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:52,390::__init__::225::IOProcess::(_processLogs) (273099) Building response >Thread-18::DEBUG::2014-07-08 16:33:52,391::__init__::225::IOProcess::(_processLogs) (273099) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:52,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:52,394::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:33:52,399::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:33:52,399::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:33:52,399::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:33:52,400::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:33:52,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:33:52,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:33:52,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:33:52,402::__init__::225::IOProcess::(_processLogs) (273100) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:33:52,402::__init__::225::IOProcess::(_processLogs) (273100) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:33:52,404::__init__::225::IOProcess::(_processLogs) (273100) Building response >Thread-18::DEBUG::2014-07-08 16:33:52,409::__init__::225::IOProcess::(_processLogs) (273100) Queuing response >Thread-18::DEBUG::2014-07-08 16:33:52,411::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:33:52,412::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:33:53,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:53,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176294 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:33:53,968::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:33:53,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`69bd6e3a-d6a5-483e-9fb3-87f72386c124`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:53,969::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:33:53,985::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:53,986::task::1191::Storage.TaskManager.Task::(prepare) Task=`69bd6e3a-d6a5-483e-9fb3-87f72386c124`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:33:53,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`69bd6e3a-d6a5-483e-9fb3-87f72386c124`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:53,986::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:53,986::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:53,987::task::993::Storage.TaskManager.Task::(_decref) Task=`69bd6e3a-d6a5-483e-9fb3-87f72386c124`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:33:53,998::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:33:53,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`31c674bd-edfc-446a-95a5-04ade57613e3`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:33:53,999::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:33:54,000::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7b7e90bb-4e88-4283-8222-9218b64e9bb4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:33:54,001::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:33:54,001::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:33:54,001::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7b7e90bb-4e88-4283-8222-9218b64e9bb4`::Granted request >Thread-6940::DEBUG::2014-07-08 16:33:54,002::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`31c674bd-edfc-446a-95a5-04ade57613e3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:33:54,002::task::993::Storage.TaskManager.Task::(_decref) Task=`31c674bd-edfc-446a-95a5-04ade57613e3`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:33:54,021::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:54,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`31c674bd-edfc-446a-95a5-04ade57613e3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:33:54,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`31c674bd-edfc-446a-95a5-04ade57613e3`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:33:54,022::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:33:54,023::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:33:54,023::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:33:54,023::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:33:54,024::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:33:54,024::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:33:54,024::task::993::Storage.TaskManager.Task::(_decref) Task=`31c674bd-edfc-446a-95a5-04ade57613e3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:33:55,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:33:56,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017406 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:33:58,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:33:58,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`dff7807d-e1b0-462a-9904-90a787a2aba0`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:33:58,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:33:58,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472675', 'lastCheck': '5.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:33:58,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`dff7807d-e1b0-462a-9904-90a787a2aba0`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472675', 'lastCheck': '5.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:33:58,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`dff7807d-e1b0-462a-9904-90a787a2aba0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:33:58,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:33:58,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:33:58,207::task::993::Storage.TaskManager.Task::(_decref) Task=`dff7807d-e1b0-462a-9904-90a787a2aba0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:33:58,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412 s, 24.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:00,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:00,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175736 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:02,419::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:02,420::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:02,420::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:02,420::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:02,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:02,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:02,421::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:02,421::__init__::225::IOProcess::(_processLogs) (273101) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:02,421::__init__::225::IOProcess::(_processLogs) (273101) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:02,422::__init__::225::IOProcess::(_processLogs) (273101) Building response >Thread-18::DEBUG::2014-07-08 16:34:02,422::__init__::225::IOProcess::(_processLogs) (273101) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:02,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:02,422::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:34:02,424::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:34:02,571::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000506197 s, 913 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:02,577::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:02,579::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:02,581::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:02,582::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:02,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:02,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:02,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:02,587::__init__::225::IOProcess::(_processLogs) (273102) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:02,589::__init__::225::IOProcess::(_processLogs) (273102) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:02,590::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273102) Building response >Thread-18::DEBUG::2014-07-08 16:34:02,591::__init__::225::IOProcess::(_processLogs) (273102) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:02,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:02,593::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:34:02,602::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:02,604::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:34:02,605::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:02,606::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:02,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:02,610::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:02,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:02,612::__init__::225::IOProcess::(_processLogs) (273103) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:02,613::__init__::225::IOProcess::(_processLogs) (273103) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:02,615::__init__::225::IOProcess::(_processLogs) (273103) Building response >Thread-18::DEBUG::2014-07-08 16:34:02,617::__init__::225::IOProcess::(_processLogs) (273103) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:34:02,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:34:02,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:02,788::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:02,820::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:02,830::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:34:02,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:02,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:02,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:02,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:02,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:02,868::__init__::225::IOProcess::(_processLogs) (273104) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:02,874::__init__::225::IOProcess::(_processLogs) (273104) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:02,881::__init__::225::IOProcess::(_processLogs) (273104) Building response >Thread-18::DEBUG::2014-07-08 16:34:02,887::__init__::225::IOProcess::(_processLogs) (273104) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:02,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:02,901::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:02,922::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:34:02,929::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:02,935::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:02,939::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:02,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:03,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 16:34:03,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170913 s, 6.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:03,029::__init__::225::IOProcess::(_processLogs) (273105) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:03,032::__init__::225::IOProcess::(_processLogs) (273105) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:03,034::__init__::225::IOProcess::(_processLogs) (273105) Building response >Thread-18::DEBUG::2014-07-08 16:34:03,037::__init__::225::IOProcess::(_processLogs) (273105) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:03,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:03,043::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:34:04,038::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:34:04,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0b24e0b-a308-4f7e-936c-03d0ac5ab6c6`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:34:04,040::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:34:04,055::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:04,055::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0b24e0b-a308-4f7e-936c-03d0ac5ab6c6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:04,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0b24e0b-a308-4f7e-936c-03d0ac5ab6c6`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:04,056::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:04,056::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:04,056::task::993::Storage.TaskManager.Task::(_decref) Task=`f0b24e0b-a308-4f7e-936c-03d0ac5ab6c6`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:34:04,068::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:34:04,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`351a83b7-4046-4ff1-80ec-7d55e3f702c7`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:34:04,070::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:34:04,071::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`260c59e8-9360-4ad9-95f4-8b6c04f1b865`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:34:04,071::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:34:04,071::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:34:04,072::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`260c59e8-9360-4ad9-95f4-8b6c04f1b865`::Granted request >Thread-6940::DEBUG::2014-07-08 16:34:04,072::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`351a83b7-4046-4ff1-80ec-7d55e3f702c7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:34:04,073::task::993::Storage.TaskManager.Task::(_decref) Task=`351a83b7-4046-4ff1-80ec-7d55e3f702c7`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:34:04,093::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:04,094::task::1191::Storage.TaskManager.Task::(prepare) Task=`351a83b7-4046-4ff1-80ec-7d55e3f702c7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:04,095::task::595::Storage.TaskManager.Task::(_updateState) Task=`351a83b7-4046-4ff1-80ec-7d55e3f702c7`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:34:04,096::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:34:04,096::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:34:04,098::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:34:04,100::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:34:04,100::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:34:04,101::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:34:04,103::task::993::Storage.TaskManager.Task::(_decref) Task=`351a83b7-4046-4ff1-80ec-7d55e3f702c7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:34:05,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:05,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177026 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:07,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:07,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175177 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:09,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:10,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176054 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:12,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:12,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174557 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:13,056::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:13,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:13,059::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:13,060::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:13,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:13,062::__init__::225::IOProcess::(_processLogs) (273106) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:13,064::__init__::225::IOProcess::(_processLogs) (273106) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:13,066::__init__::225::IOProcess::(_processLogs) (273106) Building response >Thread-18::DEBUG::2014-07-08 16:34:13,066::__init__::225::IOProcess::(_processLogs) (273106) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:13,067::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:13,067::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:34:13,069::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:34:13,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000507314 s, 911 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:13,218::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:13,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:13,218::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:13,219::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:13,219::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:13,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:13,220::__init__::225::IOProcess::(_processLogs) DEBUG|(273107) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:13,220::__init__::225::IOProcess::(_processLogs) (273107) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:13,220::__init__::225::IOProcess::(_processLogs) (273107) Building response >Thread-18::DEBUG::2014-07-08 16:34:13,220::__init__::225::IOProcess::(_processLogs) (273107) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:13,221::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:34:13,221::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:34:13,223::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:13,224::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:34:13,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:13,224::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:13,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:13,225::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:13,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:13,225::__init__::225::IOProcess::(_processLogs) (273108) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:13,226::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273108) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:13,226::__init__::225::IOProcess::(_processLogs) (273108) Building response >Thread-18::DEBUG::2014-07-08 16:34:13,226::__init__::225::IOProcess::(_processLogs) (273108) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:13,226::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:34:13,227::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:13,228::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:13,228::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:34:13,228::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:13,229::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:13,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:13,229::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:13,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:13,230::__init__::225::IOProcess::(_processLogs) (273109) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:13,230::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273109) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:13,230::__init__::225::IOProcess::(_processLogs) (273109) Building response >Thread-18::DEBUG::2014-07-08 16:34:13,231::__init__::225::IOProcess::(_processLogs) (273109) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:13,231::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:34:13,231::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:13,232::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:13,232::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:34:13,233::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:13,233::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:13,233::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:13,234::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:13,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:13,234::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:13,235::__init__::225::IOProcess::(_processLogs) (273110) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:13,235::__init__::225::IOProcess::(_processLogs) (273110) Building response >Thread-18::DEBUG::2014-07-08 16:34:13,235::__init__::225::IOProcess::(_processLogs) (273110) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:13,235::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:13,236::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:34:13,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`68b47dd6-9ea9-474e-8afd-e52d6f0bfbe9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:34:13,483::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:34:13,483::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507314', 'lastCheck': '0.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:34:13,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`68b47dd6-9ea9-474e-8afd-e52d6f0bfbe9`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507314', 'lastCheck': '0.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:34:13,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`68b47dd6-9ea9-474e-8afd-e52d6f0bfbe9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:13,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:13,484::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:13,485::task::993::Storage.TaskManager.Task::(_decref) Task=`68b47dd6-9ea9-474e-8afd-e52d6f0bfbe9`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:34:14,119::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:34:14,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8e7438b-973f-4c2f-af3f-94c6c08719f0`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:34:14,121::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:34:14,135::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:14,136::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8e7438b-973f-4c2f-af3f-94c6c08719f0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:14,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8e7438b-973f-4c2f-af3f-94c6c08719f0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:14,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:14,137::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:14,137::task::993::Storage.TaskManager.Task::(_decref) Task=`c8e7438b-973f-4c2f-af3f-94c6c08719f0`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:34:14,149::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:34:14,149::task::595::Storage.TaskManager.Task::(_updateState) Task=`094d4599-cd41-4920-bbb1-3d11a1b77879`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:34:14,150::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:34:14,151::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`56201455-fbd4-4e0e-baf7-fb7d03226f86`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:34:14,151::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:34:14,151::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:34:14,152::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`56201455-fbd4-4e0e-baf7-fb7d03226f86`::Granted request >Thread-6940::DEBUG::2014-07-08 16:34:14,156::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`094d4599-cd41-4920-bbb1-3d11a1b77879`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:34:14,157::task::993::Storage.TaskManager.Task::(_decref) Task=`094d4599-cd41-4920-bbb1-3d11a1b77879`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:34:14,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:14,176::task::1191::Storage.TaskManager.Task::(prepare) Task=`094d4599-cd41-4920-bbb1-3d11a1b77879`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:14,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`094d4599-cd41-4920-bbb1-3d11a1b77879`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:34:14,177::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:34:14,177::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:34:14,177::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:34:14,178::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:34:14,178::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:34:14,178::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:34:14,179::task::993::Storage.TaskManager.Task::(_decref) Task=`094d4599-cd41-4920-bbb1-3d11a1b77879`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:34:14,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:14,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175339 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:16,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:16,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173844 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:18,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:19,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173247 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:21,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:21,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205242 s, 49.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:23,239::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:23,239::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:23,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:23,240::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:23,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:23,240::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:23,241::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:23,241::__init__::225::IOProcess::(_processLogs) (273111) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:23,241::__init__::225::IOProcess::(_processLogs) (273111) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:23,241::__init__::225::IOProcess::(_processLogs) (273111) Building response >Thread-18::DEBUG::2014-07-08 16:34:23,242::__init__::225::IOProcess::(_processLogs) (273111) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:23,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:23,242::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:34:23,244::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:34:23,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00064811 s, 713 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:23,409::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:23,414::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:23,419::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:23,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:23,430::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:23,434::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:23,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:23,442::__init__::225::IOProcess::(_processLogs) (273112) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:23,445::__init__::225::IOProcess::(_processLogs) (273112) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:23,449::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|(273112) Building response >Thread-18::DEBUG::2014-07-08 16:34:23,453::__init__::225::IOProcess::(_processLogs) (273112) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:23,457::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:23,460::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Dummy-6860::DEBUG::2014-07-08 16:34:23,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:34:23,633::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:23,636::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:34:23,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:23,645::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:23,648::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:23,651::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:23,654::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:23,657::__init__::225::IOProcess::(_processLogs) (273113) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:23,660::__init__::225::IOProcess::(_processLogs) (273113) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:23,663::__init__::225::IOProcess::(_processLogs) (273113) Building response >Thread-18::DEBUG::2014-07-08 16:34:23,665::__init__::225::IOProcess::(_processLogs) (273113) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:23,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:23,671::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:23,681::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:23,685::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:34:23,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:23,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:23,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:23,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-6860::DEBUG::2014-07-08 16:34:23,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0669143 s, 15.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:23,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:23,786::__init__::225::IOProcess::(_processLogs) (273114) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:23,789::__init__::225::IOProcess::(_processLogs) (273114) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:23,791::__init__::225::IOProcess::(_processLogs) (273114) Building response >Thread-18::DEBUG::2014-07-08 16:34:23,793::__init__::225::IOProcess::(_processLogs) (273114) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:23,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:23,798::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:23,807::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:23,809::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:34:23,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:23,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:23,817::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:23,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:23,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:23,824::__init__::225::IOProcess::(_processLogs) (273115) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:23,827::__init__::225::IOProcess::(_processLogs) (273115) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:23,829::__init__::225::IOProcess::(_processLogs) (273115) Building response >Thread-18::DEBUG::2014-07-08 16:34:23,832::__init__::225::IOProcess::(_processLogs) (273115) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:23,835::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:34:23,837::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:34:24,193::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:34:24,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`3aa253ad-e9a1-48d6-90f9-5950dfddb7ca`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:34:24,195::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:34:24,209::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:24,210::task::1191::Storage.TaskManager.Task::(prepare) Task=`3aa253ad-e9a1-48d6-90f9-5950dfddb7ca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:24,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`3aa253ad-e9a1-48d6-90f9-5950dfddb7ca`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:24,210::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:24,210::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:24,211::task::993::Storage.TaskManager.Task::(_decref) Task=`3aa253ad-e9a1-48d6-90f9-5950dfddb7ca`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:34:24,222::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:34:24,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`cda45198-9bae-46bd-857d-8f422872ee39`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:34:24,223::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:34:24,224::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d3208f47-0656-425f-9cff-01b02aab3f0c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:34:24,224::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:34:24,225::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:34:24,225::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d3208f47-0656-425f-9cff-01b02aab3f0c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:34:24,226::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cda45198-9bae-46bd-857d-8f422872ee39`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:34:24,226::task::993::Storage.TaskManager.Task::(_decref) Task=`cda45198-9bae-46bd-857d-8f422872ee39`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:34:24,244::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:24,245::task::1191::Storage.TaskManager.Task::(prepare) Task=`cda45198-9bae-46bd-857d-8f422872ee39`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:24,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`cda45198-9bae-46bd-857d-8f422872ee39`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:34:24,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:34:24,246::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:34:24,246::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:34:24,246::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:34:24,247::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:34:24,247::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:34:24,247::task::993::Storage.TaskManager.Task::(_decref) Task=`cda45198-9bae-46bd-857d-8f422872ee39`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:34:26,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:26,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017635 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:28,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:28,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174948 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:34:28,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a7eb4ad-10c0-4d5f-a05e-c77ff8e02bc8`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:34:28,634::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:34:28,635::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064811', 'lastCheck': '4.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:34:28,635::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a7eb4ad-10c0-4d5f-a05e-c77ff8e02bc8`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064811', 'lastCheck': '4.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:34:28,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a7eb4ad-10c0-4d5f-a05e-c77ff8e02bc8`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:28,636::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:28,636::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:28,636::task::993::Storage.TaskManager.Task::(_decref) Task=`2a7eb4ad-10c0-4d5f-a05e-c77ff8e02bc8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:34:30,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:30,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176431 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:32,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:33,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017773 s, 57.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:33,846::__init__::225::IOProcess::(_processLogs) (273110) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:33,846::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:33,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:33,847::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:33,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:33,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:33,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:33,848::__init__::225::IOProcess::(_processLogs) (273116) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:33,848::__init__::225::IOProcess::(_processLogs) (273116) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:33,848::__init__::225::IOProcess::(_processLogs) (273116) Building response >Thread-18::DEBUG::2014-07-08 16:34:33,849::__init__::225::IOProcess::(_processLogs) (273116) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:33,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:33,849::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:34:33,851::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:34:34,000::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000463454 s, 997 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:34,002::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:34,002::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:34,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:34,003::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:34,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:34,004::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:34,004::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:34,004::__init__::225::IOProcess::(_processLogs) (273117) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:34,005::__init__::225::IOProcess::(_processLogs) (273117) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:34,005::__init__::225::IOProcess::(_processLogs) DEBUG|(273117) Building response >Thread-18::DEBUG::2014-07-08 16:34:34,005::__init__::225::IOProcess::(_processLogs) (273117) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:34,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:34,006::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:34:34,008::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:34,008::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:34:34,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:34,009::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:34,009::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:34,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:34,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:34,010::__init__::225::IOProcess::(_processLogs) (273118) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:34,010::__init__::225::IOProcess::(_processLogs) (273118) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:34,010::__init__::225::IOProcess::(_processLogs) (273118) Building response >Thread-18::DEBUG::2014-07-08 16:34:34,011::__init__::225::IOProcess::(_processLogs) (273118) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:34,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:34,011::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:34,012::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:34,013::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:34:34,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:34,013::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:34,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:34,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:34,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:34,014::__init__::225::IOProcess::(_processLogs) (273119) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:34,015::__init__::225::IOProcess::(_processLogs) (273119) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:34,015::__init__::225::IOProcess::(_processLogs) DEBUG|(273119) Building response >Thread-18::DEBUG::2014-07-08 16:34:34,015::__init__::225::IOProcess::(_processLogs) (273119) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:34,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:34,016::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:34,017::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:34,017::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:34:34,017::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:34,018::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:34,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:34,018::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:34,019::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:34,019::__init__::225::IOProcess::(_processLogs) (273120) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:34,019::__init__::225::IOProcess::(_processLogs) (273120) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:34,019::__init__::225::IOProcess::(_processLogs) (273120) Building response >Thread-18::DEBUG::2014-07-08 16:34:34,020::__init__::225::IOProcess::(_processLogs) (273120) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:34,020::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:34,020::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:34:34,262::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:34:34,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d098619-4eb3-41ca-b2e6-47c108f4bcf0`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:34:34,267::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:34:34,331::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:34,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d098619-4eb3-41ca-b2e6-47c108f4bcf0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:34,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d098619-4eb3-41ca-b2e6-47c108f4bcf0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:34,333::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:34,334::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:34,335::task::993::Storage.TaskManager.Task::(_decref) Task=`2d098619-4eb3-41ca-b2e6-47c108f4bcf0`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:34:34,349::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:34:34,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`a489d273-0dba-409c-b402-1336deacb7a6`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:34:34,353::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:34:34,356::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1f60777c-7c72-4638-a2b1-9f0d1b87ad34`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:34:34,357::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:34:34,359::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:34:34,360::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1f60777c-7c72-4638-a2b1-9f0d1b87ad34`::Granted request >Thread-6940::DEBUG::2014-07-08 16:34:34,362::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a489d273-0dba-409c-b402-1336deacb7a6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:34:34,363::task::993::Storage.TaskManager.Task::(_decref) Task=`a489d273-0dba-409c-b402-1336deacb7a6`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:34:34,392::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:34,393::task::1191::Storage.TaskManager.Task::(prepare) Task=`a489d273-0dba-409c-b402-1336deacb7a6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:34,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`a489d273-0dba-409c-b402-1336deacb7a6`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:34:34,395::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:34:34,396::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:34:34,397::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:34:34,399::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:34:34,400::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:34:34,401::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:34:34,402::task::993::Storage.TaskManager.Task::(_decref) Task=`a489d273-0dba-409c-b402-1336deacb7a6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:34:35,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:35,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170665 s, 60.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:37,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:37,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247961 s, 41.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:39,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:39,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316275 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:41,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:42,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01733 s, 59.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:34:43,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`8792c8d2-f4e7-4606-9eda-f8b6e5078fdd`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:34:43,819::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:34:43,819::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463454', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:34:43,819::task::1191::Storage.TaskManager.Task::(prepare) Task=`8792c8d2-f4e7-4606-9eda-f8b6e5078fdd`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463454', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:34:43,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`8792c8d2-f4e7-4606-9eda-f8b6e5078fdd`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:43,820::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:43,820::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:43,820::task::993::Storage.TaskManager.Task::(_decref) Task=`8792c8d2-f4e7-4606-9eda-f8b6e5078fdd`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:34:44,023::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:44,023::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:44,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:44,024::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:44,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:44,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:44,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:44,025::__init__::225::IOProcess::(_processLogs) (273121) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:44,025::__init__::225::IOProcess::(_processLogs) (273121) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:44,025::__init__::225::IOProcess::(_processLogs) (273121) Building response >Thread-18::DEBUG::2014-07-08 16:34:44,026::__init__::225::IOProcess::(_processLogs) (273121) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:44,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:44,026::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:34:44,028::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:34:44,173::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000437754 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:44,175::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:44,176::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:44,176::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:44,177::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:44,177::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:44,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:44,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:44,178::__init__::225::IOProcess::(_processLogs) (273122) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:44,178::__init__::225::IOProcess::(_processLogs) (273122) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:44,178::__init__::225::IOProcess::(_processLogs) (273122) Building response >Thread-18::DEBUG::2014-07-08 16:34:44,178::__init__::225::IOProcess::(_processLogs) (273122) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:44,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:44,179::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:34:44,181::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:44,181::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:34:44,181::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:44,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:44,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:44,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:44,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:44,183::__init__::225::IOProcess::(_processLogs) (273123) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:44,183::__init__::225::IOProcess::(_processLogs) (273123) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:44,183::__init__::225::IOProcess::(_processLogs) (273123) Building response >Thread-18::DEBUG::2014-07-08 16:34:44,183::__init__::225::IOProcess::(_processLogs) (273123) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:44,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:44,184::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:44,185::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:44,185::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:34:44,185::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:44,186::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:44,186::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:44,186::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:44,186::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:44,187::__init__::225::IOProcess::(_processLogs) (273124) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:44,187::__init__::225::IOProcess::(_processLogs) (273124) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:44,187::__init__::225::IOProcess::(_processLogs) (273124) Building response >Thread-18::DEBUG::2014-07-08 16:34:44,187::__init__::225::IOProcess::(_processLogs) (273124) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:44,188::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:44,188::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:44,189::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:44,189::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:34:44,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:44,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:44,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:44,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:44,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:44,191::__init__::225::IOProcess::(_processLogs) (273125) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:44,191::__init__::225::IOProcess::(_processLogs) (273125) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:44,191::__init__::225::IOProcess::(_processLogs) (273125) Building response >Thread-18::DEBUG::2014-07-08 16:34:44,192::__init__::225::IOProcess::(_processLogs) (273125) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:44,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:44,192::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:34:44,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:34:44,426::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:34:44,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f73c322-9329-41c7-bbbe-1c0c4ba8183c`::moving from state init -> state preparing >Dummy-6860::DEBUG::2014-07-08 16:34:44,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0443492 s, 23.1 MB/s\n'; <rc> = 0 >Thread-6941::INFO::2014-07-08 16:34:44,517::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:34:44,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:44,538::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f73c322-9329-41c7-bbbe-1c0c4ba8183c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:44,539::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f73c322-9329-41c7-bbbe-1c0c4ba8183c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:44,541::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:44,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:44,545::task::993::Storage.TaskManager.Task::(_decref) Task=`1f73c322-9329-41c7-bbbe-1c0c4ba8183c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:34:44,566::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:34:44,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`2aba5eb8-c4d0-4c53-a375-54bac2ed2a15`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:34:44,573::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:34:44,580::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`631ef48f-672d-4393-bdba-8abdfda87390`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:34:44,582::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:34:44,586::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:34:44,588::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`631ef48f-672d-4393-bdba-8abdfda87390`::Granted request >Thread-6940::DEBUG::2014-07-08 16:34:44,595::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2aba5eb8-c4d0-4c53-a375-54bac2ed2a15`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:34:44,597::task::993::Storage.TaskManager.Task::(_decref) Task=`2aba5eb8-c4d0-4c53-a375-54bac2ed2a15`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:34:44,643::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:44,645::task::1191::Storage.TaskManager.Task::(prepare) Task=`2aba5eb8-c4d0-4c53-a375-54bac2ed2a15`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:44,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`2aba5eb8-c4d0-4c53-a375-54bac2ed2a15`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:34:44,648::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:34:44,650::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:34:44,652::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:34:44,655::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:34:44,657::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:34:44,658::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:34:44,661::task::993::Storage.TaskManager.Task::(_decref) Task=`2aba5eb8-c4d0-4c53-a375-54bac2ed2a15`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:34:46,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:46,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.022307 s, 45.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:49,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:49,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017425 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:51,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:51,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173476 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:53,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:53,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175577 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:54,195::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:54,196::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:54,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:54,197::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:54,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:54,197::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:54,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:54,198::__init__::225::IOProcess::(_processLogs) (273126) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:54,198::__init__::225::IOProcess::(_processLogs) (273126) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:54,198::__init__::225::IOProcess::(_processLogs) (273126) Building response >Thread-18::DEBUG::2014-07-08 16:34:54,198::__init__::225::IOProcess::(_processLogs) (273126) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:54,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:54,199::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:34:54,201::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:34:54,351::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000477422 s, 968 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:34:54,353::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:54,354::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:34:54,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:54,355::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:54,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:54,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:54,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:54,355::__init__::225::IOProcess::(_processLogs) (273127) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:34:54,356::__init__::225::IOProcess::(_processLogs) (273127) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:34:54,356::__init__::225::IOProcess::(_processLogs) (273127) Building response >Thread-18::DEBUG::2014-07-08 16:34:54,356::__init__::225::IOProcess::(_processLogs) (273127) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:54,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:54,357::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:34:54,359::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:54,359::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:34:54,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:54,360::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:54,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:54,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:54,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:54,361::__init__::225::IOProcess::(_processLogs) (273128) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:54,361::__init__::225::IOProcess::(_processLogs) (273128) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:54,361::__init__::225::IOProcess::(_processLogs) (273128) Building response >Thread-18::DEBUG::2014-07-08 16:34:54,361::__init__::225::IOProcess::(_processLogs) (273128) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:54,362::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:54,362::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:54,363::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:54,363::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:34:54,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:54,364::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:54,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:54,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:54,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:54,365::__init__::225::IOProcess::(_processLogs) (273129) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:54,365::__init__::225::IOProcess::(_processLogs) (273129) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:54,365::__init__::225::IOProcess::(_processLogs) (273129) Building response >Thread-18::DEBUG::2014-07-08 16:34:54,365::__init__::225::IOProcess::(_processLogs) (273129) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:54,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:54,366::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:34:54,367::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:34:54,367::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:34:54,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:34:54,368::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:34:54,368::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:34:54,368::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:34:54,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:34:54,369::__init__::225::IOProcess::(_processLogs) (273130) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:34:54,369::__init__::225::IOProcess::(_processLogs) (273130) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:34:54,369::__init__::225::IOProcess::(_processLogs) (273130) Building response >Thread-18::DEBUG::2014-07-08 16:34:54,370::__init__::225::IOProcess::(_processLogs) (273130) Queuing response >Thread-18::DEBUG::2014-07-08 16:34:54,370::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:34:54,370::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:34:54,682::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:34:54,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a592499-47c8-4606-a03d-2d4e4e9cf141`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:34:54,684::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:34:54,699::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:54,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a592499-47c8-4606-a03d-2d4e4e9cf141`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:34:54,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a592499-47c8-4606-a03d-2d4e4e9cf141`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:54,700::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:54,700::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:54,701::task::993::Storage.TaskManager.Task::(_decref) Task=`3a592499-47c8-4606-a03d-2d4e4e9cf141`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:34:54,714::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:34:54,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`13596a3b-7552-497b-803f-cd1fddffee2a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:34:54,715::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:34:54,716::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0e4361f0-3609-4fa2-801a-e669532cd705`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:34:54,716::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:34:54,717::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:34:54,717::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0e4361f0-3609-4fa2-801a-e669532cd705`::Granted request >Thread-6940::DEBUG::2014-07-08 16:34:54,718::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`13596a3b-7552-497b-803f-cd1fddffee2a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:34:54,718::task::993::Storage.TaskManager.Task::(_decref) Task=`13596a3b-7552-497b-803f-cd1fddffee2a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:34:54,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:54,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`13596a3b-7552-497b-803f-cd1fddffee2a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:34:54,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`13596a3b-7552-497b-803f-cd1fddffee2a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:34:54,738::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:34:54,738::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:34:54,738::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:34:54,739::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:34:54,739::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:34:54,739::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:34:54,739::task::993::Storage.TaskManager.Task::(_decref) Task=`13596a3b-7552-497b-803f-cd1fddffee2a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:34:55,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:56,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176806 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:34:58,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:34:58,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0190382 s, 53.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:34:59,008::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4257af8-8d69-4aa3-ae19-9a21e5aa0e9d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:34:59,008::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:34:59,009::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477422', 'lastCheck': '4.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:34:59,009::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4257af8-8d69-4aa3-ae19-9a21e5aa0e9d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477422', 'lastCheck': '4.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:34:59,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4257af8-8d69-4aa3-ae19-9a21e5aa0e9d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:34:59,010::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:34:59,010::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:34:59,010::task::993::Storage.TaskManager.Task::(_decref) Task=`a4257af8-8d69-4aa3-ae19-9a21e5aa0e9d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:35:00,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:00,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025223 s, 40.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:02,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:02,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177714 s, 57.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:35:04,390::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:04,395::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:04,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:04,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:04,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:04,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:04,413::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:04,418::__init__::225::IOProcess::(_processLogs) (273131) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:04,423::__init__::225::IOProcess::(_processLogs) (273131) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:04,426::__init__::225::IOProcess::(_processLogs) (273131) Building response >Thread-18::DEBUG::2014-07-08 16:35:04,429::__init__::225::IOProcess::(_processLogs) (273131) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:04,432::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:04,435::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:35:04,447::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:35:04,595::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000460381 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:35:04,599::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:04,601::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:04,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:04,603::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:04,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:04,606::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:04,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:04,608::__init__::225::IOProcess::(_processLogs) (273132) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:04,610::__init__::225::IOProcess::(_processLogs) (273132) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:04,611::__init__::225::IOProcess::(_processLogs) (273132) Building response >Thread-18::DEBUG::2014-07-08 16:35:04,612::__init__::225::IOProcess::(_processLogs) (273132) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:04,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:04,614::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:35:04,622::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:04,623::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:35:04,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:04,625::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:04,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:04,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:04,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:04,631::__init__::225::IOProcess::(_processLogs) (273133) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:04,632::__init__::225::IOProcess::(_processLogs) (273133) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:04,634::__init__::225::IOProcess::(_processLogs) DEBUG|(273133) Building response >Thread-18::DEBUG::2014-07-08 16:35:04,635::__init__::225::IOProcess::(_processLogs) (273133) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:04,637::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:04,638::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:04,643::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:04,644::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:35:04,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:04,659::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:04,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:04,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:04,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:04,664::__init__::225::IOProcess::(_processLogs) (273134) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:04,665::__init__::225::IOProcess::(_processLogs) (273134) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:04,666::__init__::225::IOProcess::(_processLogs) DEBUG|(273134) Building response >Thread-18::DEBUG::2014-07-08 16:35:04,668::__init__::225::IOProcess::(_processLogs) (273134) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:04,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:04,670::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:04,674::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:04,676::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:35:04,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:04,678::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:04,679::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:04,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:04,682::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:04,683::__init__::225::IOProcess::(_processLogs) (273135) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:04,684::__init__::225::IOProcess::(_processLogs) (273135) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:04,686::__init__::225::IOProcess::(_processLogs) (273135) Building response >Thread-18::DEBUG::2014-07-08 16:35:04,687::__init__::225::IOProcess::(_processLogs) (273135) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:04,688::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:04,689::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:35:04,754::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:35:04,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b61d274-0a6d-4ed6-809c-dc9fdc82a05c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:35:04,758::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:35:04,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:35:04,775::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b61d274-0a6d-4ed6-809c-dc9fdc82a05c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:35:04,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b61d274-0a6d-4ed6-809c-dc9fdc82a05c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:35:04,777::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:35:04,778::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:35:04,779::task::993::Storage.TaskManager.Task::(_decref) Task=`4b61d274-0a6d-4ed6-809c-dc9fdc82a05c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:35:04,793::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:35:04,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`95911157-c012-44d4-b373-0b2dbb7ce04f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:35:04,797::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:35:04,800::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`73d6cb74-e8df-4621-9592-7d52ac991620`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:35:04,801::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:35:04,803::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:35:04,804::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`73d6cb74-e8df-4621-9592-7d52ac991620`::Granted request >Thread-6940::DEBUG::2014-07-08 16:35:04,806::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`95911157-c012-44d4-b373-0b2dbb7ce04f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:35:04,808::task::993::Storage.TaskManager.Task::(_decref) Task=`95911157-c012-44d4-b373-0b2dbb7ce04f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:35:04,845::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:04,847::task::1191::Storage.TaskManager.Task::(prepare) Task=`95911157-c012-44d4-b373-0b2dbb7ce04f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:04,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`95911157-c012-44d4-b373-0b2dbb7ce04f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:35:04,851::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:35:04,853::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:35:04,856::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:35:04,860::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:35:04,861::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:35:04,863::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:35:04,867::task::993::Storage.TaskManager.Task::(_decref) Task=`95911157-c012-44d4-b373-0b2dbb7ce04f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:35:04,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:05,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419842 s, 24.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:07,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:07,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175406 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:09,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:09,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017444 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:11,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:12,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173554 s, 59.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:35:14,167::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba326f6b-d436-4111-a9af-fbb47b34b10d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:35:14,168::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:35:14,168::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460381', 'lastCheck': '9.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:35:14,169::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba326f6b-d436-4111-a9af-fbb47b34b10d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460381', 'lastCheck': '9.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:35:14,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba326f6b-d436-4111-a9af-fbb47b34b10d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:35:14,169::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:35:14,169::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:35:14,170::task::993::Storage.TaskManager.Task::(_decref) Task=`ba326f6b-d436-4111-a9af-fbb47b34b10d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:35:14,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:14,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173967 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:35:14,699::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:14,700::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:14,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:14,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:14,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:14,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:14,704::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:14,705::__init__::225::IOProcess::(_processLogs) (273136) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:14,705::__init__::225::IOProcess::(_processLogs) (273136) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:14,705::__init__::225::IOProcess::(_processLogs) (273136) Building response >Thread-18::DEBUG::2014-07-08 16:35:14,705::__init__::225::IOProcess::(_processLogs) (273136) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:14,706::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:14,706::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:35:14,708::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:35:14,855::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000883888 s, 523 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:35:14,857::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:14,857::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:14,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:14,858::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:14,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:14,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:14,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:14,859::__init__::225::IOProcess::(_processLogs) (273137) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:14,859::__init__::225::IOProcess::(_processLogs) (273137) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:14,859::__init__::225::IOProcess::(_processLogs) (273137) Building response >Thread-18::DEBUG::2014-07-08 16:35:14,859::__init__::225::IOProcess::(_processLogs) (273137) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:14,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:14,860::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:35:14,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:14,862::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:35:14,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:14,863::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:14,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:14,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:14,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:14,864::__init__::225::IOProcess::(_processLogs) (273138) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:14,864::__init__::225::IOProcess::(_processLogs) (273138) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:14,864::__init__::225::IOProcess::(_processLogs) (273138) Building response >Thread-18::DEBUG::2014-07-08 16:35:14,865::__init__::225::IOProcess::(_processLogs) (273138) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:14,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:14,865::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:14,866::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:14,866::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:35:14,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:14,867::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:14,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:14,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:14,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:14,868::__init__::225::IOProcess::(_processLogs) (273139) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:14,868::__init__::225::IOProcess::(_processLogs) (273139) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:14,868::__init__::225::IOProcess::(_processLogs) (273139) Building response >Thread-18::DEBUG::2014-07-08 16:35:14,869::__init__::225::IOProcess::(_processLogs) (273139) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:14,869::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:14,869::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:14,870::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:14,870::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:35:14,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:14,871::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:14,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:14,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:14,872::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:14,872::__init__::225::IOProcess::(_processLogs) (273140) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:14,872::__init__::225::IOProcess::(_processLogs) (273140) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:14,872::__init__::225::IOProcess::(_processLogs) (273140) Building response >Thread-18::DEBUG::2014-07-08 16:35:14,873::__init__::225::IOProcess::(_processLogs) (273140) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:14,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:14,873::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:35:14,890::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [4a52ef4] >Thread-6941::DEBUG::2014-07-08 16:35:14,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa33028d-f0d4-4da4-b656-5c993e67a149`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:35:14,891::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:35:14,906::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:35:14,906::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa33028d-f0d4-4da4-b656-5c993e67a149`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:35:14,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa33028d-f0d4-4da4-b656-5c993e67a149`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:35:14,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:35:14,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:35:14,907::task::993::Storage.TaskManager.Task::(_decref) Task=`fa33028d-f0d4-4da4-b656-5c993e67a149`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:35:14,920::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [4a52ef4] >Thread-6940::DEBUG::2014-07-08 16:35:14,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8be164f-a4d7-4899-a5cf-47833a00711b`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:35:14,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:35:14,922::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`50d0c012-dd73-4887-a9ef-169b18a41017`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:35:14,922::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:35:14,927::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:35:14,928::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`50d0c012-dd73-4887-a9ef-169b18a41017`::Granted request >Thread-6940::DEBUG::2014-07-08 16:35:14,928::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b8be164f-a4d7-4899-a5cf-47833a00711b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:35:14,929::task::993::Storage.TaskManager.Task::(_decref) Task=`b8be164f-a4d7-4899-a5cf-47833a00711b`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:35:14,948::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:14,948::task::1191::Storage.TaskManager.Task::(prepare) Task=`b8be164f-a4d7-4899-a5cf-47833a00711b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:14,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8be164f-a4d7-4899-a5cf-47833a00711b`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:35:14,949::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:35:14,949::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:35:14,950::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:35:14,950::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:35:14,950::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:35:14,950::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:35:14,951::task::993::Storage.TaskManager.Task::(_decref) Task=`b8be164f-a4d7-4899-a5cf-47833a00711b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:35:16,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:16,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335548 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:18,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:18,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173501 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:21,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:21,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177401 s, 57.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:23,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:23,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017963 s, 57.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:35:24,876::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:24,876::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:24,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:24,877::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:24,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:24,878::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:24,878::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:24,878::__init__::225::IOProcess::(_processLogs) (273141) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:24,879::__init__::225::IOProcess::(_processLogs) (273141) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:24,879::__init__::225::IOProcess::(_processLogs) (273141) Building response >Thread-18::DEBUG::2014-07-08 16:35:24,879::__init__::225::IOProcess::(_processLogs) (273141) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:24,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:24,880::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:35:24,881::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:35:25,036::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000429373 s, 1.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:35:25,112::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:35:25,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`ecbe715a-a8e7-4cac-b900-f7189b70866a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:35:25,120::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:35:25,129::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:25,130::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:25,130::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:25,131::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:25,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:25,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:25,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:25,132::__init__::225::IOProcess::(_processLogs) (273142) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:25,132::__init__::225::IOProcess::(_processLogs) (273142) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:25,132::__init__::225::IOProcess::(_processLogs) (273142) Building response >Thread-18::DEBUG::2014-07-08 16:35:25,132::__init__::225::IOProcess::(_processLogs) (273142) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:25,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:25,133::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:35:25,136::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:25,139::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:35:25,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:25,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:25,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:25,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:25,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:25,141::__init__::225::IOProcess::(_processLogs) (273143) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:25,141::__init__::225::IOProcess::(_processLogs) (273143) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:25,141::__init__::225::IOProcess::(_processLogs) (273143) Building response >Thread-18::DEBUG::2014-07-08 16:35:25,142::__init__::225::IOProcess::(_processLogs) (273143) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:25,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:25,142::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:25,144::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:25,144::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:35:25,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:25,148::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:25,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:25,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6941::INFO::2014-07-08 16:35:25,149::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:35:25,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6941::DEBUG::2014-07-08 16:35:25,151::task::1191::Storage.TaskManager.Task::(prepare) Task=`ecbe715a-a8e7-4cac-b900-f7189b70866a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:35:25,152::__init__::225::IOProcess::(_processLogs) (273144) Finding callback 'access'... >Thread-6941::DEBUG::2014-07-08 16:35:25,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`ecbe715a-a8e7-4cac-b900-f7189b70866a`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:35:25,154::__init__::225::IOProcess::(_processLogs) (273144) Got request for method 'access' >Thread-6941::DEBUG::2014-07-08 16:35:25,154::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:35:25,155::__init__::225::IOProcess::(_processLogs) (273144) Building response >Thread-6941::DEBUG::2014-07-08 16:35:25,155::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:35:25,157::__init__::225::IOProcess::(_processLogs) (273144) Queuing response >Thread-6941::DEBUG::2014-07-08 16:35:25,157::task::993::Storage.TaskManager.Task::(_decref) Task=`ecbe715a-a8e7-4cac-b900-f7189b70866a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:35:25,159::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:25,161::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:25,164::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:25,164::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:35:25,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:25,165::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:25,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:25,165::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:25,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:25,166::__init__::225::IOProcess::(_processLogs) (273145) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:25,166::__init__::225::IOProcess::(_processLogs) (273145) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:25,166::__init__::225::IOProcess::(_processLogs) (273145) Building response >Thread-18::DEBUG::2014-07-08 16:35:25,167::__init__::225::IOProcess::(_processLogs) (273145) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:25,167::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:25,167::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:35:25,178::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:35:25,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2e4319b-3588-49ac-ac17-b9cae0ee4af3`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:35:25,179::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:35:25,180::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`57c138c2-63fa-4cc3-a88b-541b2a9be711`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:35:25,181::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:35:25,181::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:35:25,182::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`57c138c2-63fa-4cc3-a88b-541b2a9be711`::Granted request >Thread-6940::DEBUG::2014-07-08 16:35:25,183::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a2e4319b-3588-49ac-ac17-b9cae0ee4af3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:35:25,183::task::993::Storage.TaskManager.Task::(_decref) Task=`a2e4319b-3588-49ac-ac17-b9cae0ee4af3`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:35:25,204::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:25,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2e4319b-3588-49ac-ac17-b9cae0ee4af3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:25,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2e4319b-3588-49ac-ac17-b9cae0ee4af3`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:35:25,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:35:25,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:35:25,206::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:35:25,206::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:35:25,206::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:35:25,207::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:35:25,207::task::993::Storage.TaskManager.Task::(_decref) Task=`a2e4319b-3588-49ac-ac17-b9cae0ee4af3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:35:25,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:25,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0231683 s, 44.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:27,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:28,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177518 s, 57.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:35:29,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`b08ff620-66d0-4d20-9827-54810829ea2a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:35:29,464::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:35:29,465::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429373', 'lastCheck': '4.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:35:29,465::task::1191::Storage.TaskManager.Task::(prepare) Task=`b08ff620-66d0-4d20-9827-54810829ea2a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429373', 'lastCheck': '4.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:35:29,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`b08ff620-66d0-4d20-9827-54810829ea2a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:35:29,466::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:35:29,466::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:35:29,466::task::993::Storage.TaskManager.Task::(_decref) Task=`b08ff620-66d0-4d20-9827-54810829ea2a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:35:30,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:30,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898466 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:32,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:32,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182384 s, 56.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:34,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:35,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0647826 s, 15.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:35:35,172::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:35,173::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:35,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:35,175::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:35,176::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:35,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:35,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:35,179::__init__::225::IOProcess::(_processLogs) (273146) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:35,180::__init__::225::IOProcess::(_processLogs) (273146) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:35,181::__init__::225::IOProcess::(_processLogs) (273146) Building response >Thread-18::DEBUG::2014-07-08 16:35:35,182::__init__::225::IOProcess::(_processLogs) (273146) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:35,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:35,183::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:35:35,185::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:35:35,335::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000431608 s, 1.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:35:35,337::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:35:35,343::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:35,345::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:35,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::DEBUG::2014-07-08 16:35:35,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`d008d13a-3762-4de1-97c1-7549d945ba27`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:35:35,349::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:35,351::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::INFO::2014-07-08 16:35:35,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:35:35,354::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:35,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:35,357::__init__::225::IOProcess::(_processLogs) (273147) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:35,358::__init__::225::IOProcess::(_processLogs) (273147) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:35,359::__init__::225::IOProcess::(_processLogs) (273147) Building response >Thread-18::DEBUG::2014-07-08 16:35:35,361::__init__::225::IOProcess::(_processLogs) (273147) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:35,361::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:35,362::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:35:35,368::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:35,369::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:35:35,370::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:35,371::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6941::INFO::2014-07-08 16:35:35,372::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:35:35,374::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::DEBUG::2014-07-08 16:35:35,375::task::1191::Storage.TaskManager.Task::(prepare) Task=`d008d13a-3762-4de1-97c1-7549d945ba27`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:35:35,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`d008d13a-3762-4de1-97c1-7549d945ba27`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:35:35,378::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-6941::DEBUG::2014-07-08 16:35:35,379::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:35:35,380::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:35:35,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6941::DEBUG::2014-07-08 16:35:35,383::task::993::Storage.TaskManager.Task::(_decref) Task=`d008d13a-3762-4de1-97c1-7549d945ba27`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:35:35,384::__init__::225::IOProcess::(_processLogs) (273148) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:35,388::__init__::225::IOProcess::(_processLogs) (273148) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:35,391::__init__::225::IOProcess::(_processLogs) (273148) Building response >Thread-18::DEBUG::2014-07-08 16:35:35,391::__init__::225::IOProcess::(_processLogs) (273148) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:35,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:35,394::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:35,396::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:35,396::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:35:35,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:35,396::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:35,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:35,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:35,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:35,397::__init__::225::IOProcess::(_processLogs) (273149) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:35,398::__init__::225::IOProcess::(_processLogs) (273149) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:35,398::__init__::225::IOProcess::(_processLogs) (273149) Building response >Thread-18::DEBUG::2014-07-08 16:35:35,398::__init__::225::IOProcess::(_processLogs) (273149) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:35,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:35,398::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:35:35,402::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:35:35,402::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:35,404::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-6940::DEBUG::2014-07-08 16:35:35,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b69806f-23eb-4264-82c8-76ba1f9ce31d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:35:35,406::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:35:35,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:35,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:35:35,409::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ba4ad096-a454-4e64-a5e4-3805a20b58cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:35:35,410::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:35:35,410::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:35:35,412::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:35:35,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:35:35,413::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ba4ad096-a454-4e64-a5e4-3805a20b58cb`::Granted request >Thread-18::DEBUG::2014-07-08 16:35:35,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:35:35,415::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2b69806f-23eb-4264-82c8-76ba1f9ce31d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:35:35,416::__init__::225::IOProcess::(_processLogs) (273150) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:35:35,416::task::993::Storage.TaskManager.Task::(_decref) Task=`2b69806f-23eb-4264-82c8-76ba1f9ce31d`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:35:35,417::__init__::225::IOProcess::(_processLogs) (273150) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:35,419::__init__::225::IOProcess::(_processLogs) (273150) Building response >Thread-18::DEBUG::2014-07-08 16:35:35,421::__init__::225::IOProcess::(_processLogs) (273150) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:35,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:35,424::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::INFO::2014-07-08 16:35:35,445::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:35,445::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b69806f-23eb-4264-82c8-76ba1f9ce31d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:35,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b69806f-23eb-4264-82c8-76ba1f9ce31d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:35:35,446::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:35:35,446::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:35:35,446::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:35:35,447::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:35:35,447::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:35:35,447::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:35:35,448::task::993::Storage.TaskManager.Task::(_decref) Task=`2b69806f-23eb-4264-82c8-76ba1f9ce31d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:35:39,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:39,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0848324 s, 12.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:41,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:42,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0220221 s, 46.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:44,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:44,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174744 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:35:45,431::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:45,432::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:45,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:45,432::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:45,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:45,433::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:45,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:45,433::__init__::225::IOProcess::(_processLogs) (273151) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:45,433::__init__::225::IOProcess::(_processLogs) (273151) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:45,434::__init__::225::IOProcess::(_processLogs) (273151) Building response >Thread-18::DEBUG::2014-07-08 16:35:45,434::__init__::225::IOProcess::(_processLogs) (273151) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:45,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:45,434::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:35:45,436::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:35:45,590::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000533852 s, 865 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:35:45,589::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:35:45,602::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:45,605::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:35:45,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c64d70b-852a-4250-8a3e-1061d98afe06`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:35:45,606::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::INFO::2014-07-08 16:35:45,607::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:35:45,608::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:45,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:45,609::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:45,610::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:45,610::__init__::225::IOProcess::(_processLogs) (273152) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:45,610::__init__::225::IOProcess::(_processLogs) (273152) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:35:45,610::__init__::225::IOProcess::(_processLogs) (273152) Building response >Thread-18::DEBUG::2014-07-08 16:35:45,611::__init__::225::IOProcess::(_processLogs) (273152) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:45,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:45,611::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:35:45,617::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:45,617::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:35:45,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:45,618::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:45,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:45,618::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:45,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:45,619::__init__::225::IOProcess::(_processLogs) (273153) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:45,619::__init__::225::IOProcess::(_processLogs) (273153) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:45,619::__init__::225::IOProcess::(_processLogs) (273153) Building response >Thread-18::DEBUG::2014-07-08 16:35:45,619::__init__::225::IOProcess::(_processLogs) (273153) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:45,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:45,621::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:45,623::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6941::INFO::2014-07-08 16:35:45,623::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:35:45,624::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-6941::DEBUG::2014-07-08 16:35:45,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c64d70b-852a-4250-8a3e-1061d98afe06`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:35:45,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::DEBUG::2014-07-08 16:35:45,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c64d70b-852a-4250-8a3e-1061d98afe06`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:35:45,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:35:45,627::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-6941::DEBUG::2014-07-08 16:35:45,628::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:35:45,629::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::DEBUG::2014-07-08 16:35:45,630::task::993::Storage.TaskManager.Task::(_decref) Task=`0c64d70b-852a-4250-8a3e-1061d98afe06`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:35:45,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:45,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:45,634::__init__::225::IOProcess::(_processLogs) (273154) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:45,634::__init__::225::IOProcess::(_processLogs) (273154) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:45,634::__init__::225::IOProcess::(_processLogs) (273154) Building response >Thread-18::DEBUG::2014-07-08 16:35:45,634::__init__::225::IOProcess::(_processLogs) (273154) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:45,635::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:45,635::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:45,636::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:45,636::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:35:45,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:45,637::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:45,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:45,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:45,637::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:45,638::__init__::225::IOProcess::(_processLogs) (273155) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:45,638::__init__::225::IOProcess::(_processLogs) (273155) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:45,638::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|(273155) Building response >Thread-18::DEBUG::2014-07-08 16:35:45,638::__init__::225::IOProcess::(_processLogs) (273155) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:45,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:45,639::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:35:45,644::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:35:45,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4bebe27-850f-4068-b5fb-554cb195a71d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:35:45,649::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:35:45,655::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`babae2c7-d23e-4ea6-96ce-630bd411e534`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:35:45,656::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:35:45,658::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:35:45,660::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`babae2c7-d23e-4ea6-96ce-630bd411e534`::Granted request >Thread-6940::DEBUG::2014-07-08 16:35:45,664::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b4bebe27-850f-4068-b5fb-554cb195a71d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:35:45,666::task::993::Storage.TaskManager.Task::(_decref) Task=`b4bebe27-850f-4068-b5fb-554cb195a71d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:35:45,704::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:45,705::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4bebe27-850f-4068-b5fb-554cb195a71d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:45,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4bebe27-850f-4068-b5fb-554cb195a71d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:35:45,705::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:35:45,706::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:35:45,706::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:35:45,706::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:35:45,707::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:35:45,707::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:35:45,707::task::993::Storage.TaskManager.Task::(_decref) Task=`b4bebe27-850f-4068-b5fb-554cb195a71d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:35:46,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:46,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017739 s, 57.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:35:48,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`11136f82-a1ae-419d-86ea-35de396838df`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:35:48,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:35:48,620::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533852', 'lastCheck': '3.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:35:48,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`11136f82-a1ae-419d-86ea-35de396838df`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533852', 'lastCheck': '3.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:35:48,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`11136f82-a1ae-419d-86ea-35de396838df`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:35:48,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:35:48,621::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:35:48,622::task::993::Storage.TaskManager.Task::(_decref) Task=`11136f82-a1ae-419d-86ea-35de396838df`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:35:48,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:49,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178152 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:51,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:51,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175051 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:53,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:53,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174926 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:35:55,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:35:55,717::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:55,718::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:35:55,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:55,718::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:55,718::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:55,719::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:55,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:55,719::__init__::225::IOProcess::(_processLogs) (273156) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:35:55,719::__init__::225::IOProcess::(_processLogs) (273156) Got request for method 'statvfs' >Thread-6941::DEBUG::2014-07-08 16:35:55,721::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:35:55,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`d172cb4c-5d57-4074-9279-da44fb023192`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:35:55,724::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:35:55,723::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|(273156) Building response >Thread-18::DEBUG::2014-07-08 16:35:55,725::__init__::225::IOProcess::(_processLogs) (273156) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:55,726::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:35:55,726::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:35:55,734::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::INFO::2014-07-08 16:35:55,880::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:35:55,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`d172cb4c-5d57-4074-9279-da44fb023192`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:35:55,890::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000496977 s, 930 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:35:55,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`d172cb4c-5d57-4074-9279-da44fb023192`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:35:55,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:35:55,905::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:35:55,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:35:55,911::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:35:55,914::task::993::Storage.TaskManager.Task::(_decref) Task=`d172cb4c-5d57-4074-9279-da44fb023192`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:35:55,918::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:55,927::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:55,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:55,939::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:55,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:55,953::__init__::225::IOProcess::(_processLogs) (273157) Finding callback 'statvfs'... >Thread-6940::DEBUG::2014-07-08 16:35:55,954::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:35:55,959::__init__::225::IOProcess::(_processLogs) (273157) Got request for method 'statvfs' >Thread-6940::DEBUG::2014-07-08 16:35:55,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`57def596-e8bb-484d-a36c-4cfc1f0fa4b5`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:35:55,968::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|(273157) Building response >Thread-6940::INFO::2014-07-08 16:35:55,971::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:35:55,974::__init__::225::IOProcess::(_processLogs) (273157) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:55,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:55,986::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6940::DEBUG::2014-07-08 16:35:55,989::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b620d905-58c0-4bfe-842c-57d97e59da72`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:35:55,995::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:35:56,009::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:35:56,014::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b620d905-58c0-4bfe-842c-57d97e59da72`::Granted request >Dummy-6860::DEBUG::2014-07-08 16:35:56,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.29093 s, 3.5 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:35:56,109::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`57def596-e8bb-484d-a36c-4cfc1f0fa4b5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:35:56,109::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-6940::DEBUG::2014-07-08 16:35:56,111::task::993::Storage.TaskManager.Task::(_decref) Task=`57def596-e8bb-484d-a36c-4cfc1f0fa4b5`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:35:56,112::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:35:56,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:56,119::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:56,123::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:56,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:56,130::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:56,134::__init__::225::IOProcess::(_processLogs) (273158) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:56,138::__init__::225::IOProcess::(_processLogs) (273158) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:56,141::__init__::225::IOProcess::(_processLogs) (273158) Building response >Thread-18::DEBUG::2014-07-08 16:35:56,142::__init__::225::IOProcess::(_processLogs) (273158) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:56,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:56,148::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:56,152::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:56,153::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:35:56,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:56,155::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Queuing request... >Thread-6940::INFO::2014-07-08 16:35:56,157::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:35:56,159::task::1191::Storage.TaskManager.Task::(prepare) Task=`57def596-e8bb-484d-a36c-4cfc1f0fa4b5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:35:56,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:35:56,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`57def596-e8bb-484d-a36c-4cfc1f0fa4b5`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:35:56,162::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:35:56,162::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:35:56,163::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:35:56,165::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:35:56,166::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:35:56,168::__init__::225::IOProcess::(_processLogs) (273159) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:35:56,169::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:35:56,171::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:35:56,171::__init__::225::IOProcess::(_processLogs) (273159) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:35:56,172::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:35:56,174::__init__::225::IOProcess::(_processLogs) (273159) Building response >Thread-6940::DEBUG::2014-07-08 16:35:56,175::task::993::Storage.TaskManager.Task::(_decref) Task=`57def596-e8bb-484d-a36c-4cfc1f0fa4b5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:35:56,177::__init__::225::IOProcess::(_processLogs) (273159) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:56,179::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:56,180::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:35:56,186::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:35:56,187::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:35:56,188::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:35:56,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:35:56,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:35:56,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:35:56,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:35:56,193::__init__::225::IOProcess::(_processLogs) (273160) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:35:56,194::__init__::225::IOProcess::(_processLogs) (273160) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:35:56,195::__init__::225::IOProcess::(_processLogs) (273160) Building response >Thread-18::DEBUG::2014-07-08 16:35:56,196::__init__::225::IOProcess::(_processLogs) (273160) Queuing response >Thread-18::DEBUG::2014-07-08 16:35:56,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:35:56,198::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:35:58,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:35:58,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176878 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:00,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:00,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173872 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:02,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:03,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177026 s, 57.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:36:03,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`8415671c-3b44-4df4-9407-4a7435ddd491`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:36:03,855::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:36:03,856::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496977', 'lastCheck': '7.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:36:03,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`8415671c-3b44-4df4-9407-4a7435ddd491`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496977', 'lastCheck': '7.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:36:03,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`8415671c-3b44-4df4-9407-4a7435ddd491`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:36:03,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:36:03,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:36:03,857::task::993::Storage.TaskManager.Task::(_decref) Task=`8415671c-3b44-4df4-9407-4a7435ddd491`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:36:05,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:05,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0913283 s, 11.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:36:06,203::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:36:06,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:06,205::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:06,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:06,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:06,206::__init__::225::IOProcess::(_processLogs) (273161) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:36:06,206::__init__::225::IOProcess::(_processLogs) (273161) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:06,206::__init__::225::IOProcess::(_processLogs) (273161) Building response >Thread-18::DEBUG::2014-07-08 16:36:06,206::__init__::225::IOProcess::(_processLogs) (273161) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:06,207::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:06,207::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:36:06,209::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:36:06,379::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:36:06,382::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000609839 s, 758 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:36:06,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbe646a1-26f2-47a2-9e70-7b50349ee572`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:06,396::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::INFO::2014-07-08 16:36:06,397::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:06,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:06,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:06,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:06,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:06,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:06,410::__init__::225::IOProcess::(_processLogs) (273162) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:36:06,413::__init__::225::IOProcess::(_processLogs) (273162) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:06,418::__init__::225::IOProcess::(_processLogs) (273162) Building response >Thread-18::DEBUG::2014-07-08 16:36:06,420::__init__::225::IOProcess::(_processLogs) (273162) Queuing response >Thread-6941::INFO::2014-07-08 16:36:06,421::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:36:06,424::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbe646a1-26f2-47a2-9e70-7b50349ee572`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:36:06,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6941::DEBUG::2014-07-08 16:36:06,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbe646a1-26f2-47a2-9e70-7b50349ee572`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:36:06,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:36:06,433::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:36:06,437::task::993::Storage.TaskManager.Task::(_decref) Task=`cbe646a1-26f2-47a2-9e70-7b50349ee572`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:36:06,450::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:36:06,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:06,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:06,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:06,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:06,452::__init__::225::IOProcess::(_processLogs) (273163) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:06,452::__init__::225::IOProcess::(_processLogs) (273163) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:06,452::__init__::225::IOProcess::(_processLogs) (273163) Building response >Thread-18::DEBUG::2014-07-08 16:36:06,452::__init__::225::IOProcess::(_processLogs) (273163) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:06,453::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:06,453::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:36:06,454::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:36:06,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:06,455::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:06,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:06,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:06,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:06,455::__init__::225::IOProcess::(_processLogs) (273164) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:06,456::__init__::225::IOProcess::(_processLogs) (273164) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:06,456::__init__::225::IOProcess::(_processLogs) (273164) Building response >Thread-18::DEBUG::2014-07-08 16:36:06,456::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273164) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:06,457::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:06,457::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:36:06,458::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:06,458::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:36:06,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:06,459::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:06,459::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:06,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:06,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:06,460::__init__::225::IOProcess::(_processLogs) (273165) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:06,460::__init__::225::IOProcess::(_processLogs) (273165) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:36:06,462::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:36:06,462::__init__::225::IOProcess::(_processLogs) (273165) Building response >Thread-6940::DEBUG::2014-07-08 16:36:06,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e1b0d6d-dca9-4201-a760-ce93c2d101fc`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:06,465::__init__::225::IOProcess::(_processLogs) (273165) Queuing response >Thread-6940::INFO::2014-07-08 16:36:06,466::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:06,467::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:06,468::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:36:06,470::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4b2c4a4e-cdcd-4f20-b1ce-868a988a103b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:36:06,470::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:36:06,472::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:36:06,472::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4b2c4a4e-cdcd-4f20-b1ce-868a988a103b`::Granted request >Thread-6940::DEBUG::2014-07-08 16:36:06,473::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1e1b0d6d-dca9-4201-a760-ce93c2d101fc`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:36:06,473::task::993::Storage.TaskManager.Task::(_decref) Task=`1e1b0d6d-dca9-4201-a760-ce93c2d101fc`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:36:06,492::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:36:06,493::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e1b0d6d-dca9-4201-a760-ce93c2d101fc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:36:06,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e1b0d6d-dca9-4201-a760-ce93c2d101fc`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:36:06,493::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:36:06,493::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:36:06,494::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:36:06,494::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:36:06,494::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:36:06,495::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:36:06,495::task::993::Storage.TaskManager.Task::(_decref) Task=`1e1b0d6d-dca9-4201-a760-ce93c2d101fc`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:36:07,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:07,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176085 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:09,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:09,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174467 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:11,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:12,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173386 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:14,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:14,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174674 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:16,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:36:16,620::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:36:16,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::DEBUG::2014-07-08 16:36:16,631::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:36:16,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:16,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::DEBUG::2014-07-08 16:36:16,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`24b61586-d878-44e4-8ea1-2fc08ab0e7fa`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:16,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6941::INFO::2014-07-08 16:36:16,651::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:16,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:16,663::__init__::225::IOProcess::(_processLogs) (273166) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:36:16,664::__init__::225::IOProcess::(_processLogs) (273166) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:16,667::__init__::225::IOProcess::(_processLogs) (273166) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:16,668::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:16,668::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6941::INFO::2014-07-08 16:36:16,676::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:36:16,681::task::1191::Storage.TaskManager.Task::(prepare) Task=`24b61586-d878-44e4-8ea1-2fc08ab0e7fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:36:16,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`24b61586-d878-44e4-8ea1-2fc08ab0e7fa`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:36:16,686::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-08 16:36:16,693::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:36:16,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:36:16,849::task::993::Storage.TaskManager.Task::(_decref) Task=`24b61586-d878-44e4-8ea1-2fc08ab0e7fa`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 16:36:16,861::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000526032 s, 878 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:36:16,868::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:36:16,873::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:16,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:36:16,883::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:36:16,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:16,893::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:36:16,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c8bc551-8fab-46c1-bd57-eb4d34473930`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:16,900::__init__::225::IOProcess::(_processLogs) (273167) Finding callback 'statvfs'... >Thread-6940::INFO::2014-07-08 16:36:16,903::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:16,905::__init__::225::IOProcess::(_processLogs) (273167) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:16,911::__init__::225::IOProcess::(_processLogs) (273167) Building response >Thread-18::DEBUG::2014-07-08 16:36:16,918::__init__::225::IOProcess::(_processLogs) (273167) Queuing response >Thread-6940::DEBUG::2014-07-08 16:36:16,920::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5b61e3f6-1cca-4a44-b7dd-22fbf5ba0e9f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:36:16,921::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:36:16,922::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:36:16,924::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6940::DEBUG::2014-07-08 16:36:16,926::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:36:17,007::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5b61e3f6-1cca-4a44-b7dd-22fbf5ba0e9f`::Granted request >Dummy-6860::DEBUG::2014-07-08 16:36:17,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.311764 s, 3.3 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:36:17,020::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5c8bc551-8fab-46c1-bd57-eb4d34473930`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:36:17,023::task::993::Storage.TaskManager.Task::(_decref) Task=`5c8bc551-8fab-46c1-bd57-eb4d34473930`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:36:17,027::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:36:17,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:17,033::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:17,035::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:17,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:17,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:17,044::__init__::225::IOProcess::(_processLogs) (273168) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:17,047::__init__::225::IOProcess::(_processLogs) (273168) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:17,051::__init__::225::IOProcess::(_processLogs) (273168) Building response >Thread-18::DEBUG::2014-07-08 16:36:17,052::__init__::225::IOProcess::(_processLogs) (273168) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:17,052::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:17,054::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:36:17,059::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:36:17,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:17,062::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:17,063::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:17,064::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:17,064::__init__::225::IOProcess::(_processLogs) (273169) Finding callback 'access'... >Thread-6940::INFO::2014-07-08 16:36:17,066::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:36:17,066::__init__::225::IOProcess::(_processLogs) (273169) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:36:17,067::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c8bc551-8fab-46c1-bd57-eb4d34473930`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:36:17,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c8bc551-8fab-46c1-bd57-eb4d34473930`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:36:17,068::__init__::225::IOProcess::(_processLogs) (273169) Building response >Thread-18::DEBUG::2014-07-08 16:36:17,070::__init__::225::IOProcess::(_processLogs) (273169) Queuing response >Thread-6940::DEBUG::2014-07-08 16:36:17,070::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:36:17,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:36:17,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:36:17,074::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:36:17,075::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:36:17,075::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:36:17,076::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:36:17,077::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:36:17,079::task::993::Storage.TaskManager.Task::(_decref) Task=`5c8bc551-8fab-46c1-bd57-eb4d34473930`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:36:17,083::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:36:17,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:17,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:17,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:17,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:17,090::__init__::225::IOProcess::(_processLogs) (273170) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:17,091::__init__::225::IOProcess::(_processLogs) (273170) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:17,093::__init__::225::IOProcess::(_processLogs) (273170) Building response >Thread-18::DEBUG::2014-07-08 16:36:17,094::__init__::225::IOProcess::(_processLogs) (273170) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:17,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:17,096::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:36:19,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fd92bff-9eda-4c5a-b92c-a6de87d48484`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:36:19,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:36:19,011::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526032', 'lastCheck': '1.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:36:19,011::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fd92bff-9eda-4c5a-b92c-a6de87d48484`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526032', 'lastCheck': '1.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:36:19,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fd92bff-9eda-4c5a-b92c-a6de87d48484`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:36:19,012::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:36:19,012::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:36:19,012::task::993::Storage.TaskManager.Task::(_decref) Task=`5fd92bff-9eda-4c5a-b92c-a6de87d48484`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:36:19,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:19,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174747 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:21,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:21,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175504 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:23,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:23,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01743 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:25,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:26,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175353 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:36:27,097::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:36:27,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`80c3c420-3945-40eb-b965-f105ae6b84e6`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:36:27,099::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:27,104::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:36:27,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:27,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:27,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:27,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:27,106::__init__::225::IOProcess::(_processLogs) (273171) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:36:27,106::__init__::225::IOProcess::(_processLogs) (273171) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:27,106::__init__::225::IOProcess::(_processLogs) (273171) Building response >Thread-18::DEBUG::2014-07-08 16:36:27,106::__init__::225::IOProcess::(_processLogs) (273171) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:27,107::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:27,107::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:36:27,108::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::INFO::2014-07-08 16:36:27,253::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:36:27,256::task::1191::Storage.TaskManager.Task::(prepare) Task=`80c3c420-3945-40eb-b965-f105ae6b84e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:36:27,257::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000591121 s, 782 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:36:27,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`80c3c420-3945-40eb-b965-f105ae6b84e6`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:36:27,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:36:27,262::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:36:27,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:36:27,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::DEBUG::2014-07-08 16:36:27,264::task::993::Storage.TaskManager.Task::(_decref) Task=`80c3c420-3945-40eb-b965-f105ae6b84e6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:36:27,265::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:27,267::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:27,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:27,270::__init__::225::IOProcess::(_processLogs) (273172) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:36:27,270::__init__::225::IOProcess::(_processLogs) (273172) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:27,270::__init__::225::IOProcess::(_processLogs) (273172) Building response >Thread-18::DEBUG::2014-07-08 16:36:27,270::__init__::225::IOProcess::(_processLogs) (273172) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:27,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:27,271::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:36:27,273::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:36:27,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:27,274::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:27,274::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:27,274::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:27,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:27,275::__init__::225::IOProcess::(_processLogs) (273173) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:27,275::__init__::225::IOProcess::(_processLogs) (273173) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:27,275::__init__::225::IOProcess::(_processLogs) (273173) Building response >Thread-18::DEBUG::2014-07-08 16:36:27,275::__init__::225::IOProcess::(_processLogs) (273173) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:27,276::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:27,276::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:36:27,277::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:36:27,277::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:27,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:27,280::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:36:27,280::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:36:27,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:36:27,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7bdce37-6f3a-4bba-98eb-afa460afe681`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:27,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::INFO::2014-07-08 16:36:27,285::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:27,285::__init__::225::IOProcess::(_processLogs) (273174) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:27,287::__init__::225::IOProcess::(_processLogs) (273174) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:36:27,288::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3276fce2-a205-4ba6-9c52-f9018459c045`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:36:27,289::__init__::225::IOProcess::(_processLogs) (273174) Building response >Thread-6940::DEBUG::2014-07-08 16:36:27,289::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:36:27,290::__init__::225::IOProcess::(_processLogs) (273174) Queuing response >Thread-6940::DEBUG::2014-07-08 16:36:27,292::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:36:27,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:36:27,293::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3276fce2-a205-4ba6-9c52-f9018459c045`::Granted request >Thread-18::DEBUG::2014-07-08 16:36:27,293::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:36:27,296::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b7bdce37-6f3a-4bba-98eb-afa460afe681`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:36:27,297::task::993::Storage.TaskManager.Task::(_decref) Task=`b7bdce37-6f3a-4bba-98eb-afa460afe681`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:36:27,299::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:27,301::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:36:27,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:27,305::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:27,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:27,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:27,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:27,313::__init__::225::IOProcess::(_processLogs) (273175) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:27,314::__init__::225::IOProcess::(_processLogs) (273175) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:27,314::__init__::225::IOProcess::(_processLogs) (273175) Building response >Thread-18::DEBUG::2014-07-08 16:36:27,314::__init__::225::IOProcess::(_processLogs) (273175) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:27,314::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:27,315::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::INFO::2014-07-08 16:36:27,328::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:36:27,329::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7bdce37-6f3a-4bba-98eb-afa460afe681`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:36:27,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7bdce37-6f3a-4bba-98eb-afa460afe681`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:36:27,329::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:36:27,330::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:36:27,330::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:36:27,330::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:36:27,331::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:36:27,331::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:36:27,331::task::993::Storage.TaskManager.Task::(_decref) Task=`b7bdce37-6f3a-4bba-98eb-afa460afe681`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:36:28,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:28,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175314 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:30,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:30,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181918 s, 56.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:32,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:32,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173208 s, 59.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:36:34,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f9c7509-c64a-4432-beb2-680df9345ff1`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:36:34,210::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:36:34,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591121', 'lastCheck': '6.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:36:34,214::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f9c7509-c64a-4432-beb2-680df9345ff1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591121', 'lastCheck': '6.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:36:34,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f9c7509-c64a-4432-beb2-680df9345ff1`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:36:34,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:36:34,217::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:36:34,218::task::993::Storage.TaskManager.Task::(_decref) Task=`8f9c7509-c64a-4432-beb2-680df9345ff1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:36:35,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:35,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448903 s, 22.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:36:37,320::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:36:37,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Dummy-6860::DEBUG::2014-07-08 16:36:37,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:36:37,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:37,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6941::DEBUG::2014-07-08 16:36:37,480::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:36:37,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6941::DEBUG::2014-07-08 16:36:37,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`383a694e-9f0d-46ad-babc-7ff23b8a9209`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:37,489::__init__::225::IOProcess::(_processLogs) (273176) Finding callback 'statvfs'... >Thread-6941::INFO::2014-07-08 16:36:37,495::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:37,496::__init__::225::IOProcess::(_processLogs) (273176) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:37,502::__init__::225::IOProcess::(_processLogs) (273176) Building response >Thread-18::DEBUG::2014-07-08 16:36:37,503::__init__::225::IOProcess::(_processLogs) (273176) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:37,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:37,506::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:36:37,511::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::INFO::2014-07-08 16:36:37,660::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:36:37,666::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00060425 s, 765 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:36:37,668::task::1191::Storage.TaskManager.Task::(prepare) Task=`383a694e-9f0d-46ad-babc-7ff23b8a9209`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:36:37,672::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:36:37,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`383a694e-9f0d-46ad-babc-7ff23b8a9209`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:36:37,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::DEBUG::2014-07-08 16:36:37,676::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:36:37,678::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6941::DEBUG::2014-07-08 16:36:37,679::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:36:37,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::DEBUG::2014-07-08 16:36:37,681::task::993::Storage.TaskManager.Task::(_decref) Task=`383a694e-9f0d-46ad-babc-7ff23b8a9209`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:36:37,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:37,688::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:37,691::__init__::225::IOProcess::(_processLogs) (273177) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:37,694::__init__::225::IOProcess::(_processLogs) (273177) Building response >Thread-18::DEBUG::2014-07-08 16:36:37,695::__init__::225::IOProcess::(_processLogs) (273177) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:37,696::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:37,697::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Dummy-6860::DEBUG::2014-07-08 16:36:37,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.22415 s, 4.6 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:36:37,787::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:36:37,789::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:36:37,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:36:37,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`12f54b83-bdd2-4579-8136-21d7b381645f`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:37,795::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::INFO::2014-07-08 16:36:37,796::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:37,797::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:37,799::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:37,802::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:36:37,804::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5618b6f9-9166-41dc-ad3b-a9e9bd4abb42`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:36:37,804::__init__::225::IOProcess::(_processLogs) (273178) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:36:37,805::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:36:37,807::__init__::225::IOProcess::(_processLogs) (273178) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:36:37,809::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:36:37,810::__init__::225::IOProcess::(_processLogs) (273178) Building response >Thread-6940::DEBUG::2014-07-08 16:36:37,811::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5618b6f9-9166-41dc-ad3b-a9e9bd4abb42`::Granted request >Thread-18::DEBUG::2014-07-08 16:36:37,813::__init__::225::IOProcess::(_processLogs) (273178) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:37,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:36:37,817::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`12f54b83-bdd2-4579-8136-21d7b381645f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:36:37,820::task::993::Storage.TaskManager.Task::(_decref) Task=`12f54b83-bdd2-4579-8136-21d7b381645f`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:36:37,825::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:36:37,829::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:37,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:37,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:37,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:37,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:37,842::__init__::225::IOProcess::(_processLogs) (273179) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:37,845::__init__::225::IOProcess::(_processLogs) (273179) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:37,847::__init__::225::IOProcess::(_processLogs) (273179) Building response >Thread-18::DEBUG::2014-07-08 16:36:37,849::__init__::225::IOProcess::(_processLogs) (273179) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:37,852::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:37,853::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:36:37,856::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:36:37,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:37,859::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:37,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:37,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:37,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:37,864::__init__::225::IOProcess::(_processLogs) (273180) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:37,866::__init__::225::IOProcess::(_processLogs) (273180) Got request for method 'access' >Thread-6940::INFO::2014-07-08 16:36:37,868::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:36:37,869::__init__::225::IOProcess::(_processLogs) (273180) Building response >Thread-6940::DEBUG::2014-07-08 16:36:37,870::task::1191::Storage.TaskManager.Task::(prepare) Task=`12f54b83-bdd2-4579-8136-21d7b381645f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:36:37,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`12f54b83-bdd2-4579-8136-21d7b381645f`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:36:37,872::__init__::225::IOProcess::(_processLogs) (273180) Queuing response >Thread-6940::DEBUG::2014-07-08 16:36:37,873::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:36:37,875::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:36:37,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:37,878::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:36:37,879::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:36:37,883::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:36:37,884::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:36:37,886::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:36:37,888::task::993::Storage.TaskManager.Task::(_decref) Task=`12f54b83-bdd2-4579-8136-21d7b381645f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:36:39,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:40,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173657 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:42,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:42,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173755 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:44,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:44,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017509 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:46,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:46,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017278 s, 59.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:36:47,886::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:47,887::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:36:47,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:47,887::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:47,888::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:47,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:47,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:47,889::__init__::225::IOProcess::(_processLogs) (273181) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:36:47,889::__init__::225::IOProcess::(_processLogs) (273181) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:47,889::__init__::225::IOProcess::(_processLogs) (273181) Building response >Thread-18::DEBUG::2014-07-08 16:36:47,889::__init__::225::IOProcess::(_processLogs) (273181) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:47,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:47,890::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:36:47,891::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:36:48,043::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00043077 s, 1.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:36:48,044::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:36:48,049::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:36:48,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bce04df-c3da-4c6c-9c72-3e4158dc970f`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:48,051::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::INFO::2014-07-08 16:36:48,052::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:48,053::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:48,054::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:48,055::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:48,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:48,055::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:48,055::__init__::225::IOProcess::(_processLogs) (273182) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:36:48,056::__init__::225::IOProcess::(_processLogs) (273182) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:48,056::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273182) Building response >Thread-18::DEBUG::2014-07-08 16:36:48,057::__init__::225::IOProcess::(_processLogs) (273182) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:48,057::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:48,057::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:36:48,059::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:48,060::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:36:48,060::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:48,060::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:48,060::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:48,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:48,061::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:48,061::__init__::225::IOProcess::(_processLogs) (273183) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:48,061::__init__::225::IOProcess::(_processLogs) (273183) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:48,062::__init__::225::IOProcess::(_processLogs) (273183) Building response >Thread-18::DEBUG::2014-07-08 16:36:48,062::__init__::225::IOProcess::(_processLogs) (273183) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:48,062::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:48,062::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:36:48,069::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:36:48,069::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:48,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:48,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:48,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:48,070::__init__::225::IOProcess::(_processLogs) (273184) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:48,071::__init__::225::IOProcess::(_processLogs) (273184) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:48,071::__init__::225::IOProcess::(_processLogs) (273184) Building response >Thread-18::DEBUG::2014-07-08 16:36:48,071::__init__::225::IOProcess::(_processLogs) (273184) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:48,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:48,072::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:36:48,073::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:36:48,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::INFO::2014-07-08 16:36:48,073::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:36:48,075::task::1191::Storage.TaskManager.Task::(prepare) Task=`4bce04df-c3da-4c6c-9c72-3e4158dc970f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:36:48,075::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6941::DEBUG::2014-07-08 16:36:48,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bce04df-c3da-4c6c-9c72-3e4158dc970f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:36:48,077::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:36:48,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::DEBUG::2014-07-08 16:36:48,078::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:36:48,079::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6941::DEBUG::2014-07-08 16:36:48,079::task::993::Storage.TaskManager.Task::(_decref) Task=`4bce04df-c3da-4c6c-9c72-3e4158dc970f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:36:48,081::__init__::225::IOProcess::(_processLogs) (273185) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:48,082::__init__::225::IOProcess::(_processLogs) (273185) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:48,083::__init__::225::IOProcess::(_processLogs) (273185) Building response >Thread-18::DEBUG::2014-07-08 16:36:48,084::__init__::225::IOProcess::(_processLogs) (273185) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:48,084::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:48,084::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:36:48,093::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:36:48,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`540fc67f-72b3-471d-b666-31c6ac92a667`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:36:48,094::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:36:48,095::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`448b43ed-0d16-47c9-8b1c-501d2295e218`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:36:48,096::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:36:48,096::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:36:48,096::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`448b43ed-0d16-47c9-8b1c-501d2295e218`::Granted request >Thread-6940::DEBUG::2014-07-08 16:36:48,097::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`540fc67f-72b3-471d-b666-31c6ac92a667`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:36:48,097::task::993::Storage.TaskManager.Task::(_decref) Task=`540fc67f-72b3-471d-b666-31c6ac92a667`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:36:48,116::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:36:48,116::task::1191::Storage.TaskManager.Task::(prepare) Task=`540fc67f-72b3-471d-b666-31c6ac92a667`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:36:48,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`540fc67f-72b3-471d-b666-31c6ac92a667`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:36:48,117::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:36:48,117::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:36:48,118::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:36:48,118::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:36:48,118::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:36:48,118::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:36:48,119::task::993::Storage.TaskManager.Task::(_decref) Task=`540fc67f-72b3-471d-b666-31c6ac92a667`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:36:49,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:49,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176621 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:36:49,551::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc3f86a5-2105-4707-81c0-930c9b750847`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:36:49,552::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:36:49,552::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043077', 'lastCheck': '1.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:36:49,552::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc3f86a5-2105-4707-81c0-930c9b750847`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043077', 'lastCheck': '1.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:36:49,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc3f86a5-2105-4707-81c0-930c9b750847`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:36:49,553::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:36:49,553::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:36:49,553::task::993::Storage.TaskManager.Task::(_decref) Task=`cc3f86a5-2105-4707-81c0-930c9b750847`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:36:51,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:51,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0475261 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:53,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:53,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174959 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:36:55,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:36:56,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170816 s, 59.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:36:58,086::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:36:58,093::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:36:58,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:58,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:58,095::__init__::225::IOProcess::(_processLogs) (273186) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:36:58,095::__init__::225::IOProcess::(_processLogs) (273186) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:36:58,095::__init__::225::IOProcess::(_processLogs) (273186) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,095::__init__::225::IOProcess::(_processLogs) (273186) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,096::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:36:58,100::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:36:58,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:58,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:58,103::__init__::225::IOProcess::(_processLogs) (273187) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:36:58,103::__init__::225::IOProcess::(_processLogs) (273187) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:36:58,103::__init__::225::IOProcess::(_processLogs) (273187) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,104::__init__::225::IOProcess::(_processLogs) (273187) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,104::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:36:58,106::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:36:58,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:58,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,108::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:58,108::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:36:58,108::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,108::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:58,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,109::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:58,109::__init__::225::IOProcess::(_processLogs) (273188) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:36:58,110::__init__::225::IOProcess::(_processLogs) (273188) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:36:58,110::__init__::225::IOProcess::(_processLogs) (273188) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,110::__init__::225::IOProcess::(_processLogs) (273188) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,110::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,111::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:36:58,111::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:58,111::__init__::225::IOProcess::(_processLogs) (273189) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:36:58,111::__init__::225::IOProcess::(_processLogs) (273189) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:36:58,112::__init__::225::IOProcess::(_processLogs) DEBUG|(273189) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,115::__init__::225::IOProcess::(_processLogs) (273189) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,117::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,119::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-37::DEBUG::2014-07-08 16:36:58,124::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:36:58,125::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:58,125::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:36:58,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:58,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:58,127::__init__::225::IOProcess::(_processLogs) (273190) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:36:58,127::__init__::225::IOProcess::(_processLogs) (273190) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:36:58,127::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|(273190) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,128::__init__::225::IOProcess::(_processLogs) (273190) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,128::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,128::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:36:58,129::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:36:58,130::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:58,130::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:36:58,130::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,131::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:58,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,133::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Extracting request information... >Thread-6941::DEBUG::2014-07-08 16:36:58,134::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:36:58,135::__init__::225::IOProcess::(_processLogs) (273191) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:36:58,137::__init__::225::IOProcess::(_processLogs) (273191) Got request for method 'readfile' >Thread-6941::DEBUG::2014-07-08 16:36:58,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d57ebbc-811a-4bab-9b79-6135cfcc0f87`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:58,139::__init__::225::IOProcess::(_processLogs) (273191) Building response >Thread-6941::INFO::2014-07-08 16:36:58,140::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:58,141::__init__::225::IOProcess::(_processLogs) (273191) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,142::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:36:58,143::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Dummy-6860::DEBUG::2014-07-08 16:36:58,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:36:58,295::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:58,296::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:36:58,296::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,296::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:58,297::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,297::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:58,305::__init__::225::IOProcess::(_processLogs) (273192) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:58,306::__init__::225::IOProcess::(_processLogs) (273192) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:58,307::__init__::225::IOProcess::(_processLogs) (273192) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,307::__init__::225::IOProcess::(_processLogs) (273192) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,307::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,309::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:36:58,315::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:58,405::__init__::225::IOProcess::(_processLogs) Message size is 167 >Dummy-6860::DEBUG::2014-07-08 16:36:58,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265393 s, 38.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:36:58,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,408::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:58,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,411::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:58,413::__init__::225::IOProcess::(_processLogs) (273193) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:36:58,414::__init__::225::IOProcess::(_processLogs) (273193) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:36:58,415::__init__::225::IOProcess::(_processLogs) (273193) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,416::__init__::225::IOProcess::(_processLogs) (273193) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,418::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,419::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:36:58,421::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:36:58,423::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:36:58,423::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:36:58,426::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:58,427::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:36:58,437::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,440::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6941::INFO::2014-07-08 16:36:58,443::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:36:58,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::DEBUG::2014-07-08 16:36:58,446::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d57ebbc-811a-4bab-9b79-6135cfcc0f87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:36:58,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d57ebbc-811a-4bab-9b79-6135cfcc0f87`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:36:58,450::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:36:58,450::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6941::DEBUG::2014-07-08 16:36:58,451::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:36:58,454::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Extracting request information... >Thread-6941::DEBUG::2014-07-08 16:36:58,455::task::993::Storage.TaskManager.Task::(_decref) Task=`3d57ebbc-811a-4bab-9b79-6135cfcc0f87`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:36:58,458::__init__::225::IOProcess::(_processLogs) (273194) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:36:58,462::__init__::225::IOProcess::(_processLogs) (273194) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:36:58,464::__init__::225::IOProcess::(_processLogs) (273194) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,465::__init__::225::IOProcess::(_processLogs) (273194) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,468::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:36:58,473::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:36:58,627::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000596149 s, 775 kB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:36:58,626::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:36:58,635::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Receiving request... >Thread-6940::DEBUG::2014-07-08 16:36:58,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`291b9e0c-1432-48ac-957f-6cfb0bb51f5d`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:36:58,640::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6940::INFO::2014-07-08 16:36:58,642::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:36:58,644::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,648::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:36:58,649::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1cf1d9e0-775e-4b4f-bce3-c28990d84231`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:36:58,651::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:36:58,652::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:36:58,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:36:58,656::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:36:58,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:36:58,659::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1cf1d9e0-775e-4b4f-bce3-c28990d84231`::Granted request >Thread-18::DEBUG::2014-07-08 16:36:58,660::__init__::225::IOProcess::(_processLogs) (273195) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:36:58,663::__init__::225::IOProcess::(_processLogs) (273195) Got request for method 'statvfs' >Thread-6940::DEBUG::2014-07-08 16:36:58,665::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`291b9e0c-1432-48ac-957f-6cfb0bb51f5d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:36:58,666::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|(273195) Building response >Thread-6940::DEBUG::2014-07-08 16:36:58,667::task::993::Storage.TaskManager.Task::(_decref) Task=`291b9e0c-1432-48ac-957f-6cfb0bb51f5d`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:36:58,670::__init__::225::IOProcess::(_processLogs) (273195) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,678::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:36:58,704::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:58,707::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:36:58,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,713::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:36:58,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,720::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:58,723::__init__::225::IOProcess::(_processLogs) (273196) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:58,723::__init__::225::IOProcess::(_processLogs) (273196) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:58,724::__init__::225::IOProcess::(_processLogs) (273196) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,725::__init__::225::IOProcess::(_processLogs) (273196) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,726::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,727::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:36:58,730::__init__::225::IOProcess::(_processLogs) Message size is 156DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:36:58,731::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:36:58,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,734::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::INFO::2014-07-08 16:36:58,735::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:36:58,738::task::1191::Storage.TaskManager.Task::(prepare) Task=`291b9e0c-1432-48ac-957f-6cfb0bb51f5d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:36:58,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:36:58,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`291b9e0c-1432-48ac-957f-6cfb0bb51f5d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:36:58,741::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:36:58,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:36:58,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:36:58,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:36:58,746::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:36:58,747::__init__::225::IOProcess::(_processLogs) (273197) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:58,749::__init__::225::IOProcess::(_processLogs) (273197) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:36:58,750::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:36:58,751::__init__::225::IOProcess::(_processLogs) (273197) Building response >Thread-6940::DEBUG::2014-07-08 16:36:58,752::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:36:58,753::__init__::225::IOProcess::(_processLogs) (273197) Queuing response >Thread-6940::DEBUG::2014-07-08 16:36:58,754::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:36:58,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,758::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:36:58,759::task::993::Storage.TaskManager.Task::(_decref) Task=`291b9e0c-1432-48ac-957f-6cfb0bb51f5d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:36:58,766::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:36:58,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:36:58,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:36:58,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:36:58,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:36:58,774::__init__::225::IOProcess::(_processLogs) (273198) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:36:58,775::__init__::225::IOProcess::(_processLogs) (273198) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:36:58,776::__init__::225::IOProcess::(_processLogs) (273198) Building response >Thread-18::DEBUG::2014-07-08 16:36:58,777::__init__::225::IOProcess::(_processLogs) (273198) Queuing response >Thread-18::DEBUG::2014-07-08 16:36:58,778::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:36:58,779::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:37:00,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:01,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174937 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:03,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:03,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178113 s, 57.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:37:04,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`b33de0dd-52a0-45d2-a37c-be91c5651cf4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:37:04,729::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:37:04,731::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596149', 'lastCheck': '5.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:37:04,732::task::1191::Storage.TaskManager.Task::(prepare) Task=`b33de0dd-52a0-45d2-a37c-be91c5651cf4`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596149', 'lastCheck': '5.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:37:04,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`b33de0dd-52a0-45d2-a37c-be91c5651cf4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:37:04,734::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:37:04,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:37:04,736::task::993::Storage.TaskManager.Task::(_decref) Task=`b33de0dd-52a0-45d2-a37c-be91c5651cf4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:37:05,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:05,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172987 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:07,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:07,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177985 s, 57.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:37:08,785::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:37:08,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::DEBUG::2014-07-08 16:37:08,786::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:37:08,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::DEBUG::2014-07-08 16:37:08,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bf1af7c-a5cc-4d60-aaa5-41e683af8360`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:37:08,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6941::INFO::2014-07-08 16:37:08,791::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:37:08,792::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:08,793::__init__::225::IOProcess::(_processLogs) (273199) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:37:08,794::__init__::225::IOProcess::(_processLogs) (273199) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:08,794::__init__::225::IOProcess::(_processLogs) (273199) Building response >Thread-18::DEBUG::2014-07-08 16:37:08,794::__init__::225::IOProcess::(_processLogs) (273199) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:08,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:08,795::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:37:08,808::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::INFO::2014-07-08 16:37:08,954::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:37:08,955::task::1191::Storage.TaskManager.Task::(prepare) Task=`2bf1af7c-a5cc-4d60-aaa5-41e683af8360`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:37:08,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bf1af7c-a5cc-4d60-aaa5-41e683af8360`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:37:08,956::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:37:08,956::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:37:08,956::task::993::Storage.TaskManager.Task::(_decref) Task=`2bf1af7c-a5cc-4d60-aaa5-41e683af8360`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 16:37:08,959::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000458428 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:37:08,961::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:37:08,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:08,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:08,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:08,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:08,963::__init__::225::IOProcess::(_processLogs) (273200) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:37:08,963::__init__::225::IOProcess::(_processLogs) (273200) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:08,963::__init__::225::IOProcess::(_processLogs) (273200) Building response >Thread-18::DEBUG::2014-07-08 16:37:08,964::__init__::225::IOProcess::(_processLogs) (273200) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:08,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:08,964::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:37:08,966::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:37:08,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:08,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:08,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:08,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:08,968::__init__::225::IOProcess::(_processLogs) (273201) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:08,968::__init__::225::IOProcess::(_processLogs) (273201) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:08,968::__init__::225::IOProcess::(_processLogs) (273201) Building response >Thread-18::DEBUG::2014-07-08 16:37:08,968::__init__::225::IOProcess::(_processLogs) (273201) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:08,970::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:37:08,972::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:37:08,972::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:37:08,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`4806ab6e-ee1d-41e9-bde4-981a2cb12448`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:37:08,976::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:37:08,978::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f83ab5f4-4640-4afe-b3c6-02f97f14c1de`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:37:08,978::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:37:08,979::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:37:08,979::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f83ab5f4-4640-4afe-b3c6-02f97f14c1de`::Granted request >Thread-6940::DEBUG::2014-07-08 16:37:08,982::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4806ab6e-ee1d-41e9-bde4-981a2cb12448`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:37:08,983::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-6940::DEBUG::2014-07-08 16:37:08,983::task::993::Storage.TaskManager.Task::(_decref) Task=`4806ab6e-ee1d-41e9-bde4-981a2cb12448`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:37:08,985::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:08,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:08,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:08,990::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:08,992::__init__::225::IOProcess::(_processLogs) (273202) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:08,994::__init__::225::IOProcess::(_processLogs) (273202) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:08,996::__init__::225::IOProcess::(_processLogs) (273202) Building response >Thread-18::DEBUG::2014-07-08 16:37:08,998::__init__::225::IOProcess::(_processLogs) (273202) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:08,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:08,999::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:37:09,001::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:37:09,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:09,002::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:09,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:09,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:09,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:09,003::__init__::225::IOProcess::(_processLogs) (273203) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:09,003::__init__::225::IOProcess::(_processLogs) (273203) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:09,003::__init__::225::IOProcess::(_processLogs) (273203) Building response >Thread-18::DEBUG::2014-07-08 16:37:09,003::__init__::225::IOProcess::(_processLogs) (273203) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:09,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:09,004::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::INFO::2014-07-08 16:37:09,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:09,015::task::1191::Storage.TaskManager.Task::(prepare) Task=`4806ab6e-ee1d-41e9-bde4-981a2cb12448`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:09,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`4806ab6e-ee1d-41e9-bde4-981a2cb12448`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:37:09,015::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:37:09,015::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:37:09,016::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:37:09,016::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:37:09,016::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:37:09,017::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:37:09,017::task::993::Storage.TaskManager.Task::(_decref) Task=`4806ab6e-ee1d-41e9-bde4-981a2cb12448`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:37:09,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:10,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372823 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:12,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:12,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176328 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:14,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:14,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174498 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:16,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:16,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176325 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:18,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:37:19,130::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:37:19,132::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6731c235] >Thread-18::DEBUG::2014-07-08 16:37:19,133::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:37:19,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:19,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6941::DEBUG::2014-07-08 16:37:19,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`51181199-26c8-4ad4-a004-9b3452a28251`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:37:19,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::INFO::2014-07-08 16:37:19,147::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:37:19,149::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:19,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:19,152::__init__::225::IOProcess::(_processLogs) (273204) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:37:19,153::__init__::225::IOProcess::(_processLogs) (273204) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:19,153::__init__::225::IOProcess::(_processLogs) (273204) Building response >Thread-18::DEBUG::2014-07-08 16:37:19,156::__init__::225::IOProcess::(_processLogs) (273204) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:19,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:19,157::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:37:19,159::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::INFO::2014-07-08 16:37:19,305::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:37:19,310::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000537485 s, 860 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:37:19,311::task::1191::Storage.TaskManager.Task::(prepare) Task=`51181199-26c8-4ad4-a004-9b3452a28251`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:37:19,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`51181199-26c8-4ad4-a004-9b3452a28251`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:37:19,319::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:37:19,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:37:19,322::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:37:19,323::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:37:19,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:19,327::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6941::DEBUG::2014-07-08 16:37:19,326::task::993::Storage.TaskManager.Task::(_decref) Task=`51181199-26c8-4ad4-a004-9b3452a28251`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:37:19,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:19,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:19,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:19,339::__init__::225::IOProcess::(_processLogs) (273205) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:37:19,342::__init__::225::IOProcess::(_processLogs) (273205) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:19,343::__init__::225::IOProcess::(_processLogs) DEBUG|(273205) Building response >Thread-18::DEBUG::2014-07-08 16:37:19,345::__init__::225::IOProcess::(_processLogs) (273205) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:19,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:19,348::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Dummy-6860::DEBUG::2014-07-08 16:37:19,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.225249 s, 4.5 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:37:19,436::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6731c235] >Thread-6940::DEBUG::2014-07-08 16:37:19,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`04e43171-e38e-42ff-b482-0da782ccccc9`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:37:19,447::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:37:19,451::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6940::DEBUG::2014-07-08 16:37:19,453::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`34badc4e-f2da-4f58-b07d-db4d6eeb1e1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:37:19,454::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:37:19,455::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:37:19,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:37:19,459::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:37:19,461::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-6940::DEBUG::2014-07-08 16:37:19,462::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`34badc4e-f2da-4f58-b07d-db4d6eeb1e1b`::Granted request >Thread-18::DEBUG::2014-07-08 16:37:19,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:19,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:19,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:37:19,469::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`04e43171-e38e-42ff-b482-0da782ccccc9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:37:19,471::__init__::225::IOProcess::(_processLogs) (273206) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:37:19,471::task::993::Storage.TaskManager.Task::(_decref) Task=`04e43171-e38e-42ff-b482-0da782ccccc9`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:37:19,473::__init__::225::IOProcess::(_processLogs) (273206) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:19,475::__init__::225::IOProcess::(_processLogs) (273206) Building response >Thread-18::DEBUG::2014-07-08 16:37:19,479::__init__::225::IOProcess::(_processLogs) (273206) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:19,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:19,483::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:37:19,494::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:37:19,496::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:37:19,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:19,504::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:19,505::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:19,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:19,510::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:19,511::__init__::225::IOProcess::(_processLogs) (273207) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:19,512::__init__::225::IOProcess::(_processLogs) (273207) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:19,513::__init__::225::IOProcess::(_processLogs) (273207) Building response >Thread-18::DEBUG::2014-07-08 16:37:19,514::__init__::225::IOProcess::(_processLogs) (273207) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:19,516::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:19,517::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::INFO::2014-07-08 16:37:19,520::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:19,523::task::1191::Storage.TaskManager.Task::(prepare) Task=`04e43171-e38e-42ff-b482-0da782ccccc9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:19,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`04e43171-e38e-42ff-b482-0da782ccccc9`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:37:19,527::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6940::DEBUG::2014-07-08 16:37:19,528::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:37:19,529::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:37:19,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:37:19,530::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:37:19,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:19,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:37:19,535::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:37:19,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:37:19,538::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:37:19,540::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:37:19,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:37:19,542::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:37:19,543::__init__::225::IOProcess::(_processLogs) (273208) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:37:19,544::task::993::Storage.TaskManager.Task::(_decref) Task=`04e43171-e38e-42ff-b482-0da782ccccc9`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:37:19,546::__init__::225::IOProcess::(_processLogs) (273208) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:19,549::__init__::225::IOProcess::(_processLogs) (273208) Building response >Thread-18::DEBUG::2014-07-08 16:37:19,552::__init__::225::IOProcess::(_processLogs) (273208) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:19,554::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:37:19,555::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:37:19,964::task::595::Storage.TaskManager.Task::(_updateState) Task=`806c451d-0745-4cba-a26e-4bf8631f7b9d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:37:19,965::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:37:19,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537485', 'lastCheck': '0.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:37:19,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`806c451d-0745-4cba-a26e-4bf8631f7b9d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537485', 'lastCheck': '0.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:37:19,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`806c451d-0745-4cba-a26e-4bf8631f7b9d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:37:19,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:37:19,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:37:19,966::task::993::Storage.TaskManager.Task::(_decref) Task=`806c451d-0745-4cba-a26e-4bf8631f7b9d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:37:21,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:21,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176909 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:23,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:24,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171911 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:26,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:26,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344068 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:28,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:28,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175892 s, 58.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:37:29,560::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:37:29,560::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:37:29,561::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:29,561::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:29,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:29,561::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:29,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:29,562::__init__::225::IOProcess::(_processLogs) (273209) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:37:29,562::__init__::225::IOProcess::(_processLogs) (273209) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:29,563::__init__::225::IOProcess::(_processLogs) (273209) Building response >Thread-18::DEBUG::2014-07-08 16:37:29,563::__init__::225::IOProcess::(_processLogs) (273209) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:29,563::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:29,563::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6941::DEBUG::2014-07-08 16:37:29,567::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:37:29,569::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:37:29,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`09f63b4d-23a0-48e4-a5da-f2449927a5ed`::moving from state init -> state preparing >Thread-37::DEBUG::2014-07-08 16:37:29,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00048301 s, 957 kB/s\n'; <rc> = 0 >Thread-6941::INFO::2014-07-08 16:37:29,721::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:37:29,726::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:37:29,726::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:37:29,726::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:29,727::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:29,727::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:29,727::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:29,728::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:29,728::__init__::225::IOProcess::(_processLogs) (273210) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:37:29,728::__init__::225::IOProcess::(_processLogs) (273210) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:29,728::__init__::225::IOProcess::(_processLogs) (273210) Building response >Thread-18::DEBUG::2014-07-08 16:37:29,728::__init__::225::IOProcess::(_processLogs) (273210) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:29,729::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:29,729::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:37:29,732::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:37:29,732::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:37:29,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:29,732::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:29,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:29,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:29,733::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:29,733::__init__::225::IOProcess::(_processLogs) (273211) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:29,734::__init__::225::IOProcess::(_processLogs) (273211) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:29,734::__init__::225::IOProcess::(_processLogs) DEBUG|(273211) Building response >Thread-18::DEBUG::2014-07-08 16:37:29,734::__init__::225::IOProcess::(_processLogs) (273211) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:29,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:29,735::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:37:29,736::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:37:29,736::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:37:29,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:29,737::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:29,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:29,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:29,737::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:29,738::__init__::225::IOProcess::(_processLogs) (273212) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:29,738::__init__::225::IOProcess::(_processLogs) (273212) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:29,738::__init__::225::IOProcess::(_processLogs) DEBUG|(273212) Building response >Thread-18::DEBUG::2014-07-08 16:37:29,738::__init__::225::IOProcess::(_processLogs) (273212) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:29,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:29,739::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::INFO::2014-07-08 16:37:29,739::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:37:29,741::task::1191::Storage.TaskManager.Task::(prepare) Task=`09f63b4d-23a0-48e4-a5da-f2449927a5ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:37:29,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`09f63b4d-23a0-48e4-a5da-f2449927a5ed`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:37:29,743::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:37:29,743::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:37:29,744::task::993::Storage.TaskManager.Task::(_decref) Task=`09f63b4d-23a0-48e4-a5da-f2449927a5ed`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:37:29,746::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:37:29,746::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:37:29,746::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:29,747::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:29,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:29,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:29,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:29,748::__init__::225::IOProcess::(_processLogs) (273213) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:29,748::__init__::225::IOProcess::(_processLogs) (273213) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:29,748::__init__::225::IOProcess::(_processLogs) (273213) Building response >Thread-18::DEBUG::2014-07-08 16:37:29,748::__init__::225::IOProcess::(_processLogs) (273213) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:29,749::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:29,749::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:37:29,756::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:37:29,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`89e46063-c9c7-403a-b3d3-280a2400b923`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:37:29,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:37:29,758::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b4e118aa-f0e4-4b7c-a495-8b04b18fb2c0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:37:29,759::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:37:29,759::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:37:29,759::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b4e118aa-f0e4-4b7c-a495-8b04b18fb2c0`::Granted request >Thread-6940::DEBUG::2014-07-08 16:37:29,760::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`89e46063-c9c7-403a-b3d3-280a2400b923`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:37:29,760::task::993::Storage.TaskManager.Task::(_decref) Task=`89e46063-c9c7-403a-b3d3-280a2400b923`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:37:29,779::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:29,780::task::1191::Storage.TaskManager.Task::(prepare) Task=`89e46063-c9c7-403a-b3d3-280a2400b923`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:29,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`89e46063-c9c7-403a-b3d3-280a2400b923`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:37:29,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:37:29,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:37:29,781::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:37:29,781::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:37:29,782::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:37:29,782::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:37:29,782::task::993::Storage.TaskManager.Task::(_decref) Task=`89e46063-c9c7-403a-b3d3-280a2400b923`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:37:30,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:30,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417559 s, 24.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:33,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:33,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178655 s, 57.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:37:35,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb7eeb9d-46bc-4ea7-9a3e-2f6c6959be60`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:37:35,129::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:37:35,131::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048301', 'lastCheck': '5.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:37:35,132::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb7eeb9d-46bc-4ea7-9a3e-2f6c6959be60`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048301', 'lastCheck': '5.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:37:35,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb7eeb9d-46bc-4ea7-9a3e-2f6c6959be60`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:37:35,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:37:35,135::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:37:35,136::task::993::Storage.TaskManager.Task::(_decref) Task=`bb7eeb9d-46bc-4ea7-9a3e-2f6c6959be60`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:37:35,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:35,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174398 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:37,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:37,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186944 s, 54.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:37:39,752::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:37:39,753::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:37:39,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:39,753::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:39,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:39,754::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:39,754::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:39,755::__init__::225::IOProcess::(_processLogs) (273214) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:37:39,755::__init__::225::IOProcess::(_processLogs) (273214) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:39,755::__init__::225::IOProcess::(_processLogs) DEBUG|(273214) Building response >Thread-18::DEBUG::2014-07-08 16:37:39,755::__init__::225::IOProcess::(_processLogs) (273214) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:39,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:39,756::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:37:39,758::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:37:39,910::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:37:39,911::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000604531 s, 764 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:37:39,916::task::595::Storage.TaskManager.Task::(_updateState) Task=`70eb548c-bad6-4c66-898f-661c584be5c3`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:37:39,917::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6941::INFO::2014-07-08 16:37:39,918::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:37:39,919::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:37:39,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:39,921::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:39,921::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:39,921::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:39,922::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:39,922::__init__::225::IOProcess::(_processLogs) (273215) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:37:39,922::__init__::225::IOProcess::(_processLogs) (273215) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:39,923::__init__::225::IOProcess::(_processLogs) (273215) Building response >Thread-18::DEBUG::2014-07-08 16:37:39,923::__init__::225::IOProcess::(_processLogs) (273215) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:39,923::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:39,923::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:37:39,926::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:37:39,926::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:37:39,926::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:39,927::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:39,927::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:39,927::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:39,928::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:39,928::__init__::225::IOProcess::(_processLogs) (273216) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:39,931::__init__::225::IOProcess::(_processLogs) (273216) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:39,937::__init__::225::IOProcess::(_processLogs) (273216) Building response >Thread-18::DEBUG::2014-07-08 16:37:39,938::__init__::225::IOProcess::(_processLogs) (273216) Queuing response >Thread-6941::INFO::2014-07-08 16:37:39,939::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:37:39,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:37:39,941::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6941::DEBUG::2014-07-08 16:37:39,943::task::1191::Storage.TaskManager.Task::(prepare) Task=`70eb548c-bad6-4c66-898f-661c584be5c3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:37:40,096::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:37:40,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`70eb548c-bad6-4c66-898f-661c584be5c3`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:37:40,100::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:37:40,102::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:37:40,104::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:37:40,104::task::993::Storage.TaskManager.Task::(_decref) Task=`70eb548c-bad6-4c66-898f-661c584be5c3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:37:40,106::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:37:40,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:40,113::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:40,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:40,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:40,119::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:40,120::__init__::225::IOProcess::(_processLogs) (273217) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:40,122::__init__::225::IOProcess::(_processLogs) (273217) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:40,123::__init__::225::IOProcess::(_processLogs) (273217) Building response >Thread-18::DEBUG::2014-07-08 16:37:40,124::__init__::225::IOProcess::(_processLogs) (273217) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:40,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:37:40,131::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:37:40,131::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:37:40,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`533bd43f-e8ee-478b-bbd1-f7a8220e89dd`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:37:40,140::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:37:40,146::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-6940::DEBUG::2014-07-08 16:37:40,147::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`66a54b6c-179d-41c2-8233-8c818b3c7e65`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:37:40,150::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:37:40,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:37:40,154::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:37:40,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:37:40,156::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`66a54b6c-179d-41c2-8233-8c818b3c7e65`::Granted request >Thread-18::DEBUG::2014-07-08 16:37:40,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:37:40,161::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`533bd43f-e8ee-478b-bbd1-f7a8220e89dd`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:37:40,162::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:37:40,163::task::993::Storage.TaskManager.Task::(_decref) Task=`533bd43f-e8ee-478b-bbd1-f7a8220e89dd`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:37:40,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:40,171::__init__::225::IOProcess::(_processLogs) (273218) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:40,175::__init__::225::IOProcess::(_processLogs) (273218) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:40,177::__init__::225::IOProcess::(_processLogs) (273218) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:40,181::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:40,264::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:37:40,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0816195 s, 12.5 MB/s\n'; <rc> = 0 >Thread-6940::INFO::2014-07-08 16:37:40,301::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:40,301::task::1191::Storage.TaskManager.Task::(prepare) Task=`533bd43f-e8ee-478b-bbd1-f7a8220e89dd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:40,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`533bd43f-e8ee-478b-bbd1-f7a8220e89dd`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:37:40,302::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:37:40,302::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:37:40,303::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:37:40,303::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:37:40,303::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:37:40,303::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:37:40,304::task::993::Storage.TaskManager.Task::(_decref) Task=`533bd43f-e8ee-478b-bbd1-f7a8220e89dd`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:37:42,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:42,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392747 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:44,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:44,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173523 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:46,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:47,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173222 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:49,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:49,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174107 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:37:50,275::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:37:50,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:50,275::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:50,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:50,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:50,276::__init__::225::IOProcess::(_processLogs) (273219) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:37:50,276::__init__::225::IOProcess::(_processLogs) (273219) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:50,277::__init__::225::IOProcess::(_processLogs) (273219) Building response >Thread-18::DEBUG::2014-07-08 16:37:50,277::__init__::225::IOProcess::(_processLogs) (273219) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:50,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:50,277::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:37:50,279::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:37:50,433::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:37:50,434::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000702306 s, 658 kB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:37:50,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`2df9a0b8-c3c6-4ede-99f7-389b15a3f724`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:37:50,445::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:37:50,448::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:37:50,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b0afdd8-81c6-4aa4-908a-b200b27a7ac5`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:37:50,452::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:37:50,453::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604531', 'lastCheck': '10.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:37:50,453::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b0afdd8-81c6-4aa4-908a-b200b27a7ac5`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604531', 'lastCheck': '10.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:37:50,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b0afdd8-81c6-4aa4-908a-b200b27a7ac5`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:37:50,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:50,455::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:50,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:50,457::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6941::DEBUG::2014-07-08 16:37:50,456::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:37:50,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6941::DEBUG::2014-07-08 16:37:50,459::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:37:50,460::__init__::225::IOProcess::(_processLogs) (273220) Finding callback 'statvfs'... >Thread-6941::DEBUG::2014-07-08 16:37:50,460::task::993::Storage.TaskManager.Task::(_decref) Task=`1b0afdd8-81c6-4aa4-908a-b200b27a7ac5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:37:50,461::__init__::225::IOProcess::(_processLogs) (273220) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:37:50,463::__init__::225::IOProcess::(_processLogs) (273220) Queuing response >Thread-6939::INFO::2014-07-08 16:37:50,465::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:37:50,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6939::DEBUG::2014-07-08 16:37:50,470::task::1191::Storage.TaskManager.Task::(prepare) Task=`2df9a0b8-c3c6-4ede-99f7-389b15a3f724`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:37:50,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`2df9a0b8-c3c6-4ede-99f7-389b15a3f724`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:37:50,474::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6939::DEBUG::2014-07-08 16:37:50,476::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:37:50,479::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:37:50,482::task::993::Storage.TaskManager.Task::(_decref) Task=`2df9a0b8-c3c6-4ede-99f7-389b15a3f724`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:37:50,492::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:37:50,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:50,495::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:50,496::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:50,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:50,498::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:50,499::__init__::225::IOProcess::(_processLogs) (273221) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:50,501::__init__::225::IOProcess::(_processLogs) (273221) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:50,504::__init__::225::IOProcess::(_processLogs) (273221) Building response >Thread-6940::DEBUG::2014-07-08 16:37:50,505::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:37:50,507::__init__::225::IOProcess::(_processLogs) (273221) Queuing response >Thread-6940::DEBUG::2014-07-08 16:37:50,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`89cf027f-ed91-4f1d-9530-b814c76d9fc7`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:37:50,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::INFO::2014-07-08 16:37:50,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:37:50,515::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:37:50,520::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`970814a5-5358-42fb-8a0a-8963ba543d2b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:37:50,522::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:37:50,526::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:37:50,528::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`970814a5-5358-42fb-8a0a-8963ba543d2b`::Granted request >Thread-18::DEBUG::2014-07-08 16:37:50,530::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:37:50,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:37:50,536::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`89cf027f-ed91-4f1d-9530-b814c76d9fc7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:37:50,538::task::993::Storage.TaskManager.Task::(_decref) Task=`89cf027f-ed91-4f1d-9530-b814c76d9fc7`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:37:50,538::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:50,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:50,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:50,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:50,546::__init__::225::IOProcess::(_processLogs) (273222) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:50,548::__init__::225::IOProcess::(_processLogs) (273222) Building response >Thread-18::DEBUG::2014-07-08 16:37:50,549::__init__::225::IOProcess::(_processLogs) (273222) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:50,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:50,554::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:37:50,557::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:37:50,558::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:37:50,558::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:37:50,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:37:50,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:37:50,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:37:50,563::__init__::225::IOProcess::(_processLogs) (273223) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:37:50,564::__init__::225::IOProcess::(_processLogs) (273223) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:37:50,564::__init__::225::IOProcess::(_processLogs) DEBUG|(273223) Building response >Thread-18::DEBUG::2014-07-08 16:37:50,564::__init__::225::IOProcess::(_processLogs) (273223) Queuing response >Thread-18::DEBUG::2014-07-08 16:37:50,564::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:37:50,565::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::INFO::2014-07-08 16:37:50,571::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:50,572::task::1191::Storage.TaskManager.Task::(prepare) Task=`89cf027f-ed91-4f1d-9530-b814c76d9fc7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:37:50,572::task::595::Storage.TaskManager.Task::(_updateState) Task=`89cf027f-ed91-4f1d-9530-b814c76d9fc7`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:37:50,572::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:37:50,572::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:37:50,573::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:37:50,573::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:37:50,573::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:37:50,574::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:37:50,574::task::993::Storage.TaskManager.Task::(_decref) Task=`89cf027f-ed91-4f1d-9530-b814c76d9fc7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:37:51,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:51,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0191374 s, 53.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:53,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:53,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172512 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:55,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:56,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017128 s, 59.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:37:58,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:37:58,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174043 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:00,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:38:00,672::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:38:00,674::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:00,679::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:38:00,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcbef22d-6495-480b-ac7b-52efc9f361c0`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:38:00,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6941::INFO::2014-07-08 16:38:00,684::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:38:00,687::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:00,689::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:00,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:00,693::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:00,694::__init__::225::IOProcess::(_processLogs) (273224) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:00,696::__init__::225::IOProcess::(_processLogs) (273224) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:00,697::__init__::225::IOProcess::(_processLogs) (273224) Building response >Thread-18::DEBUG::2014-07-08 16:38:00,698::__init__::225::IOProcess::(_processLogs) (273224) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:00,700::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:00,702::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6941::INFO::2014-07-08 16:38:00,704::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:38:00,708::task::1191::Storage.TaskManager.Task::(prepare) Task=`fcbef22d-6495-480b-ac7b-52efc9f361c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:38:00,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcbef22d-6495-480b-ac7b-52efc9f361c0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:38:00,714::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:38:00,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-08 16:38:00,717::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:38:00,871::task::993::Storage.TaskManager.Task::(_decref) Task=`fcbef22d-6495-480b-ac7b-52efc9f361c0`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 16:38:00,886::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00058358 s, 792 kB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:00,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.230791 s, 4.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:38:00,983::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6940::DEBUG::2014-07-08 16:38:00,984::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:38:00,990::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6940::DEBUG::2014-07-08 16:38:00,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`09345f47-457b-4f79-8f37-bddcbf3ed6a2`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:38:01,000::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:38:01,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:01,008::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:01,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:38:01,018::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`76aaa954-65ff-4d77-8e42-0c12c47eeedb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:38:01,022::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:38:01,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:01,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:38:01,029::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:38:01,034::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`76aaa954-65ff-4d77-8e42-0c12c47eeedb`::Granted request >Thread-18::DEBUG::2014-07-08 16:38:01,034::__init__::225::IOProcess::(_processLogs) (273225) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:01,042::__init__::225::IOProcess::(_processLogs) (273225) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:01,047::__init__::225::IOProcess::(_processLogs) DEBUG|(273225) Building response >Thread-6940::DEBUG::2014-07-08 16:38:01,048::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`09345f47-457b-4f79-8f37-bddcbf3ed6a2`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:38:01,054::__init__::225::IOProcess::(_processLogs) (273225) Queuing response >Thread-6940::DEBUG::2014-07-08 16:38:01,054::task::993::Storage.TaskManager.Task::(_decref) Task=`09345f47-457b-4f79-8f37-bddcbf3ed6a2`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:38:01,060::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:01,066::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:38:01,096::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:01,099::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:38:01,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:01,103::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:01,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:01,110::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:01,113::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:01,114::__init__::225::IOProcess::(_processLogs) (273226) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:01,118::__init__::225::IOProcess::(_processLogs) (273226) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:01,119::__init__::225::IOProcess::(_processLogs) DEBUG|(273226) Building response >Thread-18::DEBUG::2014-07-08 16:38:01,120::__init__::225::IOProcess::(_processLogs) (273226) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:01,122::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:01,123::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:01,127::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:01,128::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:38:01,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:01,131::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:01,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:01,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:01,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::INFO::2014-07-08 16:38:01,137::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:38:01,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`09345f47-457b-4f79-8f37-bddcbf3ed6a2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:38:01,138::__init__::225::IOProcess::(_processLogs) (273227) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:38:01,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`09345f47-457b-4f79-8f37-bddcbf3ed6a2`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:38:01,141::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:38:01,141::__init__::225::IOProcess::(_processLogs) (273227) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:38:01,142::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:38:01,143::__init__::225::IOProcess::(_processLogs) (273227) Building response >Thread-6940::DEBUG::2014-07-08 16:38:01,144::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:38:01,144::__init__::225::IOProcess::(_processLogs) (273227) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:01,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:01,147::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:38:01,147::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:38:01,149::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:38:01,150::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:38:01,153::task::993::Storage.TaskManager.Task::(_decref) Task=`09345f47-457b-4f79-8f37-bddcbf3ed6a2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:38:01,154::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:01,155::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:38:01,157::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:01,159::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:01,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:01,161::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:01,162::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:01,163::__init__::225::IOProcess::(_processLogs) (273228) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:01,164::__init__::225::IOProcess::(_processLogs) (273228) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:01,165::__init__::225::IOProcess::(_processLogs) (273228) Building response >Thread-18::DEBUG::2014-07-08 16:38:01,166::__init__::225::IOProcess::(_processLogs) (273228) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:01,167::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:01,169::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:38:03,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:03,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018039 s, 56.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:05,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:05,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173054 s, 59.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:38:05,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ac47eaa-d24f-488d-9aac-2d830da8ea37`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:38:05,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:38:05,750::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058358', 'lastCheck': '4.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:38:05,751::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ac47eaa-d24f-488d-9aac-2d830da8ea37`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058358', 'lastCheck': '4.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:38:05,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ac47eaa-d24f-488d-9aac-2d830da8ea37`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:38:05,753::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:38:05,753::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:38:05,754::task::993::Storage.TaskManager.Task::(_decref) Task=`4ac47eaa-d24f-488d-9aac-2d830da8ea37`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:38:07,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:08,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173518 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:10,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:10,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174308 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:38:11,173::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:38:11,176::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:38:11,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`712d22ba-50da-468d-b980-b7d3cc3d5de1`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:38:11,179::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::INFO::2014-07-08 16:38:11,180::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:38:11,180::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:11,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:11,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:11,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:11,183::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:11,183::__init__::225::IOProcess::(_processLogs) (273229) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:11,183::__init__::225::IOProcess::(_processLogs) (273229) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:11,184::__init__::225::IOProcess::(_processLogs) (273229) Building response >Thread-18::DEBUG::2014-07-08 16:38:11,184::__init__::225::IOProcess::(_processLogs) (273229) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:11,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:11,184::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:38:11,186::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6941::INFO::2014-07-08 16:38:11,332::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:38:11,342::task::1191::Storage.TaskManager.Task::(prepare) Task=`712d22ba-50da-468d-b980-b7d3cc3d5de1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:38:11,344::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000604811 s, 764 kB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:38:11,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`712d22ba-50da-468d-b980-b7d3cc3d5de1`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:38:11,353::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:38:11,359::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6941::DEBUG::2014-07-08 16:38:11,359::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:38:11,364::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6941::DEBUG::2014-07-08 16:38:11,365::task::993::Storage.TaskManager.Task::(_decref) Task=`712d22ba-50da-468d-b980-b7d3cc3d5de1`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:38:11,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:11,375::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:11,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:11,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:11,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:11,396::__init__::225::IOProcess::(_processLogs) (273230) Finding callback 'statvfs'... >Thread-6940::DEBUG::2014-07-08 16:38:11,399::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:38:11,404::__init__::225::IOProcess::(_processLogs) (273230) Got request for method 'statvfs' >Thread-6940::DEBUG::2014-07-08 16:38:11,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`11a237b1-9be9-4270-9ad1-4bf0f38410e4`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:38:11,416::__init__::225::IOProcess::(_processLogs) (273230) Building response >Thread-18::DEBUG::2014-07-08 16:38:11,422::__init__::225::IOProcess::(_processLogs) (273230) Queuing response >Thread-6940::INFO::2014-07-08 16:38:11,423::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:38:11,429::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:38:11,437::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6940::DEBUG::2014-07-08 16:38:11,439::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ae61a05c-a453-43a4-a92a-f8f5b975afc6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:38:11,446::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:38:11,455::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:38:11,460::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ae61a05c-a453-43a4-a92a-f8f5b975afc6`::Granted request >Thread-18::DEBUG::2014-07-08 16:38:11,472::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6940::DEBUG::2014-07-08 16:38:11,473::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`11a237b1-9be9-4270-9ad1-4bf0f38410e4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:38:11,475::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-6940::DEBUG::2014-07-08 16:38:11,475::task::993::Storage.TaskManager.Task::(_decref) Task=`11a237b1-9be9-4270-9ad1-4bf0f38410e4`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:38:11,478::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:11,483::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:11,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:11,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:11,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:11,496::__init__::225::IOProcess::(_processLogs) (273231) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:11,499::__init__::225::IOProcess::(_processLogs) (273231) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:11,502::__init__::225::IOProcess::(_processLogs) (273231) Building response >Thread-18::DEBUG::2014-07-08 16:38:11,507::__init__::225::IOProcess::(_processLogs) (273231) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:11,508::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:11,510::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:11,515::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:11,517::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:38:11,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:11,520::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:11,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::INFO::2014-07-08 16:38:11,523::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:38:11,524::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:38:11,527::task::1191::Storage.TaskManager.Task::(prepare) Task=`11a237b1-9be9-4270-9ad1-4bf0f38410e4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:38:11,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:38:11,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`11a237b1-9be9-4270-9ad1-4bf0f38410e4`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:38:11,531::__init__::225::IOProcess::(_processLogs) (273232) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:38:11,531::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:38:11,534::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:38:11,535::__init__::225::IOProcess::(_processLogs) (273232) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:38:11,539::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:38:11,539::__init__::225::IOProcess::(_processLogs) DEBUG|(273232) Building response >Thread-6940::DEBUG::2014-07-08 16:38:11,542::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:38:11,543::__init__::225::IOProcess::(_processLogs) (273232) Queuing response >Thread-6940::DEBUG::2014-07-08 16:38:11,544::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:38:11,547::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:38:11,548::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:38:11,550::task::993::Storage.TaskManager.Task::(_decref) Task=`11a237b1-9be9-4270-9ad1-4bf0f38410e4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:38:11,551::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:11,562::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:11,563::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:38:11,564::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:11,566::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:11,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:11,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:11,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:11,571::__init__::225::IOProcess::(_processLogs) (273233) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:11,572::__init__::225::IOProcess::(_processLogs) (273233) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:11,573::__init__::225::IOProcess::(_processLogs) (273233) Building response >Thread-18::DEBUG::2014-07-08 16:38:11,574::__init__::225::IOProcess::(_processLogs) (273233) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:11,576::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:11,577::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:38:12,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:12,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174881 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:14,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:14,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0962517 s, 10.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:16,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:17,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179312 s, 57.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:19,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:19,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175644 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:38:20,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`c29cedd0-1a07-4450-bbc9-a2558c8207e2`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:38:20,975::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:38:20,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604811', 'lastCheck': '9.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:38:20,976::task::1191::Storage.TaskManager.Task::(prepare) Task=`c29cedd0-1a07-4450-bbc9-a2558c8207e2`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604811', 'lastCheck': '9.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:38:20,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`c29cedd0-1a07-4450-bbc9-a2558c8207e2`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:38:20,976::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:38:20,976::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:38:20,977::task::993::Storage.TaskManager.Task::(_decref) Task=`c29cedd0-1a07-4450-bbc9-a2558c8207e2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:38:21,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:38:21,698::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:38:21,697::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:38:21,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:21,714::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6941::DEBUG::2014-07-08 16:38:21,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`f057211a-cff5-4776-8353-514424a45295`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:38:21,722::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6941::INFO::2014-07-08 16:38:21,728::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:38:21,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:21,738::__init__::225::IOProcess::(_processLogs) (273234) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:21,748::__init__::225::IOProcess::(_processLogs) (273234) Got request for method 'statvfs' >Thread-6941::INFO::2014-07-08 16:38:21,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:38:21,751::__init__::225::IOProcess::(_processLogs) (273234) Building response >Thread-18::DEBUG::2014-07-08 16:38:21,760::__init__::225::IOProcess::(_processLogs) (273234) Queuing response >Thread-6941::DEBUG::2014-07-08 16:38:21,760::task::1191::Storage.TaskManager.Task::(prepare) Task=`f057211a-cff5-4776-8353-514424a45295`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:38:21,767::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6941::DEBUG::2014-07-08 16:38:21,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`f057211a-cff5-4776-8353-514424a45295`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:38:21,776::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6941::DEBUG::2014-07-08 16:38:21,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:38:21,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:38:21,801::task::993::Storage.TaskManager.Task::(_decref) Task=`f057211a-cff5-4776-8353-514424a45295`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 16:38:21,810::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:38:21,981::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000746445 s, 619 kB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:38:21,996::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:38:22,003::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6940::DEBUG::2014-07-08 16:38:22,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`d179a2b5-5771-41b6-87de-15ea518b2c6e`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:38:22,016::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:38:22,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:22,032::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:38:22,038::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e4ade00a-31ca-43ca-9867-d969adac0ad5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:38:22,043::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:38:22,043::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:38:22,055::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:38:22,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:38:22,141::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e4ade00a-31ca-43ca-9867-d969adac0ad5`::Granted request >Thread-18::DEBUG::2014-07-08 16:38:22,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 16:38:22,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.378553 s, 2.7 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:38:22,152::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d179a2b5-5771-41b6-87de-15ea518b2c6e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:38:22,155::__init__::225::IOProcess::(_processLogs) (273235) Finding callback 'statvfs'... >Thread-6940::DEBUG::2014-07-08 16:38:22,158::task::993::Storage.TaskManager.Task::(_decref) Task=`d179a2b5-5771-41b6-87de-15ea518b2c6e`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:38:22,164::__init__::225::IOProcess::(_processLogs) (273235) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:22,171::__init__::225::IOProcess::(_processLogs) (273235) Building response >Thread-18::DEBUG::2014-07-08 16:38:22,175::__init__::225::IOProcess::(_processLogs) (273235) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:22,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:22,184::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:38:22,207::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:38:22,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:22,219::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:22,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:22,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:22,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:22,226::__init__::225::IOProcess::(_processLogs) (273236) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:22,227::__init__::225::IOProcess::(_processLogs) (273236) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:22,229::__init__::225::IOProcess::(_processLogs) (273236) Building response >Thread-6940::INFO::2014-07-08 16:38:22,233::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:38:22,236::__init__::225::IOProcess::(_processLogs) (273236) Queuing response >Thread-6940::DEBUG::2014-07-08 16:38:22,237::task::1191::Storage.TaskManager.Task::(prepare) Task=`d179a2b5-5771-41b6-87de-15ea518b2c6e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:38:22,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`d179a2b5-5771-41b6-87de-15ea518b2c6e`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:38:22,245::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:38:22,247::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:38:22,250::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:38:22,257::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:38:22,261::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-6940::DEBUG::2014-07-08 16:38:22,263::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:38:22,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:38:22,266::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:38:22,269::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:38:22,270::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:38:22,275::task::993::Storage.TaskManager.Task::(_decref) Task=`d179a2b5-5771-41b6-87de-15ea518b2c6e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:38:22,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:22,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:22,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:22,292::__init__::225::IOProcess::(_processLogs) (273237) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:22,294::__init__::225::IOProcess::(_processLogs) (273237) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:22,296::__init__::225::IOProcess::(_processLogs) (273237) Building response >Thread-18::DEBUG::2014-07-08 16:38:22,299::__init__::225::IOProcess::(_processLogs) (273237) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:22,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:22,306::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:22,314::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:38:22,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:22,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:22,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:22,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:22,328::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:22,330::__init__::225::IOProcess::(_processLogs) (273238) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:22,333::__init__::225::IOProcess::(_processLogs) (273238) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:22,335::__init__::225::IOProcess::(_processLogs) (273238) Building response >Thread-18::DEBUG::2014-07-08 16:38:22,337::__init__::225::IOProcess::(_processLogs) (273238) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:22,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:22,341::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:38:24,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:24,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174607 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:26,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:27,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175275 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:29,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:29,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177116 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:31,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:31,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188435 s, 54.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:38:32,303::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:38:32,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`be99fe03-dec8-41c8-8906-55ab11835624`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:38:32,305::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:38:32,320::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:38:32,321::task::1191::Storage.TaskManager.Task::(prepare) Task=`be99fe03-dec8-41c8-8906-55ab11835624`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:38:32,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`be99fe03-dec8-41c8-8906-55ab11835624`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:38:32,321::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:38:32,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:38:32,322::task::993::Storage.TaskManager.Task::(_decref) Task=`be99fe03-dec8-41c8-8906-55ab11835624`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:38:32,333::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:38:32,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`9723ea9f-0327-4262-93e6-84892fe7a630`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:38:32,335::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:38:32,336::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4900dfbb-4dfe-4b66-84cc-857c9754cb60`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:38:32,336::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:38:32,337::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:38:32,337::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4900dfbb-4dfe-4b66-84cc-857c9754cb60`::Granted request >Thread-6940::DEBUG::2014-07-08 16:38:32,338::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9723ea9f-0327-4262-93e6-84892fe7a630`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:38:32,338::task::993::Storage.TaskManager.Task::(_decref) Task=`9723ea9f-0327-4262-93e6-84892fe7a630`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:38:32,349::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:32,349::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:38:32,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:32,350::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:32,350::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:32,350::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:32,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:32,351::__init__::225::IOProcess::(_processLogs) (273239) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:32,351::__init__::225::IOProcess::(_processLogs) (273239) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:32,356::__init__::225::IOProcess::(_processLogs) (273239) Queuing response >Thread-6940::INFO::2014-07-08 16:38:32,357::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:38:32,358::task::1191::Storage.TaskManager.Task::(prepare) Task=`9723ea9f-0327-4262-93e6-84892fe7a630`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:38:32,358::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:38:32,359::task::595::Storage.TaskManager.Task::(_updateState) Task=`9723ea9f-0327-4262-93e6-84892fe7a630`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:38:32,360::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:38:32,360::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6940::DEBUG::2014-07-08 16:38:32,361::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:38:32,364::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:38:32,365::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:38:32,366::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:38:32,367::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-37::DEBUG::2014-07-08 16:38:32,369::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6940::DEBUG::2014-07-08 16:38:32,370::task::993::Storage.TaskManager.Task::(_decref) Task=`9723ea9f-0327-4262-93e6-84892fe7a630`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 16:38:32,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000576036 s, 802 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:38:32,539::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:38:32,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:32,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:32,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:32,546::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:32,548::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:32,549::__init__::225::IOProcess::(_processLogs) (273240) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:32,551::__init__::225::IOProcess::(_processLogs) (273240) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:32,552::__init__::225::IOProcess::(_processLogs) (273240) Building response >Thread-18::DEBUG::2014-07-08 16:38:32,554::__init__::225::IOProcess::(_processLogs) (273240) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:32,555::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:32,557::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:38:32,566::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:38:32,568::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:32,570::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:32,572::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:32,573::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:32,574::__init__::225::IOProcess::(_processLogs) (273241) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:32,575::__init__::225::IOProcess::(_processLogs) (273241) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:32,577::__init__::225::IOProcess::(_processLogs) (273241) Building response >Thread-18::DEBUG::2014-07-08 16:38:32,578::__init__::225::IOProcess::(_processLogs) (273241) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:32,580::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:32,581::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:32,586::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:38:32,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:32,589::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:32,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:32,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:32,594::__init__::225::IOProcess::(_processLogs) (273242) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:32,596::__init__::225::IOProcess::(_processLogs) (273242) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:32,598::__init__::225::IOProcess::(_processLogs) (273242) Building response >Thread-18::DEBUG::2014-07-08 16:38:32,599::__init__::225::IOProcess::(_processLogs) (273242) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:32,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:32,603::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:32,608::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:38:32,610::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:32,612::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:32,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:32,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:32,616::__init__::225::IOProcess::(_processLogs) (273243) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:32,619::__init__::225::IOProcess::(_processLogs) (273243) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:32,620::__init__::225::IOProcess::(_processLogs) (273243) Building response >Thread-18::DEBUG::2014-07-08 16:38:32,622::__init__::225::IOProcess::(_processLogs) (273243) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:32,623::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:32,625::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:38:33,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:33,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0228839 s, 44.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:35,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:36,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172316 s, 59.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:38:36,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`14b04c38-1a6d-42c4-aba0-301aa23b1a54`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:38:36,138::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:38:36,138::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576036', 'lastCheck': '3.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:38:36,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`14b04c38-1a6d-42c4-aba0-301aa23b1a54`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576036', 'lastCheck': '3.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:38:36,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`14b04c38-1a6d-42c4-aba0-301aa23b1a54`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:38:36,139::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:38:36,139::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:38:36,139::task::993::Storage.TaskManager.Task::(_decref) Task=`14b04c38-1a6d-42c4-aba0-301aa23b1a54`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:38:38,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:38,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175035 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:40,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:40,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174923 s, 58.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:38:42,549::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:38:42,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`607cd906-3821-4bc1-a856-da7b979f42eb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:38:42,551::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:38:42,566::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:38:42,567::task::1191::Storage.TaskManager.Task::(prepare) Task=`607cd906-3821-4bc1-a856-da7b979f42eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:38:42,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`607cd906-3821-4bc1-a856-da7b979f42eb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:38:42,567::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:38:42,567::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:38:42,568::task::993::Storage.TaskManager.Task::(_decref) Task=`607cd906-3821-4bc1-a856-da7b979f42eb`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:38:42,580::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:38:42,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a0e1ee3-f2b4-45f9-b179-3968ec731454`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:38:42,581::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:38:42,582::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4fd79eb8-b2a1-4b90-85a1-0f97e2df8a52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:38:42,582::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:38:42,583::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:38:42,583::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4fd79eb8-b2a1-4b90-85a1-0f97e2df8a52`::Granted request >Thread-6940::DEBUG::2014-07-08 16:38:42,584::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7a0e1ee3-f2b4-45f9-b179-3968ec731454`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:38:42,584::task::993::Storage.TaskManager.Task::(_decref) Task=`7a0e1ee3-f2b4-45f9-b179-3968ec731454`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:38:42,603::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:38:42,605::task::1191::Storage.TaskManager.Task::(prepare) Task=`7a0e1ee3-f2b4-45f9-b179-3968ec731454`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:38:42,606::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a0e1ee3-f2b4-45f9-b179-3968ec731454`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:38:42,606::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:38:42,607::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:38:42,608::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:38:42,610::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:38:42,611::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:38:42,612::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:38:42,613::task::993::Storage.TaskManager.Task::(_decref) Task=`7a0e1ee3-f2b4-45f9-b179-3968ec731454`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:38:42,635::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:38:42,635::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:42,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:42,636::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:42,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:42,636::__init__::225::IOProcess::(_processLogs) (273244) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:42,636::__init__::225::IOProcess::(_processLogs) (273244) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:42,637::__init__::225::IOProcess::(_processLogs) (273244) Building response >Thread-18::DEBUG::2014-07-08 16:38:42,637::__init__::225::IOProcess::(_processLogs) (273244) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:42,637::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-37::DEBUG::2014-07-08 16:38:42,639::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:38:42,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000788627 s, 586 kB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:42,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:38:42,962::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:38:42,965::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:42,966::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:42,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:42,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:42,977::__init__::225::IOProcess::(_processLogs) (273245) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:42,981::__init__::225::IOProcess::(_processLogs) (273245) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:42,984::__init__::225::IOProcess::(_processLogs) (273245) Building response >Thread-18::DEBUG::2014-07-08 16:38:42,988::__init__::225::IOProcess::(_processLogs) (273245) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:42,991::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:42,994::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:38:43,013::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:38:43,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:43,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:43,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:43,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:43,030::__init__::225::IOProcess::(_processLogs) (273246) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:43,115::__init__::225::IOProcess::(_processLogs) (273246) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:43,118::__init__::225::IOProcess::(_processLogs) (273246) Building response >Dummy-6860::DEBUG::2014-07-08 16:38:43,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0724839 s, 14.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:38:43,120::__init__::225::IOProcess::(_processLogs) (273246) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:43,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:43,125::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:43,132::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:38:43,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:43,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:43,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:43,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:43,146::__init__::225::IOProcess::(_processLogs) (273247) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:43,148::__init__::225::IOProcess::(_processLogs) (273247) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:43,150::__init__::225::IOProcess::(_processLogs) (273247) Building response >Thread-18::DEBUG::2014-07-08 16:38:43,152::__init__::225::IOProcess::(_processLogs) (273247) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:43,153::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:43,155::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:43,164::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:38:43,168::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:43,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:43,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:43,175::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:43,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:43,180::__init__::225::IOProcess::(_processLogs) (273248) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:43,182::__init__::225::IOProcess::(_processLogs) (273248) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:43,184::__init__::225::IOProcess::(_processLogs) (273248) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:43,186::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:43,189::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:38:45,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:45,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175613 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:47,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:47,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173224 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:49,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:50,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173194 s, 59.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:38:51,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`7eb672d4-45a7-41d3-926a-2f2cfdfb6750`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:38:51,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:38:51,315::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788627', 'lastCheck': '8.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:38:51,315::task::1191::Storage.TaskManager.Task::(prepare) Task=`7eb672d4-45a7-41d3-926a-2f2cfdfb6750`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788627', 'lastCheck': '8.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:38:51,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`7eb672d4-45a7-41d3-926a-2f2cfdfb6750`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:38:51,315::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:38:51,316::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:38:51,316::task::993::Storage.TaskManager.Task::(_decref) Task=`7eb672d4-45a7-41d3-926a-2f2cfdfb6750`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:38:52,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:52,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176046 s, 58.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:38:52,629::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:38:52,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`4db85ccb-8cf3-4afb-995a-54bd8dbac72c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:38:52,631::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:38:52,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:38:52,646::task::1191::Storage.TaskManager.Task::(prepare) Task=`4db85ccb-8cf3-4afb-995a-54bd8dbac72c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:38:52,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`4db85ccb-8cf3-4afb-995a-54bd8dbac72c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:38:52,647::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:38:52,647::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:38:52,647::task::993::Storage.TaskManager.Task::(_decref) Task=`4db85ccb-8cf3-4afb-995a-54bd8dbac72c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:38:52,658::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:38:52,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e0c11a4-769b-4af0-af7d-2694e0ee8aa8`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:38:52,659::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:38:52,660::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`051474f7-f965-44aa-a945-c9be1ea2bef8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:38:52,661::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:38:52,661::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:38:52,662::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`051474f7-f965-44aa-a945-c9be1ea2bef8`::Granted request >Thread-6940::DEBUG::2014-07-08 16:38:52,662::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7e0c11a4-769b-4af0-af7d-2694e0ee8aa8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:38:52,663::task::993::Storage.TaskManager.Task::(_decref) Task=`7e0c11a4-769b-4af0-af7d-2694e0ee8aa8`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:38:52,681::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:38:52,682::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e0c11a4-769b-4af0-af7d-2694e0ee8aa8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:38:52,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e0c11a4-769b-4af0-af7d-2694e0ee8aa8`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:38:52,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:38:52,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:38:52,683::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:38:52,683::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:38:52,684::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:38:52,684::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:38:52,684::task::993::Storage.TaskManager.Task::(_decref) Task=`7e0c11a4-769b-4af0-af7d-2694e0ee8aa8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:38:53,196::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:38:53,197::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:53,197::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:53,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:53,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:53,198::__init__::225::IOProcess::(_processLogs) (273249) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:53,198::__init__::225::IOProcess::(_processLogs) (273249) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:53,198::__init__::225::IOProcess::(_processLogs) (273249) Building response >Thread-18::DEBUG::2014-07-08 16:38:53,199::__init__::225::IOProcess::(_processLogs) (273249) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:53,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:53,199::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:38:53,201::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:38:53,350::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000472673 s, 977 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:38:53,352::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:38:53,352::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:53,353::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:53,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:53,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:53,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:53,354::__init__::225::IOProcess::(_processLogs) (273250) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:38:53,354::__init__::225::IOProcess::(_processLogs) (273250) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:38:53,354::__init__::225::IOProcess::(_processLogs) (273250) Building response >Thread-18::DEBUG::2014-07-08 16:38:53,354::__init__::225::IOProcess::(_processLogs) (273250) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:53,355::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:53,355::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:38:53,357::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:53,357::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:38:53,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:53,358::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:53,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:53,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:53,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:53,359::__init__::225::IOProcess::(_processLogs) (273251) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:53,359::__init__::225::IOProcess::(_processLogs) (273251) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:53,359::__init__::225::IOProcess::(_processLogs) (273251) Building response >Thread-18::DEBUG::2014-07-08 16:38:53,360::__init__::225::IOProcess::(_processLogs) (273251) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:53,360::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:53,360::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:53,361::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:53,362::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:38:53,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:53,362::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:53,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:53,363::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:53,363::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:53,365::__init__::225::IOProcess::(_processLogs) (273252) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:53,367::__init__::225::IOProcess::(_processLogs) (273252) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:53,369::__init__::225::IOProcess::(_processLogs) (273252) Building response >Thread-18::DEBUG::2014-07-08 16:38:53,371::__init__::225::IOProcess::(_processLogs) (273252) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:53,372::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:53,373::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:38:53,377::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:38:53,379::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:38:53,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:38:53,382::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:38:53,384::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:38:53,385::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:38:53,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:38:53,388::__init__::225::IOProcess::(_processLogs) (273253) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:38:53,390::__init__::225::IOProcess::(_processLogs) (273253) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:38:53,391::__init__::225::IOProcess::(_processLogs) (273253) Building response >Thread-18::DEBUG::2014-07-08 16:38:53,393::__init__::225::IOProcess::(_processLogs) (273253) Queuing response >Thread-18::DEBUG::2014-07-08 16:38:53,394::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:38:53,396::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:38:54,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:54,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174127 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:56,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:56,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041707 s, 24.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:38:59,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:38:59,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176848 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:01,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:01,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899013 s, 11.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:39:02,697::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:39:02,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa754823-1a52-4e81-baef-5923300c472d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:02,699::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:39:02,715::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:02,715::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa754823-1a52-4e81-baef-5923300c472d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:02,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa754823-1a52-4e81-baef-5923300c472d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:02,716::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:02,716::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:02,716::task::993::Storage.TaskManager.Task::(_decref) Task=`aa754823-1a52-4e81-baef-5923300c472d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:39:02,729::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:39:02,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cb520b6-0b06-48f3-bc77-402e7f2f680b`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:39:02,730::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:39:02,731::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6f80c2c4-fe06-4616-a0ec-495ee14c50a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:39:02,731::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:39:02,732::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:39:02,732::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6f80c2c4-fe06-4616-a0ec-495ee14c50a3`::Granted request >Thread-6940::DEBUG::2014-07-08 16:39:02,733::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8cb520b6-0b06-48f3-bc77-402e7f2f680b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:39:02,733::task::993::Storage.TaskManager.Task::(_decref) Task=`8cb520b6-0b06-48f3-bc77-402e7f2f680b`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:39:02,752::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:02,753::task::1191::Storage.TaskManager.Task::(prepare) Task=`8cb520b6-0b06-48f3-bc77-402e7f2f680b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:02,753::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cb520b6-0b06-48f3-bc77-402e7f2f680b`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:39:02,753::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:39:02,754::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:39:02,754::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:39:02,754::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:39:02,755::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:39:02,755::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:39:02,755::task::993::Storage.TaskManager.Task::(_decref) Task=`8cb520b6-0b06-48f3-bc77-402e7f2f680b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:39:03,401::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:03,402::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:03,402::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:03,402::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:03,402::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:03,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:03,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:03,403::__init__::225::IOProcess::(_processLogs) (273254) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:03,403::__init__::225::IOProcess::(_processLogs) (273254) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:03,404::__init__::225::IOProcess::(_processLogs) (273254) Building response >Thread-18::DEBUG::2014-07-08 16:39:03,404::__init__::225::IOProcess::(_processLogs) (273254) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:03,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:03,404::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:39:03,406::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:39:03,563::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000488877 s, 945 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:39:03,579::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:03,582::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:03,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:03,586::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:03,587::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:03,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:03,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:03,593::__init__::225::IOProcess::(_processLogs) (273255) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:03,595::__init__::225::IOProcess::(_processLogs) (273255) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:03,596::__init__::225::IOProcess::(_processLogs) (273255) Building response >Thread-18::DEBUG::2014-07-08 16:39:03,597::__init__::225::IOProcess::(_processLogs) (273255) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:03,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:03,601::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:39:03,614::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:03,616::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:39:03,618::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:03,619::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:03,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:03,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:03,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:03,625::__init__::225::IOProcess::(_processLogs) (273256) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:03,627::__init__::225::IOProcess::(_processLogs) (273256) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:03,629::__init__::225::IOProcess::(_processLogs) (273256) Building response >Thread-18::DEBUG::2014-07-08 16:39:03,630::__init__::225::IOProcess::(_processLogs) (273256) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:03,632::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:03,634::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:03,640::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:03,641::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:39:03,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:03,644::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:03,646::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:03,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:03,649::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:03,651::__init__::225::IOProcess::(_processLogs) (273257) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:03,652::__init__::225::IOProcess::(_processLogs) (273257) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:03,653::__init__::225::IOProcess::(_processLogs) (273257) Building response >Thread-18::DEBUG::2014-07-08 16:39:03,655::__init__::225::IOProcess::(_processLogs) (273257) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:03,657::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:03,658::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:03,663::__init__::225::IOProcess::(_processLogs) (273257) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:03,665::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:39:03,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:03,668::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:03,669::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:03,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:03,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:03,674::__init__::225::IOProcess::(_processLogs) (273258) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:03,676::__init__::225::IOProcess::(_processLogs) (273258) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:03,678::__init__::225::IOProcess::(_processLogs) (273258) Building response >Thread-18::DEBUG::2014-07-08 16:39:03,679::__init__::225::IOProcess::(_processLogs) (273258) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:03,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:03,682::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:39:03,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:03,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358819 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:06,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:06,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301863 s, 33.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:39:06,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`878fb1cc-5b4e-4ae0-968b-7199876382b1`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:06,597::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:39:06,598::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488877', 'lastCheck': '2.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:39:06,600::task::1191::Storage.TaskManager.Task::(prepare) Task=`878fb1cc-5b4e-4ae0-968b-7199876382b1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488877', 'lastCheck': '2.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:39:06,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`878fb1cc-5b4e-4ae0-968b-7199876382b1`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:06,677::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:06,681::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:06,682::task::993::Storage.TaskManager.Task::(_decref) Task=`878fb1cc-5b4e-4ae0-968b-7199876382b1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:39:08,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:08,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174585 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:10,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:10,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017416 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:39:12,771::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:39:12,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e4df75d-007f-4ef9-aa9f-47fbe023a119`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:12,772::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:39:12,787::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:12,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e4df75d-007f-4ef9-aa9f-47fbe023a119`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:12,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e4df75d-007f-4ef9-aa9f-47fbe023a119`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:12,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:12,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:12,789::task::993::Storage.TaskManager.Task::(_decref) Task=`2e4df75d-007f-4ef9-aa9f-47fbe023a119`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:39:12,801::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:39:12,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`fec06f17-a759-4ecd-9a6d-7aa11adf2563`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:39:12,802::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:39:12,803::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b8fa1ad8-1172-4224-8fdd-47939f6d33f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:39:12,804::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:39:12,805::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:39:12,806::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b8fa1ad8-1172-4224-8fdd-47939f6d33f3`::Granted request >Thread-6940::DEBUG::2014-07-08 16:39:12,810::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fec06f17-a759-4ecd-9a6d-7aa11adf2563`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:39:12,811::task::993::Storage.TaskManager.Task::(_decref) Task=`fec06f17-a759-4ecd-9a6d-7aa11adf2563`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:39:12,830::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:12,830::task::1191::Storage.TaskManager.Task::(prepare) Task=`fec06f17-a759-4ecd-9a6d-7aa11adf2563`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:12,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`fec06f17-a759-4ecd-9a6d-7aa11adf2563`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:39:12,831::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:39:12,831::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:39:12,832::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:39:12,832::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:39:12,832::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:39:12,832::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:39:12,833::task::993::Storage.TaskManager.Task::(_decref) Task=`fec06f17-a759-4ecd-9a6d-7aa11adf2563`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:39:12,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:13,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174529 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:39:13,688::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:13,689::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:13,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:13,689::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:13,690::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:13,690::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:13,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:13,690::__init__::225::IOProcess::(_processLogs) (273259) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:13,691::__init__::225::IOProcess::(_processLogs) (273259) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:13,691::__init__::225::IOProcess::(_processLogs) (273259) Building response >Thread-18::DEBUG::2014-07-08 16:39:13,691::__init__::225::IOProcess::(_processLogs) (273259) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:13,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:13,692::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:39:13,693::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:39:13,839::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000489436 s, 944 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:39:13,841::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:13,842::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:13,842::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:13,842::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:13,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:13,843::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:13,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:13,843::__init__::225::IOProcess::(_processLogs) (273260) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:13,844::__init__::225::IOProcess::(_processLogs) (273260) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:13,844::__init__::225::IOProcess::(_processLogs) (273260) Building response >Thread-18::DEBUG::2014-07-08 16:39:13,844::__init__::225::IOProcess::(_processLogs) (273260) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:13,844::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:13,844::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:39:13,847::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:13,847::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:39:13,847::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:13,848::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:13,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:13,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:13,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:13,849::__init__::225::IOProcess::(_processLogs) (273261) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:13,849::__init__::225::IOProcess::(_processLogs) (273261) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:13,849::__init__::225::IOProcess::(_processLogs) (273261) Building response >Thread-18::DEBUG::2014-07-08 16:39:13,849::__init__::225::IOProcess::(_processLogs) (273261) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:13,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:13,850::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:13,851::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:13,851::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:39:13,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:13,852::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:13,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:13,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:13,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:13,853::__init__::225::IOProcess::(_processLogs) (273262) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:13,853::__init__::225::IOProcess::(_processLogs) (273262) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:13,853::__init__::225::IOProcess::(_processLogs) (273262) Building response >Thread-18::DEBUG::2014-07-08 16:39:13,853::__init__::225::IOProcess::(_processLogs) (273262) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:13,854::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:13,854::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:13,855::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:13,855::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:39:13,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:13,856::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:13,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:13,856::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:13,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:13,857::__init__::225::IOProcess::(_processLogs) (273263) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:13,857::__init__::225::IOProcess::(_processLogs) (273263) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:13,857::__init__::225::IOProcess::(_processLogs) (273263) Building response >Thread-18::DEBUG::2014-07-08 16:39:13,857::__init__::225::IOProcess::(_processLogs) (273263) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:13,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:13,858::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:39:15,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:15,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017597 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:17,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:17,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174568 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:19,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:20,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175222 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:39:21,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d0ba0cc-59e3-4db5-92c1-b0a189f76e55`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:21,894::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:39:21,895::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489436', 'lastCheck': '8.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:39:21,895::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d0ba0cc-59e3-4db5-92c1-b0a189f76e55`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489436', 'lastCheck': '8.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:39:21,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d0ba0cc-59e3-4db5-92c1-b0a189f76e55`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:21,895::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:21,896::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:21,896::task::993::Storage.TaskManager.Task::(_decref) Task=`6d0ba0cc-59e3-4db5-92c1-b0a189f76e55`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:39:22,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:22,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905145 s, 11.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:39:22,846::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:39:22,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfca6fbd-11c2-4e92-983a-4447c40c224f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:22,848::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:39:22,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:22,863::task::1191::Storage.TaskManager.Task::(prepare) Task=`cfca6fbd-11c2-4e92-983a-4447c40c224f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:22,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfca6fbd-11c2-4e92-983a-4447c40c224f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:22,864::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:22,864::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:22,864::task::993::Storage.TaskManager.Task::(_decref) Task=`cfca6fbd-11c2-4e92-983a-4447c40c224f`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:39:22,875::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:39:22,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4d43268-9550-4b4c-9dfa-3a3b15e7e343`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:39:22,877::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:39:22,878::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c54a6bb6-bc58-4bed-a70b-fc8be8c9d2d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:39:22,878::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:39:22,878::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:39:22,879::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c54a6bb6-bc58-4bed-a70b-fc8be8c9d2d7`::Granted request >Thread-6940::DEBUG::2014-07-08 16:39:22,879::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e4d43268-9550-4b4c-9dfa-3a3b15e7e343`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:39:22,880::task::993::Storage.TaskManager.Task::(_decref) Task=`e4d43268-9550-4b4c-9dfa-3a3b15e7e343`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:39:22,899::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:22,899::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4d43268-9550-4b4c-9dfa-3a3b15e7e343`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:22,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4d43268-9550-4b4c-9dfa-3a3b15e7e343`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:39:22,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:39:22,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:39:22,900::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:39:22,901::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:39:22,901::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:39:22,901::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:39:22,901::task::993::Storage.TaskManager.Task::(_decref) Task=`e4d43268-9550-4b4c-9dfa-3a3b15e7e343`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:39:23,860::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:23,861::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:23,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:23,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:23,862::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:23,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:23,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:23,862::__init__::225::IOProcess::(_processLogs) (273264) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:23,863::__init__::225::IOProcess::(_processLogs) (273264) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:23,863::__init__::225::IOProcess::(_processLogs) (273264) Building response >Thread-18::DEBUG::2014-07-08 16:39:23,863::__init__::225::IOProcess::(_processLogs) (273264) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:23,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:23,864::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:39:23,865::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:39:24,014::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000443063 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:39:24,016::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:24,016::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:24,017::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:24,017::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:24,017::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:24,018::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:24,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:24,018::__init__::225::IOProcess::(_processLogs) (273265) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:24,018::__init__::225::IOProcess::(_processLogs) (273265) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:24,019::__init__::225::IOProcess::(_processLogs) (273265) Building response >Thread-18::DEBUG::2014-07-08 16:39:24,019::__init__::225::IOProcess::(_processLogs) (273265) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:24,019::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:24,019::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:39:24,021::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:24,022::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:39:24,022::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:24,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:24,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:24,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:24,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:24,023::__init__::225::IOProcess::(_processLogs) (273266) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:24,024::__init__::225::IOProcess::(_processLogs) (273266) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:24,024::__init__::225::IOProcess::(_processLogs) (273266) Building response >Thread-18::DEBUG::2014-07-08 16:39:24,024::__init__::225::IOProcess::(_processLogs) (273266) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:24,024::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:24,025::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:24,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:24,026::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:39:24,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:24,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:24,027::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:24,027::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:24,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:24,027::__init__::225::IOProcess::(_processLogs) (273267) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:24,028::__init__::225::IOProcess::(_processLogs) (273267) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:24,028::__init__::225::IOProcess::(_processLogs) (273267) Building response >Thread-18::DEBUG::2014-07-08 16:39:24,028::__init__::225::IOProcess::(_processLogs) (273267) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:24,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:24,029::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:24,030::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:24,030::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:39:24,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:24,030::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:24,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:24,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:24,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:24,031::__init__::225::IOProcess::(_processLogs) (273268) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:24,032::__init__::225::IOProcess::(_processLogs) (273268) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:24,032::__init__::225::IOProcess::(_processLogs) (273268) Building response >Thread-18::DEBUG::2014-07-08 16:39:24,032::__init__::225::IOProcess::(_processLogs) (273268) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:24,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:24,033::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:39:24,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:24,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176001 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:26,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:27,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176898 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:29,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:29,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176194 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:31,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:31,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182111 s, 56.2 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:39:32,915::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:39:32,916::task::595::Storage.TaskManager.Task::(_updateState) Task=`15606a6e-7004-4fd4-af66-33a1de71756c`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:32,917::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:39:32,932::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:32,932::task::1191::Storage.TaskManager.Task::(prepare) Task=`15606a6e-7004-4fd4-af66-33a1de71756c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:32,932::task::595::Storage.TaskManager.Task::(_updateState) Task=`15606a6e-7004-4fd4-af66-33a1de71756c`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:32,933::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:32,933::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:32,933::task::993::Storage.TaskManager.Task::(_decref) Task=`15606a6e-7004-4fd4-af66-33a1de71756c`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:39:32,945::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:39:32,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`c01ac704-07cb-4011-a216-ec1d22431757`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:39:32,946::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:39:32,947::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`defbcafc-98f6-4b92-bcaa-cc981dfb9826`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:39:32,948::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:39:32,948::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:39:32,948::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`defbcafc-98f6-4b92-bcaa-cc981dfb9826`::Granted request >Thread-6940::DEBUG::2014-07-08 16:39:32,949::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c01ac704-07cb-4011-a216-ec1d22431757`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:39:32,950::task::993::Storage.TaskManager.Task::(_decref) Task=`c01ac704-07cb-4011-a216-ec1d22431757`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:39:32,969::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:32,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`c01ac704-07cb-4011-a216-ec1d22431757`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:32,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`c01ac704-07cb-4011-a216-ec1d22431757`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:39:32,970::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:39:32,970::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:39:32,970::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:39:32,971::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:39:32,971::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:39:32,971::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:39:32,972::task::993::Storage.TaskManager.Task::(_decref) Task=`c01ac704-07cb-4011-a216-ec1d22431757`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:39:33,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:33,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363313 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:39:34,035::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:34,036::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:34,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:34,036::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:34,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:34,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:34,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:34,038::__init__::225::IOProcess::(_processLogs) (273269) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:34,038::__init__::225::IOProcess::(_processLogs) (273269) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:34,038::__init__::225::IOProcess::(_processLogs) (273269) Building response >Thread-18::DEBUG::2014-07-08 16:39:34,038::__init__::225::IOProcess::(_processLogs) (273269) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:34,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:34,039::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:39:34,041::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:39:34,188::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000650345 s, 710 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:39:34,193::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:34,195::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:34,197::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:34,199::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:34,201::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:34,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:34,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:34,207::__init__::225::IOProcess::(_processLogs) (273270) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:34,209::__init__::225::IOProcess::(_processLogs) (273270) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:34,211::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273270) Building response >Thread-18::DEBUG::2014-07-08 16:39:34,212::__init__::225::IOProcess::(_processLogs) (273270) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:34,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:34,215::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:39:34,224::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:34,225::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:39:34,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:34,228::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:34,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:34,230::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:34,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:34,233::__init__::225::IOProcess::(_processLogs) (273271) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:34,235::__init__::225::IOProcess::(_processLogs) (273271) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:34,236::__init__::225::IOProcess::(_processLogs) (273271) Building response >Thread-18::DEBUG::2014-07-08 16:39:34,237::__init__::225::IOProcess::(_processLogs) (273271) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:34,239::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:34,240::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:34,245::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:34,246::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:39:34,248::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:34,250::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:34,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:34,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:34,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:34,258::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273272) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:34,261::__init__::225::IOProcess::(_processLogs) (273272) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:34,264::__init__::225::IOProcess::(_processLogs) (273272) Building response >Thread-18::DEBUG::2014-07-08 16:39:34,267::__init__::225::IOProcess::(_processLogs) (273272) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:34,270::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:34,272::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:34,281::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:34,286::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:39:34,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:34,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:34,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:34,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:34,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:34,303::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273273) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:34,306::__init__::225::IOProcess::(_processLogs) (273273) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:34,308::__init__::225::IOProcess::(_processLogs) (273273) Building response >Thread-18::DEBUG::2014-07-08 16:39:34,311::__init__::225::IOProcess::(_processLogs) (273273) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:34,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:34,316::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:39:35,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:36,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174269 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:39:37,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`88be8c71-3110-4d87-9700-68ad4a6fdf59`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:37,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:39:37,047::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650345', 'lastCheck': '2.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:39:37,047::task::1191::Storage.TaskManager.Task::(prepare) Task=`88be8c71-3110-4d87-9700-68ad4a6fdf59`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650345', 'lastCheck': '2.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:39:37,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`88be8c71-3110-4d87-9700-68ad4a6fdf59`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:37,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:37,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:37,048::task::993::Storage.TaskManager.Task::(_decref) Task=`88be8c71-3110-4d87-9700-68ad4a6fdf59`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:39:38,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:38,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174074 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:40,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:40,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173657 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:42,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:42,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247802 s, 41.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:39:42,987::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:39:43,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bc01f7a-f665-4d3c-8d21-96a4c34cc9c0`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:43,077::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:39:43,093::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:43,093::task::1191::Storage.TaskManager.Task::(prepare) Task=`8bc01f7a-f665-4d3c-8d21-96a4c34cc9c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:43,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bc01f7a-f665-4d3c-8d21-96a4c34cc9c0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:43,094::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:43,097::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:43,098::task::993::Storage.TaskManager.Task::(_decref) Task=`8bc01f7a-f665-4d3c-8d21-96a4c34cc9c0`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:39:43,113::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:39:43,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad92b528-303e-45f3-b8ec-fcd4ef7eeebe`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:39:43,114::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:39:43,115::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`151a02c8-2ce5-440a-b9db-97a9e147b785`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:39:43,116::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:39:43,116::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:39:43,117::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`151a02c8-2ce5-440a-b9db-97a9e147b785`::Granted request >Thread-6940::DEBUG::2014-07-08 16:39:43,117::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ad92b528-303e-45f3-b8ec-fcd4ef7eeebe`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:39:43,118::task::993::Storage.TaskManager.Task::(_decref) Task=`ad92b528-303e-45f3-b8ec-fcd4ef7eeebe`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:39:43,138::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:43,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad92b528-303e-45f3-b8ec-fcd4ef7eeebe`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:43,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad92b528-303e-45f3-b8ec-fcd4ef7eeebe`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:39:43,139::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:39:43,139::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:39:43,140::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:39:43,140::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:39:43,140::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:39:43,140::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:39:43,141::task::993::Storage.TaskManager.Task::(_decref) Task=`ad92b528-303e-45f3-b8ec-fcd4ef7eeebe`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:39:44,325::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:44,325::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:44,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:44,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:44,326::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:44,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:44,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:44,327::__init__::225::IOProcess::(_processLogs) (273274) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:44,327::__init__::225::IOProcess::(_processLogs) (273274) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:44,327::__init__::225::IOProcess::(_processLogs) (273274) Building response >Thread-18::DEBUG::2014-07-08 16:39:44,328::__init__::225::IOProcess::(_processLogs) (273274) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:44,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:44,328::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:39:44,330::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:39:44,479::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000431608 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:39:44,481::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:44,482::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:44,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:44,482::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:44,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:44,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:44,483::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:44,484::__init__::225::IOProcess::(_processLogs) (273275) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:44,484::__init__::225::IOProcess::(_processLogs) (273275) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:44,484::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273275) Building response >Thread-18::DEBUG::2014-07-08 16:39:44,484::__init__::225::IOProcess::(_processLogs) (273275) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:44,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:44,485::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:39:44,488::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:44,488::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:39:44,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:44,488::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:44,489::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:44,489::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:44,489::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:44,490::__init__::225::IOProcess::(_processLogs) (273276) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:44,490::__init__::225::IOProcess::(_processLogs) (273276) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:44,490::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273276) Building response >Thread-18::DEBUG::2014-07-08 16:39:44,491::__init__::225::IOProcess::(_processLogs) (273276) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:44,491::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:44,491::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:44,492::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:44,492::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:39:44,493::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:44,493::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:44,493::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:44,493::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:44,494::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:44,494::__init__::225::IOProcess::(_processLogs) (273277) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:44,494::__init__::225::IOProcess::(_processLogs) (273277) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:44,495::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273277) Building response >Thread-18::DEBUG::2014-07-08 16:39:44,495::__init__::225::IOProcess::(_processLogs) (273277) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:44,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:44,495::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:44,497::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:44,497::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:39:44,497::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:44,497::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:44,498::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:44,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:44,498::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:44,498::__init__::225::IOProcess::(_processLogs) (273278) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:44,499::__init__::225::IOProcess::(_processLogs) (273278) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:44,499::__init__::225::IOProcess::(_processLogs) (273278) Building response >Thread-18::DEBUG::2014-07-08 16:39:44,499::__init__::225::IOProcess::(_processLogs) (273278) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:44,499::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:44,500::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:39:45,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:45,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175269 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:47,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:47,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176035 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:49,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:49,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176518 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:51,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:52,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316658 s, 32.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:39:52,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`2752a7bb-dc8e-4495-a187-9381739621d2`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:52,206::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:39:52,207::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431608', 'lastCheck': '7.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:39:52,207::task::1191::Storage.TaskManager.Task::(prepare) Task=`2752a7bb-dc8e-4495-a187-9381739621d2`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431608', 'lastCheck': '7.7', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:39:52,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`2752a7bb-dc8e-4495-a187-9381739621d2`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:52,207::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:52,208::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:52,208::task::993::Storage.TaskManager.Task::(_decref) Task=`2752a7bb-dc8e-4495-a187-9381739621d2`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:39:53,155::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:39:53,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`7757a4b3-ab72-4210-a616-e66ff7266448`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:39:53,157::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:39:53,172::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:53,172::task::1191::Storage.TaskManager.Task::(prepare) Task=`7757a4b3-ab72-4210-a616-e66ff7266448`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:39:53,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`7757a4b3-ab72-4210-a616-e66ff7266448`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:39:53,172::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:39:53,173::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:39:53,173::task::993::Storage.TaskManager.Task::(_decref) Task=`7757a4b3-ab72-4210-a616-e66ff7266448`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:39:53,184::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:39:53,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`48b7a1a8-c117-4dc5-97b1-1e09231395dc`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:39:53,186::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:39:53,187::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f4d28df9-4a6d-4093-a177-df1de59eec45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:39:53,187::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:39:53,187::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:39:53,188::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f4d28df9-4a6d-4093-a177-df1de59eec45`::Granted request >Thread-6940::DEBUG::2014-07-08 16:39:53,188::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`48b7a1a8-c117-4dc5-97b1-1e09231395dc`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:39:53,189::task::993::Storage.TaskManager.Task::(_decref) Task=`48b7a1a8-c117-4dc5-97b1-1e09231395dc`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:39:53,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:53,208::task::1191::Storage.TaskManager.Task::(prepare) Task=`48b7a1a8-c117-4dc5-97b1-1e09231395dc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:39:53,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`48b7a1a8-c117-4dc5-97b1-1e09231395dc`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:39:53,208::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:39:53,208::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:39:53,209::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:39:53,209::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:39:53,209::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:39:53,210::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:39:53,210::task::993::Storage.TaskManager.Task::(_decref) Task=`48b7a1a8-c117-4dc5-97b1-1e09231395dc`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:39:54,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:54,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173942 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:39:54,503::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:39:54,503::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:54,503::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:54,504::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:39:54,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:54,504::__init__::225::IOProcess::(_processLogs) (273279) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:54,505::__init__::225::IOProcess::(_processLogs) (273279) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:54,505::__init__::225::IOProcess::(_processLogs) (273279) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:54,506::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:54,506::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:39:54,508::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:39:54,654::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000473232 s, 976 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:39:54,656::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:39:54,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:54,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:54,657::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:54,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:54,657::__init__::225::IOProcess::(_processLogs) (273280) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:39:54,658::__init__::225::IOProcess::(_processLogs) (273280) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:39:54,658::__init__::225::IOProcess::(_processLogs) (273280) Building response >Thread-18::DEBUG::2014-07-08 16:39:54,658::__init__::225::IOProcess::(_processLogs) (273280) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:54,658::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:54,658::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:39:54,661::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:39:54,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:54,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:54,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:54,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:54,662::__init__::225::IOProcess::(_processLogs) (273281) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:54,662::__init__::225::IOProcess::(_processLogs) (273281) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:54,663::__init__::225::IOProcess::(_processLogs) (273281) Building response >Thread-18::DEBUG::2014-07-08 16:39:54,663::__init__::225::IOProcess::(_processLogs) (273281) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:54,663::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:54,663::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:54,664::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:39:54,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:54,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:54,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:54,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:54,666::__init__::225::IOProcess::(_processLogs) (273282) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:54,666::__init__::225::IOProcess::(_processLogs) (273282) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:54,666::__init__::225::IOProcess::(_processLogs) (273282) Building response >Thread-18::DEBUG::2014-07-08 16:39:54,666::__init__::225::IOProcess::(_processLogs) (273282) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:54,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:54,667::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:39:54,668::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:39:54,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:39:54,669::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:39:54,669::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:39:54,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:39:54,669::__init__::225::IOProcess::(_processLogs) (273283) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:39:54,670::__init__::225::IOProcess::(_processLogs) (273283) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:39:54,670::__init__::225::IOProcess::(_processLogs) (273283) Building response >Thread-18::DEBUG::2014-07-08 16:39:54,670::__init__::225::IOProcess::(_processLogs) (273283) Queuing response >Thread-18::DEBUG::2014-07-08 16:39:54,670::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:39:54,670::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:39:56,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:56,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173319 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:39:58,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:39:58,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01728 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:00,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:01,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204968 s, 50.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:40:03,225::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:40:03,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b7ac523-a8ff-4e21-a607-1ebf910d46e6`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:03,226::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:40:03,242::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:03,243::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b7ac523-a8ff-4e21-a607-1ebf910d46e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:03,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b7ac523-a8ff-4e21-a607-1ebf910d46e6`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:03,243::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:03,243::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:03,244::task::993::Storage.TaskManager.Task::(_decref) Task=`5b7ac523-a8ff-4e21-a607-1ebf910d46e6`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:40:03,256::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:40:03,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`17484625-2bcf-46e5-b480-4a014beb3c25`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:40:03,257::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:40:03,258::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8af0ff0a-2b9a-4ab1-937c-d0b1de7497a7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:40:03,259::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:40:03,259::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:40:03,259::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8af0ff0a-2b9a-4ab1-937c-d0b1de7497a7`::Granted request >Thread-6940::DEBUG::2014-07-08 16:40:03,260::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`17484625-2bcf-46e5-b480-4a014beb3c25`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:40:03,260::task::993::Storage.TaskManager.Task::(_decref) Task=`17484625-2bcf-46e5-b480-4a014beb3c25`::ref 1 aborting False >Dummy-6860::DEBUG::2014-07-08 16:40:03,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6940::INFO::2014-07-08 16:40:03,427::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:03,429::task::1191::Storage.TaskManager.Task::(prepare) Task=`17484625-2bcf-46e5-b480-4a014beb3c25`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:03,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`17484625-2bcf-46e5-b480-4a014beb3c25`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:40:03,430::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:40:03,430::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:40:03,431::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:40:03,431::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:40:03,431::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:40:03,432::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:40:03,432::task::993::Storage.TaskManager.Task::(_decref) Task=`17484625-2bcf-46e5-b480-4a014beb3c25`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:40:03,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175828 s, 58.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:04,675::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:04,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:04,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:04,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:04,681::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:04,682::__init__::225::IOProcess::(_processLogs) (273284) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:04,683::__init__::225::IOProcess::(_processLogs) (273284) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:04,685::__init__::225::IOProcess::(_processLogs) (273284) Building response >Thread-18::DEBUG::2014-07-08 16:40:04,686::__init__::225::IOProcess::(_processLogs) (273284) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:04,687::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:04,688::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:40:04,695::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:40:04,849::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00045647 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:04,858::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:04,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:04,864::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:04,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:04,870::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:04,874::__init__::225::IOProcess::(_processLogs) (273285) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:04,877::__init__::225::IOProcess::(_processLogs) (273285) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:04,879::__init__::225::IOProcess::(_processLogs) (273285) Building response >Thread-18::DEBUG::2014-07-08 16:40:04,882::__init__::225::IOProcess::(_processLogs) (273285) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:04,884::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:04,887::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:40:04,902::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:40:04,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:04,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:04,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:04,913::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:04,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:04,919::__init__::225::IOProcess::(_processLogs) (273286) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:04,921::__init__::225::IOProcess::(_processLogs) (273286) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:04,923::__init__::225::IOProcess::(_processLogs) (273286) Building response >Thread-18::DEBUG::2014-07-08 16:40:04,925::__init__::225::IOProcess::(_processLogs) (273286) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:04,928::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:04,931::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:04,940::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:04,943::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:40:04,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:04,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:04,952::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:04,954::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:04,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:04,959::__init__::225::IOProcess::(_processLogs) (273287) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:04,961::__init__::225::IOProcess::(_processLogs) (273287) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:04,964::__init__::225::IOProcess::(_processLogs) (273287) Building response >Thread-18::DEBUG::2014-07-08 16:40:04,967::__init__::225::IOProcess::(_processLogs) (273287) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:04,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:04,972::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:04,981::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:04,984::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:40:04,987::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:04,990::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:04,995::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:04,998::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:05,001::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:05,004::__init__::225::IOProcess::(_processLogs) (273288) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:05,006::__init__::225::IOProcess::(_processLogs) (273288) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:05,009::__init__::225::IOProcess::(_processLogs) DEBUG|(273288) Building response >Thread-18::DEBUG::2014-07-08 16:40:05,012::__init__::225::IOProcess::(_processLogs) (273288) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:05,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:05,018::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:40:05,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:05,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171512 s, 59.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:40:07,375::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1b77402-91de-4b78-9c79-68b1530965d4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:07,376::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:40:07,376::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045647', 'lastCheck': '2.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:40:07,377::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1b77402-91de-4b78-9c79-68b1530965d4`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045647', 'lastCheck': '2.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:40:07,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1b77402-91de-4b78-9c79-68b1530965d4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:07,377::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:07,377::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:07,378::task::993::Storage.TaskManager.Task::(_decref) Task=`b1b77402-91de-4b78-9c79-68b1530965d4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:40:07,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:08,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172459 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:10,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:10,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321946 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:12,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:12,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174199 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:40:13,452::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:40:13,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fc2727e-3159-4388-8601-06f9c7d9f9bd`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:13,453::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:40:13,468::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:13,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`1fc2727e-3159-4388-8601-06f9c7d9f9bd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:13,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fc2727e-3159-4388-8601-06f9c7d9f9bd`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:13,469::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:13,469::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:13,470::task::993::Storage.TaskManager.Task::(_decref) Task=`1fc2727e-3159-4388-8601-06f9c7d9f9bd`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:40:13,482::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:40:13,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`dac753e0-535c-47bc-b966-b33c0d99b220`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:40:13,484::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:40:13,485::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`23dd555e-d607-442d-85d2-16bfdd40be1d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:40:13,485::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:40:13,485::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:40:13,486::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`23dd555e-d607-442d-85d2-16bfdd40be1d`::Granted request >Thread-6940::DEBUG::2014-07-08 16:40:13,486::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dac753e0-535c-47bc-b966-b33c0d99b220`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:40:13,487::task::993::Storage.TaskManager.Task::(_decref) Task=`dac753e0-535c-47bc-b966-b33c0d99b220`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:40:13,510::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:13,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`dac753e0-535c-47bc-b966-b33c0d99b220`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:13,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`dac753e0-535c-47bc-b966-b33c0d99b220`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:40:13,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:40:13,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:40:13,512::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:40:13,512::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:40:13,512::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:40:13,513::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:40:13,513::task::993::Storage.TaskManager.Task::(_decref) Task=`dac753e0-535c-47bc-b966-b33c0d99b220`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:40:14,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:14,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173878 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:15,027::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:15,027::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:15,027::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:15,028::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:15,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:15,028::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:15,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:15,029::__init__::225::IOProcess::(_processLogs) (273289) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:15,029::__init__::225::IOProcess::(_processLogs) (273289) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:15,029::__init__::225::IOProcess::(_processLogs) (273289) Building response >Thread-18::DEBUG::2014-07-08 16:40:15,029::__init__::225::IOProcess::(_processLogs) (273289) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:15,030::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:15,030::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:40:15,031::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:40:15,180::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00043496 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:15,182::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:15,183::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:15,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:15,183::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:15,184::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:15,184::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:15,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:15,184::__init__::225::IOProcess::(_processLogs) (273290) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:15,185::__init__::225::IOProcess::(_processLogs) (273290) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:15,185::__init__::225::IOProcess::(_processLogs) (273290) Building response >Thread-18::DEBUG::2014-07-08 16:40:15,185::__init__::225::IOProcess::(_processLogs) (273290) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:15,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:15,186::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:40:15,188::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:15,188::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:40:15,189::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:15,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:15,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:15,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:15,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:15,190::__init__::225::IOProcess::(_processLogs) (273291) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:15,190::__init__::225::IOProcess::(_processLogs) (273291) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:15,190::__init__::225::IOProcess::(_processLogs) (273291) Building response >Thread-18::DEBUG::2014-07-08 16:40:15,191::__init__::225::IOProcess::(_processLogs) (273291) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:15,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:15,191::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:15,192::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:15,192::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:40:15,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:15,193::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:15,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:15,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:15,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:15,194::__init__::225::IOProcess::(_processLogs) (273292) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:15,194::__init__::225::IOProcess::(_processLogs) (273292) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:15,194::__init__::225::IOProcess::(_processLogs) (273292) Building response >Thread-18::DEBUG::2014-07-08 16:40:15,195::__init__::225::IOProcess::(_processLogs) (273292) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:15,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:15,195::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:15,196::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:15,196::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:40:15,197::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:15,197::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:15,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:15,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:15,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:15,198::__init__::225::IOProcess::(_processLogs) (273293) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:15,198::__init__::225::IOProcess::(_processLogs) (273293) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:15,198::__init__::225::IOProcess::(_processLogs) (273293) Building response >Thread-18::DEBUG::2014-07-08 16:40:15,199::__init__::225::IOProcess::(_processLogs) (273293) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:15,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:15,199::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:40:16,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:17,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171431 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:19,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:19,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0869186 s, 11.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:21,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:21,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017799 s, 57.5 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:40:22,613::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dbe051b-9618-4509-be13-7b74253d6e6f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:22,613::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:40:22,614::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043496', 'lastCheck': '7.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:40:22,614::task::1191::Storage.TaskManager.Task::(prepare) Task=`5dbe051b-9618-4509-be13-7b74253d6e6f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043496', 'lastCheck': '7.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:40:22,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dbe051b-9618-4509-be13-7b74253d6e6f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:22,615::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:22,615::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:22,615::task::993::Storage.TaskManager.Task::(_decref) Task=`5dbe051b-9618-4509-be13-7b74253d6e6f`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:40:23,526::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:40:23,527::task::595::Storage.TaskManager.Task::(_updateState) Task=`6552a8a9-f4d6-46a1-8915-b88d4f457ba9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:23,527::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:40:23,542::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:23,543::task::1191::Storage.TaskManager.Task::(prepare) Task=`6552a8a9-f4d6-46a1-8915-b88d4f457ba9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:23,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`6552a8a9-f4d6-46a1-8915-b88d4f457ba9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:23,543::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:23,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:23,544::task::993::Storage.TaskManager.Task::(_decref) Task=`6552a8a9-f4d6-46a1-8915-b88d4f457ba9`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:40:23,555::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:40:23,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`c285575f-8320-4139-bafb-f3ada104515d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:40:23,556::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:40:23,561::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ce799ad1-5b36-43ca-934c-7fba9521de52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:40:23,561::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:40:23,562::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:40:23,562::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ce799ad1-5b36-43ca-934c-7fba9521de52`::Granted request >Thread-6940::DEBUG::2014-07-08 16:40:23,563::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c285575f-8320-4139-bafb-f3ada104515d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:40:23,563::task::993::Storage.TaskManager.Task::(_decref) Task=`c285575f-8320-4139-bafb-f3ada104515d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:40:23,582::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:23,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`c285575f-8320-4139-bafb-f3ada104515d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:23,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`c285575f-8320-4139-bafb-f3ada104515d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:40:23,583::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:40:23,583::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:40:23,584::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:40:23,584::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:40:23,584::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:40:23,584::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:40:23,585::task::993::Storage.TaskManager.Task::(_decref) Task=`c285575f-8320-4139-bafb-f3ada104515d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:40:23,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:24,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017528 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:25,202::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:25,203::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:25,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:25,203::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:25,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:25,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:25,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:25,204::__init__::225::IOProcess::(_processLogs) (273294) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:25,204::__init__::225::IOProcess::(_processLogs) (273294) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:25,205::__init__::225::IOProcess::(_processLogs) (273294) Building response >Thread-18::DEBUG::2014-07-08 16:40:25,205::__init__::225::IOProcess::(_processLogs) (273294) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:25,205::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:25,205::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:40:25,207::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:40:25,357::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000439709 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:25,361::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:25,362::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:25,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:25,363::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:25,363::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:25,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:25,364::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:25,364::__init__::225::IOProcess::(_processLogs) (273295) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:25,365::__init__::225::IOProcess::(_processLogs) (273295) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:25,365::__init__::225::IOProcess::(_processLogs) (273295) Building response >Thread-18::DEBUG::2014-07-08 16:40:25,366::__init__::225::IOProcess::(_processLogs) (273295) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:25,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:25,366::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:40:25,374::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:25,375::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:40:25,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:25,378::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:25,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:25,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:25,382::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:25,383::__init__::225::IOProcess::(_processLogs) (273296) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:25,384::__init__::225::IOProcess::(_processLogs) (273296) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:25,385::__init__::225::IOProcess::(_processLogs) (273296) Building response >Thread-18::DEBUG::2014-07-08 16:40:25,386::__init__::225::IOProcess::(_processLogs) (273296) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:25,387::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:25,388::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:25,393::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:25,394::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:40:25,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:25,397::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:25,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:25,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:25,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:25,402::__init__::225::IOProcess::(_processLogs) (273297) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:25,403::__init__::225::IOProcess::(_processLogs) (273297) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:25,404::__init__::225::IOProcess::(_processLogs) (273297) Building response >Thread-18::DEBUG::2014-07-08 16:40:25,406::__init__::225::IOProcess::(_processLogs) (273297) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:25,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:25,408::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:25,413::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:25,414::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:40:25,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:25,417::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:25,418::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:25,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:25,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:25,422::__init__::225::IOProcess::(_processLogs) (273298) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:25,423::__init__::225::IOProcess::(_processLogs) (273298) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:25,425::__init__::225::IOProcess::(_processLogs) (273298) Building response >Thread-18::DEBUG::2014-07-08 16:40:25,427::__init__::225::IOProcess::(_processLogs) (273298) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:25,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:25,430::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:40:26,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:26,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173515 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:28,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:28,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174604 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:30,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:31,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184591 s, 55.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:33,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:33,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179583 s, 57.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:40:33,600::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:40:33,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5792689-10a9-4eb3-a237-43412c5987df`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:33,602::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:40:33,617::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:33,617::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5792689-10a9-4eb3-a237-43412c5987df`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:33,618::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5792689-10a9-4eb3-a237-43412c5987df`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:33,618::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:33,618::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:33,619::task::993::Storage.TaskManager.Task::(_decref) Task=`f5792689-10a9-4eb3-a237-43412c5987df`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:40:33,630::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:40:33,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`421da374-d24d-467d-bc6a-eea06d10c0c4`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:40:33,632::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:40:33,633::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6989e603-1a0c-423f-a5fd-378ecacefbb1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:40:33,633::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:40:33,634::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:40:33,634::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6989e603-1a0c-423f-a5fd-378ecacefbb1`::Granted request >Thread-6940::DEBUG::2014-07-08 16:40:33,635::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`421da374-d24d-467d-bc6a-eea06d10c0c4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:40:33,635::task::993::Storage.TaskManager.Task::(_decref) Task=`421da374-d24d-467d-bc6a-eea06d10c0c4`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:40:33,654::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:33,655::task::1191::Storage.TaskManager.Task::(prepare) Task=`421da374-d24d-467d-bc6a-eea06d10c0c4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:33,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`421da374-d24d-467d-bc6a-eea06d10c0c4`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:40:33,656::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:40:33,656::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:40:33,656::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:40:33,657::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:40:33,657::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:40:33,657::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:40:33,658::task::993::Storage.TaskManager.Task::(_decref) Task=`421da374-d24d-467d-bc6a-eea06d10c0c4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:40:35,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:40:35,471::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:35,472::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:35,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:35,473::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:35,473::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:35,473::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:35,474::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:35,474::__init__::225::IOProcess::(_processLogs) (273299) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:35,474::__init__::225::IOProcess::(_processLogs) (273299) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:35,481::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building response >Thread-18::DEBUG::2014-07-08 16:40:35,482::__init__::225::IOProcess::(_processLogs) (273299) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:35,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:35,482::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:40:35,485::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:40:35,636::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0011409 s, 405 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:35,645::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:35,649::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:35,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:35,654::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:35,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:35,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:35,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:35,667::__init__::225::IOProcess::(_processLogs) (273300) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:35,670::__init__::225::IOProcess::(_processLogs) (273300) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:35,674::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|(273300) Building response >Thread-18::DEBUG::2014-07-08 16:40:35,677::__init__::225::IOProcess::(_processLogs) (273300) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:35,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:35,684::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:40:35,703::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:35,789::__init__::225::IOProcess::(_processLogs) Message size is 164 >Dummy-6860::DEBUG::2014-07-08 16:40:35,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.231781 s, 4.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:35,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:35,800::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:35,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:35,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:35,807::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:35,810::__init__::225::IOProcess::(_processLogs) (273301) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:35,813::__init__::225::IOProcess::(_processLogs) (273301) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:35,815::__init__::225::IOProcess::(_processLogs) (273301) Building response >Thread-18::DEBUG::2014-07-08 16:40:35,817::__init__::225::IOProcess::(_processLogs) (273301) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:35,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:35,822::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:35,831::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:35,833::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:40:35,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:35,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:35,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:35,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:35,846::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:35,849::__init__::225::IOProcess::(_processLogs) (273302) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:35,851::__init__::225::IOProcess::(_processLogs) (273302) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:35,853::__init__::225::IOProcess::(_processLogs) (273302) Building response >Thread-18::DEBUG::2014-07-08 16:40:35,856::__init__::225::IOProcess::(_processLogs) (273302) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:35,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:35,861::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:35,869::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:35,872::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:40:35,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:35,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:35,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:35,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:35,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:35,888::__init__::225::IOProcess::(_processLogs) (273303) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:35,891::__init__::225::IOProcess::(_processLogs) (273303) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:35,894::__init__::225::IOProcess::(_processLogs) (273303) Building response >Thread-18::DEBUG::2014-07-08 16:40:35,896::__init__::225::IOProcess::(_processLogs) (273303) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:35,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:35,901::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:40:37,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9970c82-87dd-4605-986b-94b4b14f23ad`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:37,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:40:37,795::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011409', 'lastCheck': '1.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:40:37,795::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9970c82-87dd-4605-986b-94b4b14f23ad`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011409', 'lastCheck': '1.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:40:37,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9970c82-87dd-4605-986b-94b4b14f23ad`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:37,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:37,796::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:37,796::task::993::Storage.TaskManager.Task::(_decref) Task=`e9970c82-87dd-4605-986b-94b4b14f23ad`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:40:38,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:38,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017373 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:40,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:40,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171981 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:42,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:42,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172621 s, 59.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:40:43,671::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:40:43,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`1350a3b9-3b2d-4242-8c08-5ca8b296e0a4`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:43,672::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:40:43,687::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:43,688::task::1191::Storage.TaskManager.Task::(prepare) Task=`1350a3b9-3b2d-4242-8c08-5ca8b296e0a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:43,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`1350a3b9-3b2d-4242-8c08-5ca8b296e0a4`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:43,688::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:43,688::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:43,689::task::993::Storage.TaskManager.Task::(_decref) Task=`1350a3b9-3b2d-4242-8c08-5ca8b296e0a4`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:40:43,700::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:40:43,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0c1cb23-55e9-4285-9901-b9340d78e4a1`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:40:43,701::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:40:43,702::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`431a86e0-ce2b-4ec9-935b-8854685adf22`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:40:43,702::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:40:43,703::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:40:43,703::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`431a86e0-ce2b-4ec9-935b-8854685adf22`::Granted request >Thread-6940::DEBUG::2014-07-08 16:40:43,704::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a0c1cb23-55e9-4285-9901-b9340d78e4a1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:40:43,704::task::993::Storage.TaskManager.Task::(_decref) Task=`a0c1cb23-55e9-4285-9901-b9340d78e4a1`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:40:43,723::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:43,723::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0c1cb23-55e9-4285-9901-b9340d78e4a1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:43,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0c1cb23-55e9-4285-9901-b9340d78e4a1`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:40:43,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:40:43,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:40:43,725::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:40:43,725::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:40:43,725::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:40:43,725::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:40:43,726::task::993::Storage.TaskManager.Task::(_decref) Task=`a0c1cb23-55e9-4285-9901-b9340d78e4a1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:40:44,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:45,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176166 s, 58.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:45,910::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:45,911::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:45,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:45,911::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:45,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:45,912::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:45,912::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:45,912::__init__::225::IOProcess::(_processLogs) (273304) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:45,913::__init__::225::IOProcess::(_processLogs) (273304) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:45,913::__init__::225::IOProcess::(_processLogs) (273304) Building response >Thread-18::DEBUG::2014-07-08 16:40:45,913::__init__::225::IOProcess::(_processLogs) (273304) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:45,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:45,914::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:40:45,915::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:40:46,075::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000486642 s, 949 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:46,081::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:46,082::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:46,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:46,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:46,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:46,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:46,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:46,092::__init__::225::IOProcess::(_processLogs) (273305) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:46,093::__init__::225::IOProcess::(_processLogs) (273305) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:46,094::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|(273305) Building response >Thread-18::DEBUG::2014-07-08 16:40:46,096::__init__::225::IOProcess::(_processLogs) (273305) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:46,097::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:46,098::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:40:46,107::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:46,108::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:40:46,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:46,111::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:46,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:46,114::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:46,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:46,116::__init__::225::IOProcess::(_processLogs) (273306) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:46,117::__init__::225::IOProcess::(_processLogs) (273306) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:46,119::__init__::225::IOProcess::(_processLogs) (273306) Building response >Thread-18::DEBUG::2014-07-08 16:40:46,120::__init__::225::IOProcess::(_processLogs) (273306) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:46,122::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:46,123::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:46,128::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:46,129::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:40:46,130::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:46,132::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:46,133::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:46,134::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:46,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:46,137::__init__::225::IOProcess::(_processLogs) (273307) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:46,139::__init__::225::IOProcess::(_processLogs) (273307) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:46,140::__init__::225::IOProcess::(_processLogs) (273307) Building response >Thread-18::DEBUG::2014-07-08 16:40:46,141::__init__::225::IOProcess::(_processLogs) (273307) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:46,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:46,143::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:46,153::__init__::225::IOProcess::(_processLogs) DEBUG|(273299) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:46,154::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:40:46,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:46,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:46,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:46,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:46,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:46,162::__init__::225::IOProcess::(_processLogs) (273308) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:46,163::__init__::225::IOProcess::(_processLogs) (273308) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:46,165::__init__::225::IOProcess::(_processLogs) (273308) Building response >Thread-18::DEBUG::2014-07-08 16:40:46,166::__init__::225::IOProcess::(_processLogs) (273308) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:46,167::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:46,168::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:40:47,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:47,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177521 s, 57.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:49,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:49,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176834 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:40:51,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:51,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175487 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:40:52,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`08073da1-b83c-4bc1-91d5-b43a54a39d34`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:52,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:40:52,951::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486642', 'lastCheck': '6.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:40:52,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`08073da1-b83c-4bc1-91d5-b43a54a39d34`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486642', 'lastCheck': '6.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:40:52,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`08073da1-b83c-4bc1-91d5-b43a54a39d34`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:52,952::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:52,952::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:52,952::task::993::Storage.TaskManager.Task::(_decref) Task=`08073da1-b83c-4bc1-91d5-b43a54a39d34`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:40:53,740::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:40:53,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`eff92d20-ea92-4827-9654-2db1ceb9b122`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:40:53,741::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:40:53,756::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:53,757::task::1191::Storage.TaskManager.Task::(prepare) Task=`eff92d20-ea92-4827-9654-2db1ceb9b122`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:40:53,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`eff92d20-ea92-4827-9654-2db1ceb9b122`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:40:53,757::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:40:53,758::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:40:53,758::task::993::Storage.TaskManager.Task::(_decref) Task=`eff92d20-ea92-4827-9654-2db1ceb9b122`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:40:53,769::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:40:53,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4751876-9c3c-42bd-b92b-d549ac95359a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:40:53,770::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:40:53,771::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`26ef2bad-d8c0-4ec3-893c-80a05130c305`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:40:53,771::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:40:53,772::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:40:53,772::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`26ef2bad-d8c0-4ec3-893c-80a05130c305`::Granted request >Thread-6940::DEBUG::2014-07-08 16:40:53,773::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f4751876-9c3c-42bd-b92b-d549ac95359a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:40:53,773::task::993::Storage.TaskManager.Task::(_decref) Task=`f4751876-9c3c-42bd-b92b-d549ac95359a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:40:53,792::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:53,792::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4751876-9c3c-42bd-b92b-d549ac95359a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:40:53,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4751876-9c3c-42bd-b92b-d549ac95359a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:40:53,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:40:53,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:40:53,793::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:40:53,794::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:40:53,794::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:40:53,794::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:40:53,795::task::993::Storage.TaskManager.Task::(_decref) Task=`f4751876-9c3c-42bd-b92b-d549ac95359a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:40:53,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:54,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175426 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:56,174::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:56,174::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:56,175::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:56,175::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:56,175::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:56,176::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:56,176::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:56,176::__init__::225::IOProcess::(_processLogs) (273309) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:56,177::__init__::225::IOProcess::(_processLogs) (273309) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:56,177::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273309) Building response >Thread-18::DEBUG::2014-07-08 16:40:56,177::__init__::225::IOProcess::(_processLogs) (273309) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:56,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:56,178::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:40:56,179::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:56,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:40:56,336::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00056989 s, 811 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:56,498::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:56,503::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:40:56,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:56,511::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:56,514::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:56,517::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:56,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:56,523::__init__::225::IOProcess::(_processLogs) (273310) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:40:56,527::__init__::225::IOProcess::(_processLogs) (273310) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:40:56,530::__init__::225::IOProcess::(_processLogs) (273310) Building response >Thread-18::DEBUG::2014-07-08 16:40:56,534::__init__::225::IOProcess::(_processLogs) (273310) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:56,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:56,540::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Dummy-6860::DEBUG::2014-07-08 16:40:56,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.05691 s, 18.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:40:56,641::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:56,644::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:40:56,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:56,652::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:56,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:56,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:56,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:56,665::__init__::225::IOProcess::(_processLogs) (273311) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:56,668::__init__::225::IOProcess::(_processLogs) (273311) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:56,671::__init__::225::IOProcess::(_processLogs) (273311) Building response >Thread-18::DEBUG::2014-07-08 16:40:56,674::__init__::225::IOProcess::(_processLogs) (273311) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:56,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:56,681::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:56,691::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:56,694::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:40:56,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:56,699::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:56,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:56,705::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:56,707::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:56,710::__init__::225::IOProcess::(_processLogs) (273312) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:56,713::__init__::225::IOProcess::(_processLogs) (273312) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:56,715::__init__::225::IOProcess::(_processLogs) (273312) Building response >Thread-18::DEBUG::2014-07-08 16:40:56,718::__init__::225::IOProcess::(_processLogs) (273312) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:56,721::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:56,723::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:40:56,732::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:40:56,734::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:40:56,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:40:56,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:40:56,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:40:56,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:40:56,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:40:56,748::__init__::225::IOProcess::(_processLogs) (273313) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:40:56,750::__init__::225::IOProcess::(_processLogs) (273313) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:40:56,752::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273313) Building response >Thread-18::DEBUG::2014-07-08 16:40:56,755::__init__::225::IOProcess::(_processLogs) (273313) Queuing response >Thread-18::DEBUG::2014-07-08 16:40:56,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:40:56,759::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:40:58,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:40:59,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205191 s, 49.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:01,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:01,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268966 s, 38.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:03,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:03,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0192022 s, 53.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:41:03,809::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:41:03,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e2c4ab2-28db-469c-b922-cf0c25980f16`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:03,811::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:41:03,827::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:03,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e2c4ab2-28db-469c-b922-cf0c25980f16`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:03,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e2c4ab2-28db-469c-b922-cf0c25980f16`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:03,828::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:03,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:03,828::task::993::Storage.TaskManager.Task::(_decref) Task=`7e2c4ab2-28db-469c-b922-cf0c25980f16`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:41:03,841::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:41:03,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f4f28d3-1259-41a0-ad20-a54bb90779a0`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:41:03,842::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:41:03,843::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c8920f0b-625b-4ad5-a177-555031029eee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:41:03,844::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:41:03,844::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:41:03,845::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c8920f0b-625b-4ad5-a177-555031029eee`::Granted request >Thread-6940::DEBUG::2014-07-08 16:41:03,845::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1f4f28d3-1259-41a0-ad20-a54bb90779a0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:41:03,846::task::993::Storage.TaskManager.Task::(_decref) Task=`1f4f28d3-1259-41a0-ad20-a54bb90779a0`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:41:03,865::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:03,865::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f4f28d3-1259-41a0-ad20-a54bb90779a0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:03,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f4f28d3-1259-41a0-ad20-a54bb90779a0`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:41:03,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:41:03,866::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:41:03,867::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:41:03,867::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:41:03,867::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:41:03,867::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:41:03,868::task::993::Storage.TaskManager.Task::(_decref) Task=`1f4f28d3-1259-41a0-ad20-a54bb90779a0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:41:05,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:06,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175462 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:06,767::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:06,768::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:06,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:06,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:06,769::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:06,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:06,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:06,770::__init__::225::IOProcess::(_processLogs) (273314) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:06,770::__init__::225::IOProcess::(_processLogs) (273314) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:06,770::__init__::225::IOProcess::(_processLogs) (273314) Building response >Thread-18::DEBUG::2014-07-08 16:41:06,770::__init__::225::IOProcess::(_processLogs) (273314) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:06,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:06,771::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:41:06,772::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:41:06,918::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00047854 s, 965 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:06,921::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:06,921::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:06,921::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:06,922::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:06,922::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:06,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:06,922::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:06,924::__init__::225::IOProcess::(_processLogs) (273315) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:06,926::__init__::225::IOProcess::(_processLogs) (273315) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:06,928::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273315) Building response >Thread-18::DEBUG::2014-07-08 16:41:06,930::__init__::225::IOProcess::(_processLogs) (273315) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:06,931::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:06,932::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:41:06,941::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:06,943::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:41:06,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:06,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:06,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:06,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:06,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:06,952::__init__::225::IOProcess::(_processLogs) (273316) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:06,953::__init__::225::IOProcess::(_processLogs) (273316) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:06,955::__init__::225::IOProcess::(_processLogs) (273316) Building response >Thread-18::DEBUG::2014-07-08 16:41:06,956::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273316) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:06,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:06,959::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:06,964::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:06,966::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:41:06,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:06,969::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:06,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:06,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:06,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:06,974::__init__::225::IOProcess::(_processLogs) (273317) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:06,975::__init__::225::IOProcess::(_processLogs) (273317) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:06,977::__init__::225::IOProcess::(_processLogs) (273317) Building response >Thread-18::DEBUG::2014-07-08 16:41:06,978::__init__::225::IOProcess::(_processLogs) (273317) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:06,979::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:06,981::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:06,985::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:06,987::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:41:06,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:06,989::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:06,990::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:06,992::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:06,993::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:06,995::__init__::225::IOProcess::(_processLogs) (273318) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:06,996::__init__::225::IOProcess::(_processLogs) (273318) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:06,997::__init__::225::IOProcess::(_processLogs) (273318) Building response >Thread-18::DEBUG::2014-07-08 16:41:06,998::__init__::225::IOProcess::(_processLogs) (273318) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:07,000::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:07,001::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:41:08,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`78bb6cd6-3bc7-4a8e-9397-e665fe5f111e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:08,107::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:41:08,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047854', 'lastCheck': '1.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:41:08,108::task::1191::Storage.TaskManager.Task::(prepare) Task=`78bb6cd6-3bc7-4a8e-9397-e665fe5f111e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047854', 'lastCheck': '1.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:41:08,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`78bb6cd6-3bc7-4a8e-9397-e665fe5f111e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:08,108::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:08,109::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:08,109::task::993::Storage.TaskManager.Task::(_decref) Task=`78bb6cd6-3bc7-4a8e-9397-e665fe5f111e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:41:08,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:08,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174328 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:10,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:10,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0206326 s, 49.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:12,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:12,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171383 s, 59.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:41:13,891::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:41:13,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`635a122b-2d25-49fc-b2b2-c506f1edf3fb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:13,892::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:41:13,907::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:13,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`635a122b-2d25-49fc-b2b2-c506f1edf3fb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:13,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`635a122b-2d25-49fc-b2b2-c506f1edf3fb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:13,908::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:13,908::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:13,908::task::993::Storage.TaskManager.Task::(_decref) Task=`635a122b-2d25-49fc-b2b2-c506f1edf3fb`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:41:13,920::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:41:13,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`7289657a-46eb-41be-807b-6de1153f281a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:41:13,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:41:13,922::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`eb306d35-5166-446c-bf44-9ea17a52dfd6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:41:13,923::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:41:13,923::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:41:13,923::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`eb306d35-5166-446c-bf44-9ea17a52dfd6`::Granted request >Thread-6940::DEBUG::2014-07-08 16:41:13,924::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7289657a-46eb-41be-807b-6de1153f281a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:41:13,924::task::993::Storage.TaskManager.Task::(_decref) Task=`7289657a-46eb-41be-807b-6de1153f281a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:41:13,943::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:13,944::task::1191::Storage.TaskManager.Task::(prepare) Task=`7289657a-46eb-41be-807b-6de1153f281a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:13,944::task::595::Storage.TaskManager.Task::(_updateState) Task=`7289657a-46eb-41be-807b-6de1153f281a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:41:13,944::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:41:13,944::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:41:13,945::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:41:13,945::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:41:13,945::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:41:13,946::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:41:13,946::task::993::Storage.TaskManager.Task::(_decref) Task=`7289657a-46eb-41be-807b-6de1153f281a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:41:14,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:15,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173439 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:17,007::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:17,007::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:17,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:17,008::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:17,008::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:17,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:17,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:17,009::__init__::225::IOProcess::(_processLogs) (273319) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:17,009::__init__::225::IOProcess::(_processLogs) (273319) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:17,009::__init__::225::IOProcess::(_processLogs) (273319) Building response >Thread-18::DEBUG::2014-07-08 16:41:17,010::__init__::225::IOProcess::(_processLogs) (273319) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:17,010::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:17,010::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:41:17,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:41:17,169::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0004439 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:17,173::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:17,174::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:17,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:17,175::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:17,175::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:17,175::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:17,176::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:17,176::__init__::225::IOProcess::(_processLogs) (273320) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:17,177::__init__::225::IOProcess::(_processLogs) (273320) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:17,177::__init__::225::IOProcess::(_processLogs) (273320) Building response >Thread-18::DEBUG::2014-07-08 16:41:17,177::__init__::225::IOProcess::(_processLogs) (273320) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:17,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:17,178::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:41:17,182::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:17,182::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:41:17,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:17,183::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:17,184::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:17,184::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:17,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:17,185::__init__::225::IOProcess::(_processLogs) (273321) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:17,185::__init__::225::IOProcess::(_processLogs) (273321) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:17,186::__init__::225::IOProcess::(_processLogs) (273321) Building response >Thread-18::DEBUG::2014-07-08 16:41:17,186::__init__::225::IOProcess::(_processLogs) (273321) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:17,186::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:17,187::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:17,189::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:17,190::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:41:17,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:17,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:17,191::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:17,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:17,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:17,193::__init__::225::IOProcess::(_processLogs) (273322) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:17,193::__init__::225::IOProcess::(_processLogs) (273322) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:17,194::__init__::225::IOProcess::(_processLogs) (273322) Building response >Thread-18::DEBUG::2014-07-08 16:41:17,194::__init__::225::IOProcess::(_processLogs) (273322) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:17,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:17,195::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:17,197::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:17,198::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:41:17,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:17,198::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:17,199::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:17,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:17,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:17,200::__init__::225::IOProcess::(_processLogs) (273323) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:17,200::__init__::225::IOProcess::(_processLogs) (273323) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:17,201::__init__::225::IOProcess::(_processLogs) (273323) Building response >Thread-18::DEBUG::2014-07-08 16:41:17,201::__init__::225::IOProcess::(_processLogs) (273323) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:17,201::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:17,202::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:41:17,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:17,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456572 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:19,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:19,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263524 s, 38.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:21,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:22,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0197464 s, 51.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:41:23,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`35817c62-9e04-4177-955a-869df38eedd5`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:23,418::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:41:23,418::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004439', 'lastCheck': '6.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:41:23,418::task::1191::Storage.TaskManager.Task::(prepare) Task=`35817c62-9e04-4177-955a-869df38eedd5`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004439', 'lastCheck': '6.1', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:41:23,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`35817c62-9e04-4177-955a-869df38eedd5`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:23,419::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:23,419::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:23,419::task::993::Storage.TaskManager.Task::(_decref) Task=`35817c62-9e04-4177-955a-869df38eedd5`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:41:23,960::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:41:23,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`960eb8c1-1802-4d09-bc39-98d6b3adf855`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:23,961::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:41:23,976::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:23,976::task::1191::Storage.TaskManager.Task::(prepare) Task=`960eb8c1-1802-4d09-bc39-98d6b3adf855`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:23,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`960eb8c1-1802-4d09-bc39-98d6b3adf855`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:23,977::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:23,977::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:23,977::task::993::Storage.TaskManager.Task::(_decref) Task=`960eb8c1-1802-4d09-bc39-98d6b3adf855`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:41:23,988::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:41:23,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`47ea7913-a932-404a-9a9f-a9f5afca2a2d`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:41:23,989::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:41:23,990::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6487d588-ea80-4bd7-9f41-f5a359107dab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:41:23,991::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:41:23,991::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:41:23,991::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6487d588-ea80-4bd7-9f41-f5a359107dab`::Granted request >Thread-6940::DEBUG::2014-07-08 16:41:23,992::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`47ea7913-a932-404a-9a9f-a9f5afca2a2d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:41:23,992::task::993::Storage.TaskManager.Task::(_decref) Task=`47ea7913-a932-404a-9a9f-a9f5afca2a2d`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:41:24,011::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:24,012::task::1191::Storage.TaskManager.Task::(prepare) Task=`47ea7913-a932-404a-9a9f-a9f5afca2a2d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:24,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`47ea7913-a932-404a-9a9f-a9f5afca2a2d`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:41:24,012::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:41:24,012::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:41:24,013::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:41:24,013::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:41:24,014::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:41:24,014::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:41:24,014::task::993::Storage.TaskManager.Task::(_decref) Task=`47ea7913-a932-404a-9a9f-a9f5afca2a2d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:41:24,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:24,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171512 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:26,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:26,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173294 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:27,364::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:27,365::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:27,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:27,366::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:27,366::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:27,366::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:27,366::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:27,367::__init__::225::IOProcess::(_processLogs) (273324) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:27,367::__init__::225::IOProcess::(_processLogs) (273324) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:27,367::__init__::225::IOProcess::(_processLogs) (273324) Building response >Thread-18::DEBUG::2014-07-08 16:41:27,367::__init__::225::IOProcess::(_processLogs) (273324) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:27,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:27,368::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:41:27,370::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:41:27,519::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000493627 s, 936 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:27,521::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:27,521::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:27,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:27,522::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:27,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:27,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:27,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:27,523::__init__::225::IOProcess::(_processLogs) (273325) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:27,523::__init__::225::IOProcess::(_processLogs) (273325) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:27,524::__init__::225::IOProcess::(_processLogs) (273325) Building response >Thread-18::DEBUG::2014-07-08 16:41:27,524::__init__::225::IOProcess::(_processLogs) (273325) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:27,524::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:27,524::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:41:27,527::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:27,527::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:41:27,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:27,527::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:27,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:27,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:27,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:27,528::__init__::225::IOProcess::(_processLogs) (273326) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:27,529::__init__::225::IOProcess::(_processLogs) (273326) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:27,529::__init__::225::IOProcess::(_processLogs) (273326) Building response >Thread-18::DEBUG::2014-07-08 16:41:27,529::__init__::225::IOProcess::(_processLogs) (273326) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:27,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:27,530::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:27,531::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:41:27,531::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:27,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:27,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:27,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:27,532::__init__::225::IOProcess::(_processLogs) (273327) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:27,532::__init__::225::IOProcess::(_processLogs) (273327) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:27,533::__init__::225::IOProcess::(_processLogs) (273327) Building response >Thread-18::DEBUG::2014-07-08 16:41:27,533::__init__::225::IOProcess::(_processLogs) (273327) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:27,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:27,533::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:27,534::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:41:27,535::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:27,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:27,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:27,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:27,536::__init__::225::IOProcess::(_processLogs) (273328) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:27,536::__init__::225::IOProcess::(_processLogs) (273328) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:27,536::__init__::225::IOProcess::(_processLogs) (273328) Building response >Thread-18::DEBUG::2014-07-08 16:41:27,536::__init__::225::IOProcess::(_processLogs) (273328) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:27,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:27,537::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:41:28,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:29,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177616 s, 57.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:31,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:31,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177987 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:33,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:33,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182544 s, 56.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:41:34,028::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:41:34,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f66f29-dc10-4551-a358-e9f830df449a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:34,030::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:41:34,045::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:34,045::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0f66f29-dc10-4551-a358-e9f830df449a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:34,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f66f29-dc10-4551-a358-e9f830df449a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:34,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:34,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:34,046::task::993::Storage.TaskManager.Task::(_decref) Task=`c0f66f29-dc10-4551-a358-e9f830df449a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:41:34,059::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:41:34,060::task::595::Storage.TaskManager.Task::(_updateState) Task=`385543f6-baac-47e8-a632-8743dece50f1`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:41:34,060::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:41:34,061::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`db6995f7-636b-4189-bc38-f347fba5b2a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:41:34,061::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:41:34,062::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:41:34,062::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`db6995f7-636b-4189-bc38-f347fba5b2a2`::Granted request >Thread-6940::DEBUG::2014-07-08 16:41:34,063::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`385543f6-baac-47e8-a632-8743dece50f1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:41:34,063::task::993::Storage.TaskManager.Task::(_decref) Task=`385543f6-baac-47e8-a632-8743dece50f1`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:41:34,082::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:34,083::task::1191::Storage.TaskManager.Task::(prepare) Task=`385543f6-baac-47e8-a632-8743dece50f1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:34,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`385543f6-baac-47e8-a632-8743dece50f1`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:41:34,083::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:41:34,084::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:41:34,084::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:41:34,085::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:41:34,085::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:41:34,085::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:41:34,085::task::993::Storage.TaskManager.Task::(_decref) Task=`385543f6-baac-47e8-a632-8743dece50f1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:41:35,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:35,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342719 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:37,540::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:37,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:37,541::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:37,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:37,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:37,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:37,542::__init__::225::IOProcess::(_processLogs) (273329) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:37,542::__init__::225::IOProcess::(_processLogs) (273329) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:37,542::__init__::225::IOProcess::(_processLogs) (273329) Building response >Thread-18::DEBUG::2014-07-08 16:41:37,542::__init__::225::IOProcess::(_processLogs) (273329) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:37,543::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:37,543::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:41:37,545::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:41:37,691::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000464293 s, 995 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:37,694::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:37,694::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:37,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:37,695::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:37,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:37,695::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:37,695::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:37,696::__init__::225::IOProcess::(_processLogs) (273330) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:37,696::__init__::225::IOProcess::(_processLogs) (273330) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:37,696::__init__::225::IOProcess::(_processLogs) (273330) Building response >Thread-18::DEBUG::2014-07-08 16:41:37,696::__init__::225::IOProcess::(_processLogs) (273330) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:37,697::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:37,697::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:41:37,699::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:37,699::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:41:37,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:37,700::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:37,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:37,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:37,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:37,701::__init__::225::IOProcess::(_processLogs) (273331) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:37,701::__init__::225::IOProcess::(_processLogs) (273331) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:37,701::__init__::225::IOProcess::(_processLogs) (273331) Building response >Thread-18::DEBUG::2014-07-08 16:41:37,701::__init__::225::IOProcess::(_processLogs) (273331) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:37,702::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:37,702::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:37,703::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:41:37,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:37,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:37,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:37,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:37,704::__init__::225::IOProcess::(_processLogs) (273332) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:37,705::__init__::225::IOProcess::(_processLogs) (273332) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:37,705::__init__::225::IOProcess::(_processLogs) (273332) Building response >Thread-18::DEBUG::2014-07-08 16:41:37,705::__init__::225::IOProcess::(_processLogs) (273332) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:37,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:37,706::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:37,707::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:41:37,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:37,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:37,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:37,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:37,708::__init__::225::IOProcess::(_processLogs) (273333) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:37,708::__init__::225::IOProcess::(_processLogs) (273333) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:37,708::__init__::225::IOProcess::(_processLogs) (273333) Building response >Thread-18::DEBUG::2014-07-08 16:41:37,709::__init__::225::IOProcess::(_processLogs) (273333) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:37,709::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:37,709::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:41:37,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:38,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173736 s, 58.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:41:38,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`d236f243-a1a5-4163-9534-9324b8755d34`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:38,571::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:41:38,572::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464293', 'lastCheck': '0.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:41:38,572::task::1191::Storage.TaskManager.Task::(prepare) Task=`d236f243-a1a5-4163-9534-9324b8755d34`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464293', 'lastCheck': '0.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:41:38,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`d236f243-a1a5-4163-9534-9324b8755d34`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:38,573::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:38,573::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:38,573::task::993::Storage.TaskManager.Task::(_decref) Task=`d236f243-a1a5-4163-9534-9324b8755d34`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:41:40,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:40,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178867 s, 57.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:42,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:42,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174264 s, 58.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:41:44,100::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:41:44,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`8316dde6-4790-4eb9-9e05-a65ebc66bc09`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:44,101::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:41:44,116::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:44,117::task::1191::Storage.TaskManager.Task::(prepare) Task=`8316dde6-4790-4eb9-9e05-a65ebc66bc09`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:44,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`8316dde6-4790-4eb9-9e05-a65ebc66bc09`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:44,117::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:44,117::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:44,118::task::993::Storage.TaskManager.Task::(_decref) Task=`8316dde6-4790-4eb9-9e05-a65ebc66bc09`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:41:44,130::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:41:44,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`43613918-4300-4b64-ba7c-5992aafd8d7e`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:41:44,131::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:41:44,132::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f3a159fb-b5a1-4c42-834a-5843b0b08753`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:41:44,132::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:41:44,133::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:41:44,133::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f3a159fb-b5a1-4c42-834a-5843b0b08753`::Granted request >Thread-6940::DEBUG::2014-07-08 16:41:44,134::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`43613918-4300-4b64-ba7c-5992aafd8d7e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:41:44,134::task::993::Storage.TaskManager.Task::(_decref) Task=`43613918-4300-4b64-ba7c-5992aafd8d7e`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:41:44,153::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:44,153::task::1191::Storage.TaskManager.Task::(prepare) Task=`43613918-4300-4b64-ba7c-5992aafd8d7e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:44,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`43613918-4300-4b64-ba7c-5992aafd8d7e`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:41:44,154::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:41:44,154::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:41:44,154::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:41:44,155::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:41:44,155::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:41:44,155::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:41:44,155::task::993::Storage.TaskManager.Task::(_decref) Task=`43613918-4300-4b64-ba7c-5992aafd8d7e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:41:44,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:45,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175982 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:47,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:47,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173736 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:47,712::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:47,713::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:47,713::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:47,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:47,713::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:47,714::__init__::225::IOProcess::(_processLogs) (273334) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:47,714::__init__::225::IOProcess::(_processLogs) (273334) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:47,714::__init__::225::IOProcess::(_processLogs) (273334) Building response >Thread-18::DEBUG::2014-07-08 16:41:47,714::__init__::225::IOProcess::(_processLogs) (273334) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:47,715::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:47,715::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:41:47,717::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:41:47,863::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000462897 s, 998 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:47,865::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:47,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:47,865::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:47,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:47,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:47,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:47,867::__init__::225::IOProcess::(_processLogs) (273335) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:47,867::__init__::225::IOProcess::(_processLogs) (273335) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:47,867::__init__::225::IOProcess::(_processLogs) (273335) Building response >Thread-18::DEBUG::2014-07-08 16:41:47,867::__init__::225::IOProcess::(_processLogs) (273335) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:47,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:47,868::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:41:47,870::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:47,870::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:41:47,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:47,871::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:47,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:47,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:47,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:47,872::__init__::225::IOProcess::(_processLogs) (273336) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:47,872::__init__::225::IOProcess::(_processLogs) (273336) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:47,872::__init__::225::IOProcess::(_processLogs) (273336) Building response >Thread-18::DEBUG::2014-07-08 16:41:47,872::__init__::225::IOProcess::(_processLogs) (273336) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:47,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:47,873::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:47,874::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:47,874::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:41:47,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:47,875::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:47,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:47,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:47,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:47,876::__init__::225::IOProcess::(_processLogs) (273337) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:47,876::__init__::225::IOProcess::(_processLogs) (273337) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:47,876::__init__::225::IOProcess::(_processLogs) (273337) Building response >Thread-18::DEBUG::2014-07-08 16:41:47,876::__init__::225::IOProcess::(_processLogs) (273337) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:47,877::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:47,877::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:47,878::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:47,878::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:41:47,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:47,879::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:47,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:47,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:47,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:47,880::__init__::225::IOProcess::(_processLogs) (273338) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:47,880::__init__::225::IOProcess::(_processLogs) (273338) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:47,880::__init__::225::IOProcess::(_processLogs) (273338) Building response >Thread-18::DEBUG::2014-07-08 16:41:47,881::__init__::225::IOProcess::(_processLogs) (273338) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:47,881::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:47,881::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:41:49,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:49,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173364 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:41:51,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:51,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176275 s, 58.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:41:53,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1f4905c-6eb9-4da6-91b2-251a51bd884e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:53,725::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:41:53,726::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462897', 'lastCheck': '5.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:41:53,726::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1f4905c-6eb9-4da6-91b2-251a51bd884e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462897', 'lastCheck': '5.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:41:53,726::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1f4905c-6eb9-4da6-91b2-251a51bd884e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:53,726::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:53,727::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:53,727::task::993::Storage.TaskManager.Task::(_decref) Task=`e1f4905c-6eb9-4da6-91b2-251a51bd884e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:41:53,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:54,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364495 s, 28.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:41:54,171::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:41:54,174::task::595::Storage.TaskManager.Task::(_updateState) Task=`155da8aa-8350-4f51-a98a-84295b4dd9e5`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:41:54,176::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:41:54,192::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:54,192::task::1191::Storage.TaskManager.Task::(prepare) Task=`155da8aa-8350-4f51-a98a-84295b4dd9e5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:41:54,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`155da8aa-8350-4f51-a98a-84295b4dd9e5`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:41:54,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:41:54,193::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:41:54,193::task::993::Storage.TaskManager.Task::(_decref) Task=`155da8aa-8350-4f51-a98a-84295b4dd9e5`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:41:54,204::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:41:54,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`983ff8ea-7fbd-42bf-8e1c-d35a4ddefb75`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:41:54,206::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:41:54,211::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e436e08e-0db9-43d7-913f-ed6e6dda1c32`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:41:54,211::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:41:54,212::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:41:54,212::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e436e08e-0db9-43d7-913f-ed6e6dda1c32`::Granted request >Thread-6940::DEBUG::2014-07-08 16:41:54,213::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`983ff8ea-7fbd-42bf-8e1c-d35a4ddefb75`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:41:54,213::task::993::Storage.TaskManager.Task::(_decref) Task=`983ff8ea-7fbd-42bf-8e1c-d35a4ddefb75`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:41:54,232::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:54,232::task::1191::Storage.TaskManager.Task::(prepare) Task=`983ff8ea-7fbd-42bf-8e1c-d35a4ddefb75`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:41:54,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`983ff8ea-7fbd-42bf-8e1c-d35a4ddefb75`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:41:54,233::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:41:54,233::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:41:54,234::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:41:54,234::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:41:54,234::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:41:54,234::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:41:54,235::task::993::Storage.TaskManager.Task::(_decref) Task=`983ff8ea-7fbd-42bf-8e1c-d35a4ddefb75`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:41:56,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:56,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174208 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:57,893::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:57,894::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:57,894::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:57,898::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:57,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:57,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:57,899::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:57,899::__init__::225::IOProcess::(_processLogs) (273339) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:57,899::__init__::225::IOProcess::(_processLogs) (273339) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:57,899::__init__::225::IOProcess::(_processLogs) (273339) Building response >Thread-18::DEBUG::2014-07-08 16:41:57,900::__init__::225::IOProcess::(_processLogs) (273339) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:57,900::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:57,900::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:41:57,902::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:41:58,055::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000453677 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:41:58,060::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:58,062::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:41:58,064::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:58,065::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:58,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:58,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:58,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:58,071::__init__::225::IOProcess::(_processLogs) (273340) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:41:58,072::__init__::225::IOProcess::(_processLogs) (273340) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:41:58,073::__init__::225::IOProcess::(_processLogs) (273340) Building response >Thread-18::DEBUG::2014-07-08 16:41:58,075::__init__::225::IOProcess::(_processLogs) (273340) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:58,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:58,078::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:41:58,087::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:58,089::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:41:58,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:58,092::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:58,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:58,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:58,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:58,099::__init__::225::IOProcess::(_processLogs) (273341) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:58,100::__init__::225::IOProcess::(_processLogs) (273341) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:58,101::__init__::225::IOProcess::(_processLogs) (273341) Building response >Thread-18::DEBUG::2014-07-08 16:41:58,103::__init__::225::IOProcess::(_processLogs) (273341) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:58,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:58,106::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:58,112::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:58,113::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:41:58,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:58,117::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:58,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:58,120::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:58,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:58,123::__init__::225::IOProcess::(_processLogs) (273342) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:58,125::__init__::225::IOProcess::(_processLogs) (273342) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:58,127::__init__::225::IOProcess::(_processLogs) (273342) Building response >Thread-18::DEBUG::2014-07-08 16:41:58,128::__init__::225::IOProcess::(_processLogs) (273342) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:58,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:58,131::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:41:58,136::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:41:58,137::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:41:58,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:41:58,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:41:58,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:41:58,143::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:41:58,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:41:58,146::__init__::225::IOProcess::(_processLogs) (273343) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:41:58,148::__init__::225::IOProcess::(_processLogs) (273343) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:41:58,150::__init__::225::IOProcess::(_processLogs) (273343) Building response >Thread-18::DEBUG::2014-07-08 16:41:58,151::__init__::225::IOProcess::(_processLogs) (273343) Queuing response >Thread-18::DEBUG::2014-07-08 16:41:58,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:41:58,154::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:41:58,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:41:58,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172738 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:00,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:00,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018308 s, 55.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:02,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:03,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0998727 s, 10.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:42:04,250::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:42:04,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`cec726f2-58d0-4c3a-92b5-20e031c10f40`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:04,255::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:42:04,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:04,277::task::1191::Storage.TaskManager.Task::(prepare) Task=`cec726f2-58d0-4c3a-92b5-20e031c10f40`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:04,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`cec726f2-58d0-4c3a-92b5-20e031c10f40`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:04,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:04,281::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:04,282::task::993::Storage.TaskManager.Task::(_decref) Task=`cec726f2-58d0-4c3a-92b5-20e031c10f40`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:42:04,302::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:42:04,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`f31ea544-6212-4f5c-8084-12f443a57348`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:42:04,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:42:04,321::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`745f5bf1-7457-4ba8-9bec-ba415a05dad9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:42:04,323::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:42:04,328::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:42:04,331::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`745f5bf1-7457-4ba8-9bec-ba415a05dad9`::Granted request >Thread-6940::DEBUG::2014-07-08 16:42:04,340::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f31ea544-6212-4f5c-8084-12f443a57348`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:42:04,342::task::993::Storage.TaskManager.Task::(_decref) Task=`f31ea544-6212-4f5c-8084-12f443a57348`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:42:04,376::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:04,377::task::1191::Storage.TaskManager.Task::(prepare) Task=`f31ea544-6212-4f5c-8084-12f443a57348`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:04,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`f31ea544-6212-4f5c-8084-12f443a57348`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:42:04,378::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:42:04,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:42:04,381::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:42:04,382::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:42:04,383::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:42:04,384::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:42:04,386::task::993::Storage.TaskManager.Task::(_decref) Task=`f31ea544-6212-4f5c-8084-12f443a57348`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:42:05,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:05,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174917 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:07,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:07,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172478 s, 59.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:42:08,159::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:42:08,167::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:42:08,169::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:42:08,169::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,169::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,170::__init__::225::IOProcess::(_processLogs) (273344) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:42:08,171::__init__::225::IOProcess::(_processLogs) (273344) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:42:08,171::__init__::225::IOProcess::(_processLogs) (273344) Building response >Thread-18::DEBUG::2014-07-08 16:42:08,171::__init__::225::IOProcess::(_processLogs) (273344) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,171::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,172::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:42:08,178::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:42:08,179::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:42:08,179::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,179::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,180::__init__::225::IOProcess::(_processLogs) (273345) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:42:08,180::__init__::225::IOProcess::(_processLogs) (273345) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:42:08,181::__init__::225::IOProcess::(_processLogs) (273345) Building response >Thread-18::DEBUG::2014-07-08 16:42:08,181::__init__::225::IOProcess::(_processLogs) (273345) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,181::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,181::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:42:08,182::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:42:08,183::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:42:08,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,184::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,184::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,184::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,185::__init__::225::IOProcess::(_processLogs) (273346) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:42:08,185::__init__::225::IOProcess::(_processLogs) (273346) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:42:08,185::__init__::225::IOProcess::(_processLogs) (273346) Building response >Thread-18::DEBUG::2014-07-08 16:42:08,185::__init__::225::IOProcess::(_processLogs) (273346) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,186::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,186::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:42:08,187::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:42:08,188::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:42:08,191::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,193::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,199::__init__::225::IOProcess::(_processLogs) (273347) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:42:08,201::__init__::225::IOProcess::(_processLogs) (273347) Got request for method 'glob' >Thread-37::DEBUG::2014-07-08 16:42:08,202::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:42:08,203::__init__::225::IOProcess::(_processLogs) (273347) Building response >Thread-18::DEBUG::2014-07-08 16:42:08,204::__init__::225::IOProcess::(_processLogs) (273347) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,204::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:42:08,206::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:42:08,206::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:42:08,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,207::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,208::__init__::225::IOProcess::(_processLogs) (273348) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:42:08,208::__init__::225::IOProcess::(_processLogs) (273348) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:42:08,208::__init__::225::IOProcess::(_processLogs) (273348) Building response >Thread-18::DEBUG::2014-07-08 16:42:08,209::__init__::225::IOProcess::(_processLogs) (273348) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,209::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,209::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:42:08,210::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:42:08,211::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:42:08,211::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:42:08,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,212::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,213::__init__::225::IOProcess::(_processLogs) (273349) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:42:08,213::__init__::225::IOProcess::(_processLogs) (273349) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:42:08,213::__init__::225::IOProcess::(_processLogs) DEBUG|(273349) Building response >Thread-18::DEBUG::2014-07-08 16:42:08,214::__init__::225::IOProcess::(_processLogs) (273349) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,214::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:42:08,215::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:42:08,216::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:42:08,217::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:42:08,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,217::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,218::__init__::225::IOProcess::(_processLogs) (273350) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:08,218::__init__::225::IOProcess::(_processLogs) (273350) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:08,218::__init__::225::IOProcess::(_processLogs) (273350) Building response >Thread-18::DEBUG::2014-07-08 16:42:08,219::__init__::225::IOProcess::(_processLogs) (273350) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,219::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:08,220::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:42:08,221::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,221::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,222::__init__::225::IOProcess::(_processLogs) (273351) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:42:08,222::__init__::225::IOProcess::(_processLogs) (273351) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:42:08,222::__init__::225::IOProcess::(_processLogs) (273351) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,222::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,223::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:42:08,223::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:42:08,224::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:42:08,224::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:42:08,225::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:08,225::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,225::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,226::__init__::225::IOProcess::(_processLogs) (273352) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:08,226::__init__::225::IOProcess::(_processLogs) (273352) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:08,226::__init__::225::IOProcess::(_processLogs) (273352) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,227::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:42:08,228::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:42:08,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000588329 s, 785 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:42:08,478::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:08,489::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,507::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,518::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,538::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,546::__init__::225::IOProcess::(_processLogs) (273353) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:08,553::__init__::225::IOProcess::(_processLogs) (273353) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:08,562::__init__::225::IOProcess::(_processLogs) (273353) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,567::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,574::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:42:08,596::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:42:08,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,602::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,604::__init__::225::IOProcess::(_processLogs) (273354) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:08,605::__init__::225::IOProcess::(_processLogs) (273354) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:08,606::__init__::225::IOProcess::(_processLogs) (273354) Building response >Thread-18::DEBUG::2014-07-08 16:42:08,607::__init__::225::IOProcess::(_processLogs) (273354) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,609::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,610::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:08,615::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:42:08,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,618::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,623::__init__::225::IOProcess::(_processLogs) (273355) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:08,624::__init__::225::IOProcess::(_processLogs) (273355) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:08,625::__init__::225::IOProcess::(_processLogs) (273355) Building response >Thread-18::DEBUG::2014-07-08 16:42:08,627::__init__::225::IOProcess::(_processLogs) (273355) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,633::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:42:08,635::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:08,636::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:08,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:08,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:08,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:08,641::__init__::225::IOProcess::(_processLogs) (273356) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:08,643::__init__::225::IOProcess::(_processLogs) (273356) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:08,644::__init__::225::IOProcess::(_processLogs) (273356) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:08,645::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:08,646::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6941::DEBUG::2014-07-08 16:42:08,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d0ceacd-b900-4849-9c31-4cfb56f94e78`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:08,876::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:42:08,876::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588329', 'lastCheck': '0.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:42:08,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d0ceacd-b900-4849-9c31-4cfb56f94e78`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588329', 'lastCheck': '0.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:42:08,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d0ceacd-b900-4849-9c31-4cfb56f94e78`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:08,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:08,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:08,877::task::993::Storage.TaskManager.Task::(_decref) Task=`6d0ceacd-b900-4849-9c31-4cfb56f94e78`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:42:09,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:10,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170903 s, 59.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:12,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:12,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173666 s, 59.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:42:14,406::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:42:14,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`f46f5759-9b9d-46db-824d-0bae0c35cdc5`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:14,408::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:42:14,423::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:14,423::task::1191::Storage.TaskManager.Task::(prepare) Task=`f46f5759-9b9d-46db-824d-0bae0c35cdc5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:14,424::task::595::Storage.TaskManager.Task::(_updateState) Task=`f46f5759-9b9d-46db-824d-0bae0c35cdc5`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:14,424::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:14,424::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:14,424::task::993::Storage.TaskManager.Task::(_decref) Task=`f46f5759-9b9d-46db-824d-0bae0c35cdc5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:42:14,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6940::DEBUG::2014-07-08 16:42:14,582::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:42:14,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce6d0761-6bd2-4330-8250-74c6cf51de28`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:42:14,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:42:14,585::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4c0079d0-66e1-411f-97b8-c0a735120f88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:42:14,585::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:42:14,585::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:42:14,586::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4c0079d0-66e1-411f-97b8-c0a735120f88`::Granted request >Thread-6940::DEBUG::2014-07-08 16:42:14,586::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce6d0761-6bd2-4330-8250-74c6cf51de28`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:42:14,587::task::993::Storage.TaskManager.Task::(_decref) Task=`ce6d0761-6bd2-4330-8250-74c6cf51de28`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:42:14,684::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Dummy-6860::DEBUG::2014-07-08 16:42:14,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0217226 s, 47.1 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:42:14,687::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce6d0761-6bd2-4330-8250-74c6cf51de28`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:14,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce6d0761-6bd2-4330-8250-74c6cf51de28`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:42:14,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:42:14,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:42:14,702::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:42:14,706::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:42:14,709::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:42:14,712::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:42:14,719::task::993::Storage.TaskManager.Task::(_decref) Task=`ce6d0761-6bd2-4330-8250-74c6cf51de28`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:42:16,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:17,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175227 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:42:18,652::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:18,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:18,652::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:18,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:18,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:18,653::__init__::225::IOProcess::(_processLogs) (273357) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:18,654::__init__::225::IOProcess::(_processLogs) (273357) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:18,654::__init__::225::IOProcess::(_processLogs) (273357) Building response >Thread-18::DEBUG::2014-07-08 16:42:18,654::__init__::225::IOProcess::(_processLogs) (273357) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:18,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:18,654::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:42:18,656::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:42:18,817::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000640847 s, 721 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:42:18,920::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:18,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:18,930::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:18,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:18,938::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:18,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:18,950::__init__::225::IOProcess::(_processLogs) (273358) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:18,968::__init__::225::IOProcess::(_processLogs) (273358) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:18,971::__init__::225::IOProcess::(_processLogs) (273358) Building response >Thread-18::DEBUG::2014-07-08 16:42:18,975::__init__::225::IOProcess::(_processLogs) (273358) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:18,978::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:18,981::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:42:19,009::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:42:19,012::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:19,017::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:19,022::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:19,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:19,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:19,028::__init__::225::IOProcess::(_processLogs) (273359) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:19,029::__init__::225::IOProcess::(_processLogs) (273359) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:19,031::__init__::225::IOProcess::(_processLogs) (273359) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:19,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:19,033::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:19,036::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:42:19,038::__init__::225::IOProcess::(_processLogs) Marshaling message... >Dummy-6860::DEBUG::2014-07-08 16:42:19,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:42:19,041::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:19,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:19,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:19,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:19,199::__init__::225::IOProcess::(_processLogs) (273360) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:19,200::__init__::225::IOProcess::(_processLogs) (273360) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:19,203::__init__::225::IOProcess::(_processLogs) (273360) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:19,206::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:19,209::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:19,234::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:42:19,237::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:19,242::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:19,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:19,248::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:19,251::__init__::225::IOProcess::(_processLogs) (273361) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:19,254::__init__::225::IOProcess::(_processLogs) (273361) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:19,257::__init__::225::IOProcess::(_processLogs) (273361) Building response >Thread-18::DEBUG::2014-07-08 16:42:19,260::__init__::225::IOProcess::(_processLogs) (273361) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:19,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:19,265::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:42:19,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0840044 s, 12.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:21,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:21,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174526 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:23,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:24,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176552 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:42:24,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`e046e6e7-8aff-43c1-a7cd-4ec2650279cb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:24,160::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:42:24,168::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640847', 'lastCheck': '4.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:42:24,170::task::1191::Storage.TaskManager.Task::(prepare) Task=`e046e6e7-8aff-43c1-a7cd-4ec2650279cb`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640847', 'lastCheck': '4.9', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:42:24,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`e046e6e7-8aff-43c1-a7cd-4ec2650279cb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:24,172::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:24,173::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:24,174::task::993::Storage.TaskManager.Task::(_decref) Task=`e046e6e7-8aff-43c1-a7cd-4ec2650279cb`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:42:24,741::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:42:24,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5f8c380-30d0-40c9-93b4-e2ccd6fe318d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:24,743::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:42:24,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:24,758::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5f8c380-30d0-40c9-93b4-e2ccd6fe318d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:24,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5f8c380-30d0-40c9-93b4-e2ccd6fe318d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:24,758::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:24,758::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:24,759::task::993::Storage.TaskManager.Task::(_decref) Task=`e5f8c380-30d0-40c9-93b4-e2ccd6fe318d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:42:24,770::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:42:24,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`6130e5c4-539c-486c-89dc-de2bae75ac26`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:42:24,771::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:42:24,772::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b43a295e-9194-4719-b0d0-746a7af7446c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:42:24,772::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:42:24,773::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:42:24,773::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b43a295e-9194-4719-b0d0-746a7af7446c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:42:24,774::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6130e5c4-539c-486c-89dc-de2bae75ac26`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:42:24,774::task::993::Storage.TaskManager.Task::(_decref) Task=`6130e5c4-539c-486c-89dc-de2bae75ac26`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:42:24,792::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:24,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`6130e5c4-539c-486c-89dc-de2bae75ac26`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:24,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`6130e5c4-539c-486c-89dc-de2bae75ac26`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:42:24,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:42:24,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:42:24,794::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:42:24,794::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:42:24,795::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:42:24,795::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:42:24,795::task::993::Storage.TaskManager.Task::(_decref) Task=`6130e5c4-539c-486c-89dc-de2bae75ac26`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:42:26,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:26,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174987 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:28,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:28,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173062 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:42:29,330::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:29,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:29,331::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:29,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:29,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:29,332::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:29,333::__init__::225::IOProcess::(_processLogs) (273362) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:29,333::__init__::225::IOProcess::(_processLogs) (273362) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:29,333::__init__::225::IOProcess::(_processLogs) (273362) Building response >Thread-18::DEBUG::2014-07-08 16:42:29,333::__init__::225::IOProcess::(_processLogs) (273362) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:29,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:29,334::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:42:29,339::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:42:29,491::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000554805 s, 833 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:42:29,493::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:29,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:29,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:29,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:29,495::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:29,495::__init__::225::IOProcess::(_processLogs) (273363) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:29,495::__init__::225::IOProcess::(_processLogs) (273363) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:29,496::__init__::225::IOProcess::(_processLogs) (273363) Building response >Thread-18::DEBUG::2014-07-08 16:42:29,496::__init__::225::IOProcess::(_processLogs) (273363) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:29,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:29,496::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:42:29,498::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:42:29,499::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:29,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:29,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:29,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:29,500::__init__::225::IOProcess::(_processLogs) (273364) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:29,500::__init__::225::IOProcess::(_processLogs) (273364) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:29,500::__init__::225::IOProcess::(_processLogs) (273364) Building response >Thread-18::DEBUG::2014-07-08 16:42:29,501::__init__::225::IOProcess::(_processLogs) (273364) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:29,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:29,501::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:29,502::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:42:29,502::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:29,503::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:29,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:29,503::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:29,503::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:29,504::__init__::225::IOProcess::(_processLogs) (273365) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:29,504::__init__::225::IOProcess::(_processLogs) (273365) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:29,504::__init__::225::IOProcess::(_processLogs) (273365) Building response >Thread-18::DEBUG::2014-07-08 16:42:29,504::__init__::225::IOProcess::(_processLogs) (273365) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:29,505::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:29,505::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:29,506::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:42:29,506::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:42:29,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:29,507::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:29,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:29,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:29,507::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:29,508::__init__::225::IOProcess::(_processLogs) (273366) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:29,508::__init__::225::IOProcess::(_processLogs) (273366) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:29,508::__init__::225::IOProcess::(_processLogs) (273366) Building response >Thread-18::DEBUG::2014-07-08 16:42:29,508::__init__::225::IOProcess::(_processLogs) (273366) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:29,509::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:29,509::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:42:30,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:31,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171811 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:33,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:33,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041464 s, 24.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:42:34,811::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:42:34,815::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6fc388c-bdfa-4c6e-a01e-3e6389c55897`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:34,816::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:42:34,832::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:34,833::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6fc388c-bdfa-4c6e-a01e-3e6389c55897`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:34,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6fc388c-bdfa-4c6e-a01e-3e6389c55897`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:34,835::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:34,836::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:34,837::task::993::Storage.TaskManager.Task::(_decref) Task=`b6fc388c-bdfa-4c6e-a01e-3e6389c55897`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:42:34,852::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:42:34,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7cb3c25-0172-4539-9419-81787142ed8a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:42:34,856::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:42:34,859::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0cffcfdb-2078-444e-ad8c-68fb69005d6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:42:34,860::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:42:34,862::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:42:34,863::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0cffcfdb-2078-444e-ad8c-68fb69005d6c`::Granted request >Thread-6940::DEBUG::2014-07-08 16:42:34,866::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a7cb3c25-0172-4539-9419-81787142ed8a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:42:34,867::task::993::Storage.TaskManager.Task::(_decref) Task=`a7cb3c25-0172-4539-9419-81787142ed8a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:42:34,897::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:34,898::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7cb3c25-0172-4539-9419-81787142ed8a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:34,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7cb3c25-0172-4539-9419-81787142ed8a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:42:34,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:42:34,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:42:34,902::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:42:34,903::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:42:34,904::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:42:34,904::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:42:34,906::task::993::Storage.TaskManager.Task::(_decref) Task=`a7cb3c25-0172-4539-9419-81787142ed8a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:42:35,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:35,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174755 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:37,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:37,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173129 s, 59.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:42:39,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`91bacf51-df76-4e96-a5ff-ea23c8616e58`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:39,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:42:39,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554805', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:42:39,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`91bacf51-df76-4e96-a5ff-ea23c8616e58`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554805', 'lastCheck': '9.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:42:39,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`91bacf51-df76-4e96-a5ff-ea23c8616e58`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:39,348::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:39,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:39,348::task::993::Storage.TaskManager.Task::(_decref) Task=`91bacf51-df76-4e96-a5ff-ea23c8616e58`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:42:39,512::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:39,512::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:39,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:39,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:39,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:39,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:39,513::__init__::225::IOProcess::(_processLogs) (273367) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:39,514::__init__::225::IOProcess::(_processLogs) (273367) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:39,514::__init__::225::IOProcess::(_processLogs) (273367) Building response >Thread-18::DEBUG::2014-07-08 16:42:39,514::__init__::225::IOProcess::(_processLogs) (273367) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:39,514::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:39,515::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:42:39,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:42:39,668::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000506196 s, 913 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:42:39,676::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:39,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:39,757::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:39,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:39,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:39,764::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:39,768::__init__::225::IOProcess::(_processLogs) (273368) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:39,771::__init__::225::IOProcess::(_processLogs) (273368) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:39,773::__init__::225::IOProcess::(_processLogs) (273368) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:39,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:39,781::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:42:39,799::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:42:39,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:39,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:39,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:39,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:39,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:39,807::__init__::225::IOProcess::(_processLogs) (273369) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:39,808::__init__::225::IOProcess::(_processLogs) (273369) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:39,810::__init__::225::IOProcess::(_processLogs) (273369) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:39,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:39,813::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:39,818::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:42:39,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:39,821::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:39,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:39,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:39,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:39,825::__init__::225::IOProcess::(_processLogs) (273370) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:39,826::__init__::225::IOProcess::(_processLogs) (273370) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:39,828::__init__::225::IOProcess::(_processLogs) (273370) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:39,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:39,830::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:39,835::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:42:39,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:39,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:39,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:39,842::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:39,844::__init__::225::IOProcess::(_processLogs) (273371) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:39,846::__init__::225::IOProcess::(_processLogs) (273371) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:39,848::__init__::225::IOProcess::(_processLogs) (273371) Building response >Thread-18::DEBUG::2014-07-08 16:42:39,849::__init__::225::IOProcess::(_processLogs) (273371) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:39,853::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:39,854::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:42:39,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:40,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0432449 s, 23.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:42,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:42,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017342 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:44,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:44,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174414 s, 58.7 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:42:44,943::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:42:44,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a7982d-62b6-4dd0-b8c8-c4cbaeee1760`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:44,946::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:42:44,961::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:44,962::task::1191::Storage.TaskManager.Task::(prepare) Task=`12a7982d-62b6-4dd0-b8c8-c4cbaeee1760`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:44,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a7982d-62b6-4dd0-b8c8-c4cbaeee1760`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:44,962::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:44,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:44,966::task::993::Storage.TaskManager.Task::(_decref) Task=`12a7982d-62b6-4dd0-b8c8-c4cbaeee1760`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:42:44,977::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:42:44,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c069aeb-408a-4bf0-9b73-614aee082002`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:42:44,979::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:42:44,980::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24d015f6-cd7f-49cd-a37f-5b22c493a0a7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:42:44,981::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:42:44,981::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:42:44,981::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24d015f6-cd7f-49cd-a37f-5b22c493a0a7`::Granted request >Thread-6940::DEBUG::2014-07-08 16:42:44,982::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c069aeb-408a-4bf0-9b73-614aee082002`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:42:44,983::task::993::Storage.TaskManager.Task::(_decref) Task=`6c069aeb-408a-4bf0-9b73-614aee082002`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:42:45,002::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:45,003::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c069aeb-408a-4bf0-9b73-614aee082002`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:45,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c069aeb-408a-4bf0-9b73-614aee082002`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:42:45,003::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:42:45,004::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:42:45,004::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:42:45,004::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:42:45,005::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:42:45,005::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:42:45,005::task::993::Storage.TaskManager.Task::(_decref) Task=`6c069aeb-408a-4bf0-9b73-614aee082002`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:42:46,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:46,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176376 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:49,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:49,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177127 s, 57.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:42:49,861::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:49,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:49,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:42:49,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:49,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:49,863::__init__::225::IOProcess::(_processLogs) (273372) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:49,863::__init__::225::IOProcess::(_processLogs) (273372) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:49,864::__init__::225::IOProcess::(_processLogs) (273372) Building response >Thread-18::DEBUG::2014-07-08 16:42:49,864::__init__::225::IOProcess::(_processLogs) (273372) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:49,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:49,864::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:42:49,866::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:42:50,013::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000426021 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:42:50,015::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:42:50,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:50,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:50,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:50,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:50,017::__init__::225::IOProcess::(_processLogs) (273373) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:42:50,017::__init__::225::IOProcess::(_processLogs) (273373) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:42:50,017::__init__::225::IOProcess::(_processLogs) (273373) Building response >Thread-18::DEBUG::2014-07-08 16:42:50,017::__init__::225::IOProcess::(_processLogs) (273373) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:50,018::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:42:50,020::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:42:50,020::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:50,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:50,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:50,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:50,021::__init__::225::IOProcess::(_processLogs) (273374) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:50,021::__init__::225::IOProcess::(_processLogs) (273374) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:50,021::__init__::225::IOProcess::(_processLogs) (273374) Building response >Thread-18::DEBUG::2014-07-08 16:42:50,022::__init__::225::IOProcess::(_processLogs) (273374) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:50,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:50,022::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:50,023::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:42:50,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:50,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:50,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:50,024::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:50,025::__init__::225::IOProcess::(_processLogs) (273375) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:50,025::__init__::225::IOProcess::(_processLogs) (273375) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:50,025::__init__::225::IOProcess::(_processLogs) (273375) Building response >Thread-18::DEBUG::2014-07-08 16:42:50,025::__init__::225::IOProcess::(_processLogs) (273375) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:50,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:50,026::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:42:50,027::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:42:50,027::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:42:50,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:42:50,028::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:42:50,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:42:50,028::__init__::225::IOProcess::(_processLogs) (273376) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:42:50,028::__init__::225::IOProcess::(_processLogs) (273376) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:42:50,029::__init__::225::IOProcess::(_processLogs) (273376) Building response >Thread-18::DEBUG::2014-07-08 16:42:50,029::__init__::225::IOProcess::(_processLogs) (273376) Queuing response >Thread-18::DEBUG::2014-07-08 16:42:50,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:42:50,029::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:42:51,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:51,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175208 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:53,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:53,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175434 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:42:54,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`62524e70-f209-49be-8316-19244edfffcb`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:54,614::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:42:54,615::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426021', 'lastCheck': '4.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:42:54,615::task::1191::Storage.TaskManager.Task::(prepare) Task=`62524e70-f209-49be-8316-19244edfffcb`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426021', 'lastCheck': '4.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:42:54,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`62524e70-f209-49be-8316-19244edfffcb`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:54,615::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:54,616::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:54,616::task::993::Storage.TaskManager.Task::(_decref) Task=`62524e70-f209-49be-8316-19244edfffcb`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:42:55,018::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:42:55,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`421f0913-1a3a-49ba-bca6-28d234a41ac0`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:42:55,019::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:42:55,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:55,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`421f0913-1a3a-49ba-bca6-28d234a41ac0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:42:55,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`421f0913-1a3a-49ba-bca6-28d234a41ac0`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:42:55,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:42:55,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:42:55,035::task::993::Storage.TaskManager.Task::(_decref) Task=`421f0913-1a3a-49ba-bca6-28d234a41ac0`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:42:55,047::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:42:55,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`e00bd832-e8c2-4c61-9d9c-73c717d65d51`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:42:55,048::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:42:55,053::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4451b0f7-fbb5-4fcc-8773-63194fe5bef7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:42:55,054::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:42:55,054::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:42:55,054::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4451b0f7-fbb5-4fcc-8773-63194fe5bef7`::Granted request >Thread-6940::DEBUG::2014-07-08 16:42:55,055::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e00bd832-e8c2-4c61-9d9c-73c717d65d51`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:42:55,055::task::993::Storage.TaskManager.Task::(_decref) Task=`e00bd832-e8c2-4c61-9d9c-73c717d65d51`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:42:55,074::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:55,075::task::1191::Storage.TaskManager.Task::(prepare) Task=`e00bd832-e8c2-4c61-9d9c-73c717d65d51`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:42:55,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`e00bd832-e8c2-4c61-9d9c-73c717d65d51`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:42:55,075::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:42:55,075::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:42:55,076::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:42:55,076::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:42:55,076::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:42:55,077::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:42:55,077::task::993::Storage.TaskManager.Task::(_decref) Task=`e00bd832-e8c2-4c61-9d9c-73c717d65d51`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:42:55,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:56,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179096 s, 57.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:42:58,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:42:58,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0202719 s, 50.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:00,032::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:00,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:00,033::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:00,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:00,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:00,034::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:00,034::__init__::225::IOProcess::(_processLogs) (273377) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:00,034::__init__::225::IOProcess::(_processLogs) (273377) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:00,035::__init__::225::IOProcess::(_processLogs) (273377) Building response >Thread-18::DEBUG::2014-07-08 16:43:00,035::__init__::225::IOProcess::(_processLogs) (273377) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:00,035::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:00,035::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:43:00,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:43:00,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000474908 s, 973 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:00,189::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:00,190::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:00,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:00,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:00,190::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:00,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:00,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:00,192::__init__::225::IOProcess::(_processLogs) (273378) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:00,192::__init__::225::IOProcess::(_processLogs) (273378) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:00,192::__init__::225::IOProcess::(_processLogs) (273378) Building response >Thread-18::DEBUG::2014-07-08 16:43:00,192::__init__::225::IOProcess::(_processLogs) (273378) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:00,193::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:00,193::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:43:00,195::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:00,195::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:43:00,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:00,196::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:00,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:00,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:00,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:00,197::__init__::225::IOProcess::(_processLogs) (273379) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:00,197::__init__::225::IOProcess::(_processLogs) (273379) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:00,198::__init__::225::IOProcess::(_processLogs) (273379) Building response >Thread-18::DEBUG::2014-07-08 16:43:00,198::__init__::225::IOProcess::(_processLogs) (273379) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:00,198::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:00,198::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:00,199::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:00,200::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:43:00,200::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:00,200::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:00,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:00,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:00,202::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:00,202::__init__::225::IOProcess::(_processLogs) (273380) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:00,203::__init__::225::IOProcess::(_processLogs) (273380) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:00,203::__init__::225::IOProcess::(_processLogs) (273380) Building response >Thread-18::DEBUG::2014-07-08 16:43:00,203::__init__::225::IOProcess::(_processLogs) (273380) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:00,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:00,204::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:00,205::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:00,205::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:43:00,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:00,206::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:00,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:00,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:00,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:00,207::__init__::225::IOProcess::(_processLogs) (273381) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:00,207::__init__::225::IOProcess::(_processLogs) (273381) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:00,207::__init__::225::IOProcess::(_processLogs) (273381) Building response >Thread-18::DEBUG::2014-07-08 16:43:00,207::__init__::225::IOProcess::(_processLogs) (273381) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:00,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:00,208::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:43:00,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:00,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176121 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:02,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:02,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178155 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:05,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:43:05,165::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:43:05,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a749bf7-e508-4870-9585-557d756b28a3`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:43:05,171::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:43:05,193::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:05,194::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a749bf7-e508-4870-9585-557d756b28a3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:05,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a749bf7-e508-4870-9585-557d756b28a3`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:43:05,196::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:43:05,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:43:05,198::task::993::Storage.TaskManager.Task::(_decref) Task=`1a749bf7-e508-4870-9585-557d756b28a3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:43:05,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419568 s, 24.4 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:43:05,289::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:43:05,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7da6806-7989-4f63-8108-e7cebe20a1a8`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:43:05,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:43:05,295::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a9539b0f-ff5a-4499-9ab1-8ee56e5dbc04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:43:05,295::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:43:05,297::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:43:05,298::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a9539b0f-ff5a-4499-9ab1-8ee56e5dbc04`::Granted request >Thread-6940::DEBUG::2014-07-08 16:43:05,300::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b7da6806-7989-4f63-8108-e7cebe20a1a8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:43:05,301::task::993::Storage.TaskManager.Task::(_decref) Task=`b7da6806-7989-4f63-8108-e7cebe20a1a8`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:43:05,345::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:05,345::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7da6806-7989-4f63-8108-e7cebe20a1a8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:05,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7da6806-7989-4f63-8108-e7cebe20a1a8`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:43:05,346::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:43:05,346::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:43:05,346::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:43:05,347::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:43:05,347::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:43:05,347::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:43:05,347::task::993::Storage.TaskManager.Task::(_decref) Task=`b7da6806-7989-4f63-8108-e7cebe20a1a8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:43:07,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:07,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017406 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:09,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:43:09,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`4420e781-4290-4183-aa92-edbb66f63024`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:43:09,802::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:43:09,806::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474908', 'lastCheck': '9.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:43:09,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`4420e781-4290-4183-aa92-edbb66f63024`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474908', 'lastCheck': '9.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:43:09,813::task::595::Storage.TaskManager.Task::(_updateState) Task=`4420e781-4290-4183-aa92-edbb66f63024`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:43:09,815::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:43:09,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:43:09,821::task::993::Storage.TaskManager.Task::(_decref) Task=`4420e781-4290-4183-aa92-edbb66f63024`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:43:09,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101822 s, 10.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:10,211::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:10,211::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:10,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:10,213::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:10,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:10,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:10,214::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:10,214::__init__::225::IOProcess::(_processLogs) (273382) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:10,214::__init__::225::IOProcess::(_processLogs) (273382) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:10,214::__init__::225::IOProcess::(_processLogs) (273382) Building response >Thread-18::DEBUG::2014-07-08 16:43:10,215::__init__::225::IOProcess::(_processLogs) (273382) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:10,215::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:10,215::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:43:10,217::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:43:10,378::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000641127 s, 721 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:10,385::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:10,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:10,389::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:10,390::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:10,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:10,393::__init__::225::IOProcess::(_processLogs) (273383) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:10,394::__init__::225::IOProcess::(_processLogs) (273383) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:10,396::__init__::225::IOProcess::(_processLogs) (273383) Building response >Thread-18::DEBUG::2014-07-08 16:43:10,397::__init__::225::IOProcess::(_processLogs) (273383) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:10,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:10,399::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:43:10,412::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:43:10,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:10,415::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:10,417::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:10,418::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:10,419::__init__::225::IOProcess::(_processLogs) (273384) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:10,421::__init__::225::IOProcess::(_processLogs) (273384) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:10,422::__init__::225::IOProcess::(_processLogs) (273384) Building response >Thread-18::DEBUG::2014-07-08 16:43:10,423::__init__::225::IOProcess::(_processLogs) (273384) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:10,425::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:10,426::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:10,432::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:43:10,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:10,434::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:10,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:10,437::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:10,439::__init__::225::IOProcess::(_processLogs) (273385) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:10,440::__init__::225::IOProcess::(_processLogs) (273385) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:10,442::__init__::225::IOProcess::(_processLogs) (273385) Building response >Thread-18::DEBUG::2014-07-08 16:43:10,443::__init__::225::IOProcess::(_processLogs) (273385) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:10,444::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:10,445::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:10,451::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:43:10,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:10,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:10,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:10,456::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:10,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:10,459::__init__::225::IOProcess::(_processLogs) (273386) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:10,460::__init__::225::IOProcess::(_processLogs) (273386) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:10,461::__init__::225::IOProcess::(_processLogs) (273386) Building response >Thread-18::DEBUG::2014-07-08 16:43:10,462::__init__::225::IOProcess::(_processLogs) (273386) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:10,464::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:10,465::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:43:11,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:12,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017076 s, 60.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:14,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:14,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175686 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:43:15,363::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:43:15,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eb6db0e-5d65-4173-965e-e61ddc643a6a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:43:15,365::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:43:15,380::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:15,380::task::1191::Storage.TaskManager.Task::(prepare) Task=`3eb6db0e-5d65-4173-965e-e61ddc643a6a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:15,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eb6db0e-5d65-4173-965e-e61ddc643a6a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:43:15,381::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:43:15,381::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:43:15,381::task::993::Storage.TaskManager.Task::(_decref) Task=`3eb6db0e-5d65-4173-965e-e61ddc643a6a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:43:15,393::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:43:15,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`68ef45b8-8f14-4f7b-a6f7-c1ca3dd9dcbf`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:43:15,394::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:43:15,395::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b9c3e3e1-db44-4398-b672-2d697c0e8419`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:43:15,395::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:43:15,396::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:43:15,396::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b9c3e3e1-db44-4398-b672-2d697c0e8419`::Granted request >Thread-6940::DEBUG::2014-07-08 16:43:15,397::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`68ef45b8-8f14-4f7b-a6f7-c1ca3dd9dcbf`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:43:15,397::task::993::Storage.TaskManager.Task::(_decref) Task=`68ef45b8-8f14-4f7b-a6f7-c1ca3dd9dcbf`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:43:15,416::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:15,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`68ef45b8-8f14-4f7b-a6f7-c1ca3dd9dcbf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:15,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`68ef45b8-8f14-4f7b-a6f7-c1ca3dd9dcbf`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:43:15,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:43:15,417::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:43:15,418::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:43:15,418::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:43:15,419::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:43:15,419::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:43:15,419::task::993::Storage.TaskManager.Task::(_decref) Task=`68ef45b8-8f14-4f7b-a6f7-c1ca3dd9dcbf`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:43:16,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:16,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01743 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:18,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:19,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017773 s, 57.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:20,471::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:20,471::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:20,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:20,472::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:20,472::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:20,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:20,473::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:20,473::__init__::225::IOProcess::(_processLogs) (273387) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:20,473::__init__::225::IOProcess::(_processLogs) (273387) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:20,473::__init__::225::IOProcess::(_processLogs) (273387) Building response >Thread-18::DEBUG::2014-07-08 16:43:20,473::__init__::225::IOProcess::(_processLogs) (273387) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:20,474::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:20,474::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:43:20,476::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:43:20,623::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000476305 s, 970 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:20,630::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:20,632::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:20,633::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:20,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:20,636::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:20,637::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:20,638::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:20,640::__init__::225::IOProcess::(_processLogs) (273388) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:20,641::__init__::225::IOProcess::(_processLogs) (273388) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:20,642::__init__::225::IOProcess::(_processLogs) (273388) Building response >Thread-18::DEBUG::2014-07-08 16:43:20,643::__init__::225::IOProcess::(_processLogs) (273388) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:20,645::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:20,646::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:43:20,655::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:20,657::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:43:20,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:20,659::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:20,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:20,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:20,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:20,664::__init__::225::IOProcess::(_processLogs) (273389) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:20,665::__init__::225::IOProcess::(_processLogs) (273389) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:20,667::__init__::225::IOProcess::(_processLogs) DEBUG|(273389) Building response >Thread-18::DEBUG::2014-07-08 16:43:20,668::__init__::225::IOProcess::(_processLogs) (273389) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:20,670::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:20,672::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:20,677::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:20,678::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:43:20,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:20,680::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:20,682::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:20,683::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:20,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:20,686::__init__::225::IOProcess::(_processLogs) (273390) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:20,687::__init__::225::IOProcess::(_processLogs) (273390) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:20,688::__init__::225::IOProcess::(_processLogs) (273390) Building response >Thread-18::DEBUG::2014-07-08 16:43:20,689::__init__::225::IOProcess::(_processLogs) (273390) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:20,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:20,692::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:20,700::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:20,702::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:43:20,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:20,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:20,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:20,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:20,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:20,709::__init__::225::IOProcess::(_processLogs) (273391) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:20,710::__init__::225::IOProcess::(_processLogs) (273391) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:20,712::__init__::225::IOProcess::(_processLogs) DEBUG|(273391) Building response >Thread-18::DEBUG::2014-07-08 16:43:20,713::__init__::225::IOProcess::(_processLogs) (273391) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:20,715::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:20,716::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:43:21,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:21,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0874296 s, 11.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:23,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:23,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176457 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:43:25,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b27c215-d7cb-40bd-888d-87f6844c961a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:43:25,107::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:43:25,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476305', 'lastCheck': '4.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:43:25,108::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b27c215-d7cb-40bd-888d-87f6844c961a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476305', 'lastCheck': '4.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:43:25,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b27c215-d7cb-40bd-888d-87f6844c961a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:43:25,109::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:43:25,109::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:43:25,109::task::993::Storage.TaskManager.Task::(_decref) Task=`0b27c215-d7cb-40bd-888d-87f6844c961a`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:43:25,434::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:43:25,435::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cff2b68-479c-4381-8769-8a7313c9065a`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:43:25,435::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:43:25,450::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:25,450::task::1191::Storage.TaskManager.Task::(prepare) Task=`5cff2b68-479c-4381-8769-8a7313c9065a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:25,451::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cff2b68-479c-4381-8769-8a7313c9065a`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:43:25,451::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:43:25,451::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:43:25,451::task::993::Storage.TaskManager.Task::(_decref) Task=`5cff2b68-479c-4381-8769-8a7313c9065a`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:43:25,463::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:43:25,463::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb3a7648-fccc-4238-81f2-b86142bd278c`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:43:25,464::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:43:25,465::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`452c456d-44ba-4c7f-9494-860f9ee4db80`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:43:25,465::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:43:25,465::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:43:25,466::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`452c456d-44ba-4c7f-9494-860f9ee4db80`::Granted request >Thread-6940::DEBUG::2014-07-08 16:43:25,466::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bb3a7648-fccc-4238-81f2-b86142bd278c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:43:25,467::task::993::Storage.TaskManager.Task::(_decref) Task=`bb3a7648-fccc-4238-81f2-b86142bd278c`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:43:25,486::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:25,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb3a7648-fccc-4238-81f2-b86142bd278c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:25,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb3a7648-fccc-4238-81f2-b86142bd278c`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:43:25,487::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:43:25,487::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:43:25,487::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:43:25,488::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:43:25,488::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:43:25,488::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:43:25,489::task::993::Storage.TaskManager.Task::(_decref) Task=`bb3a7648-fccc-4238-81f2-b86142bd278c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:43:25,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:25,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175565 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:27,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:28,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351578 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:30,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:30,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0194486 s, 52.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:30,722::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:30,723::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:30,723::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:30,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:30,723::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:30,724::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:30,724::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:30,724::__init__::225::IOProcess::(_processLogs) (273392) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:30,724::__init__::225::IOProcess::(_processLogs) (273392) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:30,725::__init__::225::IOProcess::(_processLogs) (273392) Building response >Thread-18::DEBUG::2014-07-08 16:43:30,725::__init__::225::IOProcess::(_processLogs) (273392) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:30,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:30,725::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:43:30,727::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:43:30,876::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000488319 s, 946 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:30,882::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:30,885::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:30,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:30,889::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:30,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:30,892::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:30,893::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:30,895::__init__::225::IOProcess::(_processLogs) (273393) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:30,897::__init__::225::IOProcess::(_processLogs) (273393) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:30,898::__init__::225::IOProcess::(_processLogs) (273393) Building response >Thread-18::DEBUG::2014-07-08 16:43:30,900::__init__::225::IOProcess::(_processLogs) (273393) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:30,901::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:30,903::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:43:30,911::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:30,913::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:43:30,915::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:30,917::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:30,918::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:30,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:30,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:30,923::__init__::225::IOProcess::(_processLogs) (273394) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:30,924::__init__::225::IOProcess::(_processLogs) (273394) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:30,926::__init__::225::IOProcess::(_processLogs) (273394) Building response >Thread-18::DEBUG::2014-07-08 16:43:30,927::__init__::225::IOProcess::(_processLogs) (273394) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:30,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:30,930::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:30,935::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:30,936::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:43:30,938::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:30,939::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:30,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:30,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:30,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:30,944::__init__::225::IOProcess::(_processLogs) (273395) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:30,946::__init__::225::IOProcess::(_processLogs) DEBUG|(273395) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:30,947::__init__::225::IOProcess::(_processLogs) (273395) Building response >Thread-18::DEBUG::2014-07-08 16:43:30,948::__init__::225::IOProcess::(_processLogs) (273395) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:30,949::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:30,951::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:30,956::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:30,957::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:43:30,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:30,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:30,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:30,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:30,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:30,965::__init__::225::IOProcess::(_processLogs) (273396) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:30,967::__init__::225::IOProcess::(_processLogs) (273396) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:30,968::__init__::225::IOProcess::(_processLogs) (273396) Building response >Thread-18::DEBUG::2014-07-08 16:43:30,970::__init__::225::IOProcess::(_processLogs) (273396) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:30,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:30,972::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:43:32,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:32,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176093 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:34,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:35,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0754309 s, 13.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:43:35,501::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:43:35,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`3dddcf00-a755-4c56-98fd-d295061c8223`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:43:35,503::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:43:35,517::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:35,518::task::1191::Storage.TaskManager.Task::(prepare) Task=`3dddcf00-a755-4c56-98fd-d295061c8223`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:35,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`3dddcf00-a755-4c56-98fd-d295061c8223`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:43:35,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:43:35,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:43:35,519::task::993::Storage.TaskManager.Task::(_decref) Task=`3dddcf00-a755-4c56-98fd-d295061c8223`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:43:35,530::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:43:35,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e6d9dfe-5dac-46e4-a0b9-36e25f0e0ec6`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:43:35,531::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:43:35,532::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e88bcbc6-c743-45d4-b33c-92c5758f00dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:43:35,533::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:43:35,533::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:43:35,534::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e88bcbc6-c743-45d4-b33c-92c5758f00dd`::Granted request >Thread-6940::DEBUG::2014-07-08 16:43:35,534::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0e6d9dfe-5dac-46e4-a0b9-36e25f0e0ec6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:43:35,535::task::993::Storage.TaskManager.Task::(_decref) Task=`0e6d9dfe-5dac-46e4-a0b9-36e25f0e0ec6`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:43:35,553::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:35,554::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e6d9dfe-5dac-46e4-a0b9-36e25f0e0ec6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:35,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e6d9dfe-5dac-46e4-a0b9-36e25f0e0ec6`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:43:35,554::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:43:35,555::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:43:35,555::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:43:35,555::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:43:35,556::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:43:35,556::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:43:35,556::task::993::Storage.TaskManager.Task::(_decref) Task=`0e6d9dfe-5dac-46e4-a0b9-36e25f0e0ec6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:43:37,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:37,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018615 s, 55.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:39,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:39,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175579 s, 58.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:43:40,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd461dae-4233-4261-bdc7-c6e8d562609f`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:43:40,372::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:43:40,373::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488319', 'lastCheck': '9.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:43:40,373::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd461dae-4233-4261-bdc7-c6e8d562609f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488319', 'lastCheck': '9.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:43:40,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd461dae-4233-4261-bdc7-c6e8d562609f`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:43:40,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:43:40,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:43:40,374::task::993::Storage.TaskManager.Task::(_decref) Task=`fd461dae-4233-4261-bdc7-c6e8d562609f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:43:40,977::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:40,978::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:40,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:40,978::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:40,979::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:40,979::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:40,979::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:40,979::__init__::225::IOProcess::(_processLogs) (273397) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:40,980::__init__::225::IOProcess::(_processLogs) (273397) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:40,980::__init__::225::IOProcess::(_processLogs) (273397) Building response >Thread-18::DEBUG::2014-07-08 16:43:40,980::__init__::225::IOProcess::(_processLogs) (273397) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:40,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:40,981::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:43:40,982::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:43:41,130::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000418757 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:41,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:41,137::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:41,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:41,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:41,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:41,142::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:41,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:41,144::__init__::225::IOProcess::(_processLogs) (273398) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:41,146::__init__::225::IOProcess::(_processLogs) (273398) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:41,148::__init__::225::IOProcess::(_processLogs) (273398) Building response >Thread-18::DEBUG::2014-07-08 16:43:41,149::__init__::225::IOProcess::(_processLogs) (273398) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:41,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:41,152::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:43:41,161::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:41,163::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:43:41,164::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:41,166::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:41,167::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:41,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:41,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:41,171::__init__::225::IOProcess::(_processLogs) (273399) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:41,173::__init__::225::IOProcess::(_processLogs) (273399) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:41,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(273399) Building response >Thread-18::DEBUG::2014-07-08 16:43:41,176::__init__::225::IOProcess::(_processLogs) (273399) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:41,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:41,179::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:41,184::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:41,185::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:43:41,186::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:41,188::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:41,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:41,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:41,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:41,194::__init__::225::IOProcess::(_processLogs) (273400) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:41,195::__init__::225::IOProcess::(_processLogs) (273400) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:41,196::__init__::225::IOProcess::(_processLogs) (273400) Building response >Thread-18::DEBUG::2014-07-08 16:43:41,197::__init__::225::IOProcess::(_processLogs) (273400) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:41,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:41,200::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:41,205::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:43:41,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:41,208::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:41,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:41,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:41,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:41,214::__init__::225::IOProcess::(_processLogs) (273401) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:41,216::__init__::225::IOProcess::(_processLogs) (273401) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:41,217::__init__::225::IOProcess::(_processLogs) (273401) Building response >Thread-18::DEBUG::2014-07-08 16:43:41,218::__init__::225::IOProcess::(_processLogs) (273401) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:41,221::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:43:41,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:42,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902223 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:44,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:44,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330992 s, 30.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:43:45,569::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:43:45,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a41edac-8dec-4960-98ed-a0e251fe3552`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:43:45,571::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:43:45,586::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:45,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a41edac-8dec-4960-98ed-a0e251fe3552`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:43:45,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a41edac-8dec-4960-98ed-a0e251fe3552`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:43:45,587::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:43:45,587::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:43:45,587::task::993::Storage.TaskManager.Task::(_decref) Task=`2a41edac-8dec-4960-98ed-a0e251fe3552`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:43:45,598::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:43:45,599::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ffd42ae-df32-4a27-b4ac-60724c4d405a`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:43:45,600::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:43:45,601::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0e432752-8034-47ef-9782-d6a7d108efa0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:43:45,601::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:43:45,601::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:43:45,602::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0e432752-8034-47ef-9782-d6a7d108efa0`::Granted request >Thread-6940::DEBUG::2014-07-08 16:43:45,602::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9ffd42ae-df32-4a27-b4ac-60724c4d405a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:43:45,603::task::993::Storage.TaskManager.Task::(_decref) Task=`9ffd42ae-df32-4a27-b4ac-60724c4d405a`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:43:45,622::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:45,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ffd42ae-df32-4a27-b4ac-60724c4d405a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:45,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ffd42ae-df32-4a27-b4ac-60724c4d405a`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:43:45,623::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:43:45,623::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:43:45,623::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:43:45,624::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:43:45,624::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:43:45,624::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:43:45,624::task::993::Storage.TaskManager.Task::(_decref) Task=`9ffd42ae-df32-4a27-b4ac-60724c4d405a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:43:46,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:46,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274603 s, 37.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:48,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:48,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176563 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:50,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:51,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174303 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:51,227::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:51,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:51,227::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:51,227::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:51,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:51,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:51,228::__init__::225::IOProcess::(_processLogs) (273402) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:51,228::__init__::225::IOProcess::(_processLogs) (273402) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:51,229::__init__::225::IOProcess::(_processLogs) (273402) Building response >Thread-18::DEBUG::2014-07-08 16:43:51,229::__init__::225::IOProcess::(_processLogs) (273402) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:51,229::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:51,229::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:43:51,231::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:43:51,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00069197 s, 668 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:43:51,390::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:43:51,392::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:43:51,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:51,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:51,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:51,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:51,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:51,406::__init__::225::IOProcess::(_processLogs) (273403) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:43:51,407::__init__::225::IOProcess::(_processLogs) (273403) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:43:51,409::__init__::225::IOProcess::(_processLogs) (273403) Building response >Thread-18::DEBUG::2014-07-08 16:43:51,410::__init__::225::IOProcess::(_processLogs) (273403) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:51,411::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:51,412::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:43:51,421::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:43:51,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:51,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:51,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:43:51,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:51,428::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:51,429::__init__::225::IOProcess::(_processLogs) (273404) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:51,430::__init__::225::IOProcess::(_processLogs) (273404) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:51,432::__init__::225::IOProcess::(_processLogs) (273404) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:51,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:51,434::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:51,439::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:43:51,440::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:51,441::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:51,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:51,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:51,446::__init__::225::IOProcess::(_processLogs) (273405) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:51,447::__init__::225::IOProcess::(_processLogs) (273405) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:51,449::__init__::225::IOProcess::(_processLogs) (273405) Building response >Thread-18::DEBUG::2014-07-08 16:43:51,450::__init__::225::IOProcess::(_processLogs) (273405) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:51,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:51,452::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:43:51,457::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:43:51,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:43:51,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:43:51,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:43:51,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:43:51,464::__init__::225::IOProcess::(_processLogs) (273406) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:43:51,465::__init__::225::IOProcess::(_processLogs) (273406) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:43:51,467::__init__::225::IOProcess::(_processLogs) (273406) Building response >Thread-18::DEBUG::2014-07-08 16:43:51,468::__init__::225::IOProcess::(_processLogs) (273406) Queuing response >Thread-18::DEBUG::2014-07-08 16:43:51,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:43:51,470::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:43:53,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:53,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0238256 s, 43.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:43:55,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:43:55,663::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:43:55,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`b73e8752-659c-4f16-947d-503823342814`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:43:55,673::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::DEBUG::2014-07-08 16:43:55,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`df1259b0-9080-48a1-891d-2512b56b1742`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:43:55,680::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:43:55,682::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069197', 'lastCheck': '4.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:43:55,688::task::1191::Storage.TaskManager.Task::(prepare) Task=`df1259b0-9080-48a1-891d-2512b56b1742`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069197', 'lastCheck': '4.2', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:43:55,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`df1259b0-9080-48a1-891d-2512b56b1742`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:43:55,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:43:55,692::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:43:55,692::task::993::Storage.TaskManager.Task::(_decref) Task=`df1259b0-9080-48a1-891d-2512b56b1742`::ref 0 aborting False >Thread-6939::INFO::2014-07-08 16:43:55,700::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:43:55,702::task::1191::Storage.TaskManager.Task::(prepare) Task=`b73e8752-659c-4f16-947d-503823342814`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:43:55,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`b73e8752-659c-4f16-947d-503823342814`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:43:55,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:43:55,705::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:43:55,707::task::993::Storage.TaskManager.Task::(_decref) Task=`b73e8752-659c-4f16-947d-503823342814`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:43:55,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0723616 s, 14.2 MB/s\n'; <rc> = 0 >Thread-6940::DEBUG::2014-07-08 16:43:55,798::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:43:55,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5ae4be0-79c5-438c-804b-4f1313632efe`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:43:55,805::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:43:55,808::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3721bb26-7530-4351-b1fc-037ae708a5b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:43:55,808::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:43:55,810::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:43:55,811::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3721bb26-7530-4351-b1fc-037ae708a5b2`::Granted request >Thread-6940::DEBUG::2014-07-08 16:43:55,814::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d5ae4be0-79c5-438c-804b-4f1313632efe`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:43:55,814::task::993::Storage.TaskManager.Task::(_decref) Task=`d5ae4be0-79c5-438c-804b-4f1313632efe`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:43:55,845::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:55,846::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5ae4be0-79c5-438c-804b-4f1313632efe`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:43:55,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5ae4be0-79c5-438c-804b-4f1313632efe`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:43:55,848::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:43:55,848::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:43:55,850::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:43:55,851::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:43:55,851::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:43:55,852::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:43:55,853::task::993::Storage.TaskManager.Task::(_decref) Task=`d5ae4be0-79c5-438c-804b-4f1313632efe`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:43:57,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:43:58,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173738 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:00,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:00,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175982 s, 58.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:01,476::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:01,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:01,477::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:01,477::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:01,477::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:01,477::__init__::225::IOProcess::(_processLogs) (273407) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:01,478::__init__::225::IOProcess::(_processLogs) (273407) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:01,478::__init__::225::IOProcess::(_processLogs) (273407) Building response >Thread-18::DEBUG::2014-07-08 16:44:01,478::__init__::225::IOProcess::(_processLogs) (273407) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:01,478::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:01,479::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:44:01,480::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:44:01,651::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000509548 s, 907 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:01,666::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:01,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:01,669::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:01,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:01,672::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:01,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:01,675::__init__::225::IOProcess::(_processLogs) (273408) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:01,676::__init__::225::IOProcess::(_processLogs) (273408) Building response >Thread-18::DEBUG::2014-07-08 16:44:01,677::__init__::225::IOProcess::(_processLogs) (273408) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:01,678::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:01,680::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:44:01,688::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:44:01,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:01,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:01,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:01,695::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:01,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:01,698::__init__::225::IOProcess::(_processLogs) (273409) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:01,699::__init__::225::IOProcess::(_processLogs) (273409) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:01,701::__init__::225::IOProcess::(_processLogs) (273409) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:01,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:01,704::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:01,710::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:44:01,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:01,713::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:01,715::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:01,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:01,718::__init__::225::IOProcess::(_processLogs) (273410) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:01,720::__init__::225::IOProcess::(_processLogs) (273410) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:01,721::__init__::225::IOProcess::(_processLogs) (273410) Building response >Thread-18::DEBUG::2014-07-08 16:44:01,723::__init__::225::IOProcess::(_processLogs) (273410) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:01,724::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:01,726::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:01,731::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:44:01,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:01,734::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:01,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:01,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:01,739::__init__::225::IOProcess::(_processLogs) (273411) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:01,741::__init__::225::IOProcess::(_processLogs) (273411) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:01,743::__init__::225::IOProcess::(_processLogs) (273411) Building response >Thread-18::DEBUG::2014-07-08 16:44:01,745::__init__::225::IOProcess::(_processLogs) (273411) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:01,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:01,748::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:44:02,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:02,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337045 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:04,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:05,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363878 s, 28.1 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:44:05,869::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:44:05,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`4da67335-28cf-4367-945e-f57c38f46369`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:44:05,871::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:44:05,887::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:44:05,887::task::1191::Storage.TaskManager.Task::(prepare) Task=`4da67335-28cf-4367-945e-f57c38f46369`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:44:05,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`4da67335-28cf-4367-945e-f57c38f46369`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:44:05,888::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:44:05,888::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:44:05,889::task::993::Storage.TaskManager.Task::(_decref) Task=`4da67335-28cf-4367-945e-f57c38f46369`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:44:05,900::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:44:05,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`b966f264-62c8-4598-b095-fdebdd25e1e2`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:44:05,901::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:44:05,902::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1779243d-b8dd-40a8-a888-f4fe7cc63687`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:44:05,902::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:44:05,903::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:44:05,903::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1779243d-b8dd-40a8-a888-f4fe7cc63687`::Granted request >Thread-6940::DEBUG::2014-07-08 16:44:05,904::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b966f264-62c8-4598-b095-fdebdd25e1e2`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:44:05,904::task::993::Storage.TaskManager.Task::(_decref) Task=`b966f264-62c8-4598-b095-fdebdd25e1e2`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:44:05,923::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:05,924::task::1191::Storage.TaskManager.Task::(prepare) Task=`b966f264-62c8-4598-b095-fdebdd25e1e2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:05,924::task::595::Storage.TaskManager.Task::(_updateState) Task=`b966f264-62c8-4598-b095-fdebdd25e1e2`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:44:05,924::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:44:05,924::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:44:05,925::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:44:05,925::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:44:05,926::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:44:05,926::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:44:05,926::task::993::Storage.TaskManager.Task::(_decref) Task=`b966f264-62c8-4598-b095-fdebdd25e1e2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:44:07,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:07,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173892 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:09,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:09,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175398 s, 58.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:44:10,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f36fdf2-703d-4ae5-ae38-03065d9a9802`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:44:10,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:44:10,962::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509548', 'lastCheck': '9.2', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:44:10,963::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f36fdf2-703d-4ae5-ae38-03065d9a9802`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509548', 'lastCheck': '9.2', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:44:10,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f36fdf2-703d-4ae5-ae38-03065d9a9802`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:44:10,963::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:44:10,963::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:44:10,964::task::993::Storage.TaskManager.Task::(_decref) Task=`6f36fdf2-703d-4ae5-ae38-03065d9a9802`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:44:11,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:44:11,890::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:11,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:11,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:11,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:11,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:11,908::__init__::225::IOProcess::(_processLogs) (273412) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:11,912::__init__::225::IOProcess::(_processLogs) (273412) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:11,916::__init__::225::IOProcess::(_processLogs) (273412) Building response >Thread-18::DEBUG::2014-07-08 16:44:11,920::__init__::225::IOProcess::(_processLogs) (273412) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:11,923::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:11,926::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:44:11,943::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:44:12,098::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000647272 s, 714 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:12,107::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:12,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:12,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:12,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:12,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:12,121::__init__::225::IOProcess::(_processLogs) (273413) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:12,123::__init__::225::IOProcess::(_processLogs) (273413) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:12,126::__init__::225::IOProcess::(_processLogs) (273413) Building response >Thread-18::DEBUG::2014-07-08 16:44:12,130::__init__::225::IOProcess::(_processLogs) (273413) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:44:12,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.246043 s, 4.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:12,213::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:12,218::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:44:12,235::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:44:12,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:12,242::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:12,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:12,248::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:12,252::__init__::225::IOProcess::(_processLogs) (273414) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:12,254::__init__::225::IOProcess::(_processLogs) (273414) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:12,258::__init__::225::IOProcess::(_processLogs) (273414) Building response >Thread-18::DEBUG::2014-07-08 16:44:12,261::__init__::225::IOProcess::(_processLogs) (273414) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:12,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:12,266::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:12,275::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:44:12,279::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:12,282::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:12,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:12,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:12,290::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:12,293::__init__::225::IOProcess::(_processLogs) (273415) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:12,297::__init__::225::IOProcess::(_processLogs) (273415) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:12,300::__init__::225::IOProcess::(_processLogs) (273415) Building response >Thread-18::DEBUG::2014-07-08 16:44:12,303::__init__::225::IOProcess::(_processLogs) (273415) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:12,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:12,311::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:12,323::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:44:12,327::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:12,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:12,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:12,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:12,340::__init__::225::IOProcess::(_processLogs) (273416) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:12,343::__init__::225::IOProcess::(_processLogs) (273416) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:12,346::__init__::225::IOProcess::(_processLogs) (273416) Building response >Thread-18::DEBUG::2014-07-08 16:44:12,350::__init__::225::IOProcess::(_processLogs) (273416) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:12,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:12,358::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:44:14,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:14,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200043 s, 51.2 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:44:15,940::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:44:15,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`97f97302-cc7d-4973-bdf5-e646eade121d`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:44:15,942::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:44:15,957::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:44:15,957::task::1191::Storage.TaskManager.Task::(prepare) Task=`97f97302-cc7d-4973-bdf5-e646eade121d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:44:15,958::task::595::Storage.TaskManager.Task::(_updateState) Task=`97f97302-cc7d-4973-bdf5-e646eade121d`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:44:15,958::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:44:15,958::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:44:15,958::task::993::Storage.TaskManager.Task::(_decref) Task=`97f97302-cc7d-4973-bdf5-e646eade121d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:44:15,970::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:44:15,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`5919530c-8109-4f18-bd03-e545625196e2`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:44:15,972::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:44:15,973::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`41a2d149-5ae3-4be5-bc80-adb695ec86db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:44:15,973::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:44:15,973::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:44:15,974::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`41a2d149-5ae3-4be5-bc80-adb695ec86db`::Granted request >Thread-6940::DEBUG::2014-07-08 16:44:15,974::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5919530c-8109-4f18-bd03-e545625196e2`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:44:15,975::task::993::Storage.TaskManager.Task::(_decref) Task=`5919530c-8109-4f18-bd03-e545625196e2`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:44:15,993::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:15,994::task::1191::Storage.TaskManager.Task::(prepare) Task=`5919530c-8109-4f18-bd03-e545625196e2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:15,994::task::595::Storage.TaskManager.Task::(_updateState) Task=`5919530c-8109-4f18-bd03-e545625196e2`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:44:15,994::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:44:15,995::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:44:15,995::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:44:15,995::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:44:15,996::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:44:15,996::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:44:15,996::task::993::Storage.TaskManager.Task::(_decref) Task=`5919530c-8109-4f18-bd03-e545625196e2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:44:16,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:17,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171341 s, 59.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:19,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:19,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176437 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:21,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:21,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175484 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:22,369::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:22,369::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:22,370::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:22,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:22,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:22,370::__init__::225::IOProcess::(_processLogs) (273417) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:22,371::__init__::225::IOProcess::(_processLogs) (273417) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:22,371::__init__::225::IOProcess::(_processLogs) (273417) Building response >Thread-18::DEBUG::2014-07-08 16:44:22,371::__init__::225::IOProcess::(_processLogs) (273417) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:22,371::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:22,372::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:44:22,373::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:44:22,524::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00062269 s, 742 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:22,529::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:22,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:22,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:22,534::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:22,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:22,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:22,537::__init__::225::IOProcess::(_processLogs) (273418) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:22,539::__init__::225::IOProcess::(_processLogs) (273418) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:22,540::__init__::225::IOProcess::(_processLogs) (273418) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:22,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:22,543::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:44:22,551::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:44:22,552::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:22,553::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:22,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:22,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:22,558::__init__::225::IOProcess::(_processLogs) (273419) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:22,559::__init__::225::IOProcess::(_processLogs) (273419) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:22,560::__init__::225::IOProcess::(_processLogs) (273419) Building response >Thread-18::DEBUG::2014-07-08 16:44:22,562::__init__::225::IOProcess::(_processLogs) (273419) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:22,563::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:22,564::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:22,569::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:44:22,571::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:22,572::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:22,574::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:22,575::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:22,577::__init__::225::IOProcess::(_processLogs) (273420) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:22,578::__init__::225::IOProcess::(_processLogs) (273420) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:22,580::__init__::225::IOProcess::(_processLogs) (273420) Building response >Thread-18::DEBUG::2014-07-08 16:44:22,582::__init__::225::IOProcess::(_processLogs) (273420) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:22,583::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:22,585::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:22,590::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:44:22,591::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:22,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:22,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:22,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:22,598::__init__::225::IOProcess::(_processLogs) (273421) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:22,599::__init__::225::IOProcess::(_processLogs) (273421) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:22,600::__init__::225::IOProcess::(_processLogs) (273421) Building response >Thread-18::DEBUG::2014-07-08 16:44:22,602::__init__::225::IOProcess::(_processLogs) (273421) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:22,603::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:22,605::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:44:23,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:23,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180278 s, 56.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:25,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:44:26,066::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:44:26,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`e85fd56d-5584-42de-8061-7560af8118b0`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:44:26,071::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6939::INFO::2014-07-08 16:44:26,163::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:44:26,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024719 s, 41.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:44:26,168::task::1191::Storage.TaskManager.Task::(prepare) Task=`e85fd56d-5584-42de-8061-7560af8118b0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:44:26,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`e85fd56d-5584-42de-8061-7560af8118b0`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:44:26,172::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:44:26,174::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:44:26,177::task::993::Storage.TaskManager.Task::(_decref) Task=`e85fd56d-5584-42de-8061-7560af8118b0`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:44:26,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`de74f141-524a-43ed-9416-80a225a79f77`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:44:26,183::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:44:26,186::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062269', 'lastCheck': '3.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:44:26,187::task::1191::Storage.TaskManager.Task::(prepare) Task=`de74f141-524a-43ed-9416-80a225a79f77`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062269', 'lastCheck': '3.6', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:44:26,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`de74f141-524a-43ed-9416-80a225a79f77`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:44:26,188::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:44:26,189::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:44:26,190::task::993::Storage.TaskManager.Task::(_decref) Task=`de74f141-524a-43ed-9416-80a225a79f77`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:44:26,200::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:44:26,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`31fc8889-913f-49ba-bb8b-449e8424dca5`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:44:26,209::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:44:26,215::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`481210e4-18f5-40b1-a4be-b5896cb14dda`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:44:26,217::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:44:26,220::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:44:26,222::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`481210e4-18f5-40b1-a4be-b5896cb14dda`::Granted request >Thread-6940::DEBUG::2014-07-08 16:44:26,227::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`31fc8889-913f-49ba-bb8b-449e8424dca5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:44:26,229::task::993::Storage.TaskManager.Task::(_decref) Task=`31fc8889-913f-49ba-bb8b-449e8424dca5`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:44:26,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:26,269::task::1191::Storage.TaskManager.Task::(prepare) Task=`31fc8889-913f-49ba-bb8b-449e8424dca5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:26,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`31fc8889-913f-49ba-bb8b-449e8424dca5`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:44:26,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:44:26,272::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:44:26,273::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:44:26,277::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:44:26,278::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:44:26,280::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:44:26,285::task::993::Storage.TaskManager.Task::(_decref) Task=`31fc8889-913f-49ba-bb8b-449e8424dca5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:44:28,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:28,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177211 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:30,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:30,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017528 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:32,611::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:32,612::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:32,612::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:32,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:32,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:32,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:32,613::__init__::225::IOProcess::(_processLogs) (273422) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:32,614::__init__::225::IOProcess::(_processLogs) (273422) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:32,614::__init__::225::IOProcess::(_processLogs) (273422) Building response >Thread-18::DEBUG::2014-07-08 16:44:32,614::__init__::225::IOProcess::(_processLogs) (273422) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:32,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:32,614::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:44:32,616::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:44:32,772::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000438592 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:32,777::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:32,778::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:32,780::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:32,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:32,782::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:32,784::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:32,785::__init__::225::IOProcess::(_processLogs) (273423) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:32,786::__init__::225::IOProcess::(_processLogs) (273423) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:32,788::__init__::225::IOProcess::(_processLogs) (273423) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:32,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:32,790::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:44:32,798::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:44:32,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:32,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:32,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:32,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:32,806::__init__::225::IOProcess::(_processLogs) (273424) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:32,807::__init__::225::IOProcess::(_processLogs) (273424) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:32,809::__init__::225::IOProcess::(_processLogs) (273424) Building response >Thread-18::DEBUG::2014-07-08 16:44:32,810::__init__::225::IOProcess::(_processLogs) (273424) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:32,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:32,813::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:32,818::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:44:32,820::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:32,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:32,823::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:32,824::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:32,826::__init__::225::IOProcess::(_processLogs) (273425) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:32,828::__init__::225::IOProcess::(_processLogs) (273425) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:32,829::__init__::225::IOProcess::(_processLogs) (273425) Building response >Thread-18::DEBUG::2014-07-08 16:44:32,831::__init__::225::IOProcess::(_processLogs) (273425) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:32,832::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:32,834::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:32,839::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:44:32,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:32,842::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:32,844::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:32,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:32,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:32,849::__init__::225::IOProcess::(_processLogs) (273426) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:32,850::__init__::225::IOProcess::(_processLogs) (273426) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:32,852::__init__::225::IOProcess::(_processLogs) (273426) Building response >Thread-18::DEBUG::2014-07-08 16:44:32,853::__init__::225::IOProcess::(_processLogs) (273426) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:32,854::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:32,855::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:44:32,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:33,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174113 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:35,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:35,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0183195 s, 55.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:44:36,301::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:44:36,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cebf4cc-8be8-4a6a-9ccf-069cd036488d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:44:36,302::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:44:36,317::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:44:36,318::task::1191::Storage.TaskManager.Task::(prepare) Task=`8cebf4cc-8be8-4a6a-9ccf-069cd036488d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:44:36,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cebf4cc-8be8-4a6a-9ccf-069cd036488d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:44:36,318::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:44:36,318::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:44:36,319::task::993::Storage.TaskManager.Task::(_decref) Task=`8cebf4cc-8be8-4a6a-9ccf-069cd036488d`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:44:36,333::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:44:36,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`e881d56f-3bb5-4f07-849a-ba09d16aeebe`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:44:36,334::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:44:36,335::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`72b69e15-8b62-4f94-a265-b8cc747f3f2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:44:36,336::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:44:36,336::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:44:36,336::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`72b69e15-8b62-4f94-a265-b8cc747f3f2e`::Granted request >Thread-6940::DEBUG::2014-07-08 16:44:36,337::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e881d56f-3bb5-4f07-849a-ba09d16aeebe`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:44:36,337::task::993::Storage.TaskManager.Task::(_decref) Task=`e881d56f-3bb5-4f07-849a-ba09d16aeebe`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:44:36,356::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:36,357::task::1191::Storage.TaskManager.Task::(prepare) Task=`e881d56f-3bb5-4f07-849a-ba09d16aeebe`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:36,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`e881d56f-3bb5-4f07-849a-ba09d16aeebe`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:44:36,357::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:44:36,357::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:44:36,358::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:44:36,358::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:44:36,358::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:44:36,359::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:44:36,359::task::993::Storage.TaskManager.Task::(_decref) Task=`e881d56f-3bb5-4f07-849a-ba09d16aeebe`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:44:37,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:37,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173554 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:39,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:40,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169688 s, 60.3 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:44:41,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`b789e811-7c90-48d7-bcaf-39968331f88e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:44:41,403::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:44:41,404::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438592', 'lastCheck': '8.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:44:41,404::task::1191::Storage.TaskManager.Task::(prepare) Task=`b789e811-7c90-48d7-bcaf-39968331f88e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438592', 'lastCheck': '8.5', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:44:41,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`b789e811-7c90-48d7-bcaf-39968331f88e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:44:41,405::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:44:41,405::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:44:41,405::task::993::Storage.TaskManager.Task::(_decref) Task=`b789e811-7c90-48d7-bcaf-39968331f88e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:44:42,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:42,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172992 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:42,862::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:44:42,863::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:42,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:42,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:42,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:42,864::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:42,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:42,865::__init__::225::IOProcess::(_processLogs) (273427) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:42,865::__init__::225::IOProcess::(_processLogs) (273427) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:42,865::__init__::225::IOProcess::(_processLogs) (273427) Building response >Thread-18::DEBUG::2014-07-08 16:44:42,865::__init__::225::IOProcess::(_processLogs) (273427) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:42,866::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:42,866::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:44:42,867::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:44:43,030::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00838102 s, 55.1 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:43,034::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:44:43,035::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:43,035::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:43,035::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:43,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:43,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:43,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:43,046::__init__::225::IOProcess::(_processLogs) (273428) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:43,047::__init__::225::IOProcess::(_processLogs) (273428) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:43,048::__init__::225::IOProcess::(_processLogs) (273428) Building response >Thread-18::DEBUG::2014-07-08 16:44:43,050::__init__::225::IOProcess::(_processLogs) (273428) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:43,051::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:43,052::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:44:43,060::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:44:43,060::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:44:43,061::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:43,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:43,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:43,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:43,061::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:43,062::__init__::225::IOProcess::(_processLogs) (273429) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:43,062::__init__::225::IOProcess::(_processLogs) (273429) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:43,062::__init__::225::IOProcess::(_processLogs) (273429) Building response >Thread-18::DEBUG::2014-07-08 16:44:43,062::__init__::225::IOProcess::(_processLogs) (273429) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:43,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:43,063::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:43,065::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:44:43,067::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:44:43,068::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:43,069::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:43,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:43,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:43,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:43,074::__init__::225::IOProcess::(_processLogs) (273430) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:43,075::__init__::225::IOProcess::(_processLogs) (273430) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:43,076::__init__::225::IOProcess::(_processLogs) (273430) Building response >Thread-18::DEBUG::2014-07-08 16:44:43,077::__init__::225::IOProcess::(_processLogs) (273430) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:43,078::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:43,079::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:43,083::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:44:43,085::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:44:43,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:43,087::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:43,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:43,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:43,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:43,092::__init__::225::IOProcess::(_processLogs) (273431) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:43,093::__init__::225::IOProcess::(_processLogs) (273431) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:43,094::__init__::225::IOProcess::(_processLogs) (273431) Building response >Thread-18::DEBUG::2014-07-08 16:44:43,095::__init__::225::IOProcess::(_processLogs) (273431) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:43,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:43,097::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:44:44,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:44,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174873 s, 58.6 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:44:46,375::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:44:46,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`09915011-457e-446c-99e8-f4b4bc517595`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:44:46,377::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:44:46,392::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:44:46,392::task::1191::Storage.TaskManager.Task::(prepare) Task=`09915011-457e-446c-99e8-f4b4bc517595`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:44:46,392::task::595::Storage.TaskManager.Task::(_updateState) Task=`09915011-457e-446c-99e8-f4b4bc517595`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:44:46,393::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:44:46,393::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:44:46,393::task::993::Storage.TaskManager.Task::(_decref) Task=`09915011-457e-446c-99e8-f4b4bc517595`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:44:46,405::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:44:46,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce5ba8d7-ab5c-4b85-8a4b-860da4cc900e`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:44:46,406::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:44:46,407::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24d722af-484e-485a-bfcb-71523e4669c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:44:46,407::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:44:46,408::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:44:46,408::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24d722af-484e-485a-bfcb-71523e4669c3`::Granted request >Thread-6940::DEBUG::2014-07-08 16:44:46,409::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce5ba8d7-ab5c-4b85-8a4b-860da4cc900e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:44:46,409::task::993::Storage.TaskManager.Task::(_decref) Task=`ce5ba8d7-ab5c-4b85-8a4b-860da4cc900e`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:44:46,428::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:46,428::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce5ba8d7-ab5c-4b85-8a4b-860da4cc900e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:46,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce5ba8d7-ab5c-4b85-8a4b-860da4cc900e`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:44:46,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:44:46,429::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:44:46,430::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:44:46,430::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:44:46,430::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:44:46,430::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:44:46,431::task::993::Storage.TaskManager.Task::(_decref) Task=`ce5ba8d7-ab5c-4b85-8a4b-860da4cc900e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:44:46,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:46,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180071 s, 56.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:48,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:49,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0192578 s, 53.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:51,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:51,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176132 s, 58.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:53,103::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:44:53,103::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:53,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:53,104::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:53,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:53,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:53,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:53,105::__init__::225::IOProcess::(_processLogs) (273432) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:53,105::__init__::225::IOProcess::(_processLogs) (273432) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:53,105::__init__::225::IOProcess::(_processLogs) (273432) Building response >Thread-18::DEBUG::2014-07-08 16:44:53,106::__init__::225::IOProcess::(_processLogs) (273432) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:53,106::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:53,106::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:44:53,108::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:44:53,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000446414 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:44:53,269::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:44:53,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:53,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:53,274::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:53,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:53,278::__init__::225::IOProcess::(_processLogs) (273433) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:44:53,280::__init__::225::IOProcess::(_processLogs) (273433) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:44:53,281::__init__::225::IOProcess::(_processLogs) (273433) Building response >Thread-18::DEBUG::2014-07-08 16:44:53,283::__init__::225::IOProcess::(_processLogs) (273433) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:53,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:53,286::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:44:53,297::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:44:53,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:53,300::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:53,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:53,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:53,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:53,305::__init__::225::IOProcess::(_processLogs) (273434) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:53,306::__init__::225::IOProcess::(_processLogs) (273434) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:53,312::__init__::225::IOProcess::(_processLogs) (273434) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:53,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:53,314::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:53,320::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:44:53,321::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:53,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:53,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:53,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:53,326::__init__::225::IOProcess::(_processLogs) (273435) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:53,327::__init__::225::IOProcess::(_processLogs) (273435) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:53,328::__init__::225::IOProcess::(_processLogs) (273435) Building response >Thread-18::DEBUG::2014-07-08 16:44:53,330::__init__::225::IOProcess::(_processLogs) (273435) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:53,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:44:53,332::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:44:53,337::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:44:53,338::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:44:53,340::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:44:53,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:44:53,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:44:53,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:44:53,344::__init__::225::IOProcess::(_processLogs) (273436) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:44:53,346::__init__::225::IOProcess::(_processLogs) (273436) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:44:53,348::__init__::225::IOProcess::(_processLogs) (273436) Building response >Thread-18::DEBUG::2014-07-08 16:44:53,349::__init__::225::IOProcess::(_processLogs) (273436) Queuing response >Thread-18::DEBUG::2014-07-08 16:44:53,350::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:44:53,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:53,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383855 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:44:55,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:55,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179222 s, 57.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:44:56,445::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:44:56,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`159a2814-e52e-446f-a21b-8385efd22f83`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:44:56,446::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:44:56,461::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:44:56,462::task::1191::Storage.TaskManager.Task::(prepare) Task=`159a2814-e52e-446f-a21b-8385efd22f83`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:44:56,462::task::595::Storage.TaskManager.Task::(_updateState) Task=`159a2814-e52e-446f-a21b-8385efd22f83`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:44:56,462::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:44:56,462::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:44:56,463::task::993::Storage.TaskManager.Task::(_decref) Task=`159a2814-e52e-446f-a21b-8385efd22f83`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:44:56,474::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:44:56,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`9599d786-59e1-4301-9322-dff1b297f2e3`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:44:56,475::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:44:56,476::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e42d41c9-1cd5-4aa2-b1bb-4eb034fe8984`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:44:56,477::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:44:56,477::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:44:56,478::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e42d41c9-1cd5-4aa2-b1bb-4eb034fe8984`::Granted request >Thread-6940::DEBUG::2014-07-08 16:44:56,478::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9599d786-59e1-4301-9322-dff1b297f2e3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:44:56,479::task::993::Storage.TaskManager.Task::(_decref) Task=`9599d786-59e1-4301-9322-dff1b297f2e3`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:44:56,497::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:56,498::task::1191::Storage.TaskManager.Task::(prepare) Task=`9599d786-59e1-4301-9322-dff1b297f2e3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:44:56,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`9599d786-59e1-4301-9322-dff1b297f2e3`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:44:56,498::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:44:56,499::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:44:56,499::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:44:56,499::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:44:56,500::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:44:56,500::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:44:56,500::task::993::Storage.TaskManager.Task::(_decref) Task=`9599d786-59e1-4301-9322-dff1b297f2e3`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:44:56,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`85f25f0b-e686-4dfe-8508-fb786ea4188d`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:44:56,709::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:44:56,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446414', 'lastCheck': '3.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:44:56,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`85f25f0b-e686-4dfe-8508-fb786ea4188d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446414', 'lastCheck': '3.4', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:44:56,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`85f25f0b-e686-4dfe-8508-fb786ea4188d`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:44:56,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:44:56,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:44:56,710::task::993::Storage.TaskManager.Task::(_decref) Task=`85f25f0b-e686-4dfe-8508-fb786ea4188d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:44:57,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:44:58,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177242 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:00,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:00,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171953 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:02,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:02,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173277 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:03,356::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:03,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:03,357::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:03,357::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:03,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:03,358::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:03,358::__init__::225::IOProcess::(_processLogs) (273437) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:03,359::__init__::225::IOProcess::(_processLogs) (273437) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:03,359::__init__::225::IOProcess::(_processLogs) (273437) Building response >Thread-18::DEBUG::2014-07-08 16:45:03,359::__init__::225::IOProcess::(_processLogs) (273437) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:03,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:03,360::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:45:03,361::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:45:03,510::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000456471 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:03,516::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:03,519::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:03,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:03,522::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:03,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:03,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:03,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:03,529::__init__::225::IOProcess::(_processLogs) (273438) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:03,530::__init__::225::IOProcess::(_processLogs) (273438) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:03,533::__init__::225::IOProcess::(_processLogs) (273438) Building response >Thread-18::DEBUG::2014-07-08 16:45:03,534::__init__::225::IOProcess::(_processLogs) (273438) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:03,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:03,536::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:45:03,546::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:03,548::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:45:03,549::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:03,551::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:03,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:03,554::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:03,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:03,557::__init__::225::IOProcess::(_processLogs) (273439) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:03,559::__init__::225::IOProcess::(_processLogs) (273439) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:03,561::__init__::225::IOProcess::(_processLogs) (273439) Building response >Thread-18::DEBUG::2014-07-08 16:45:03,562::__init__::225::IOProcess::(_processLogs) (273439) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:03,564::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:03,566::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:03,572::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:03,574::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:45:03,575::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:03,577::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:03,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:03,580::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:03,582::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:03,584::__init__::225::IOProcess::(_processLogs) (273440) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:03,586::__init__::225::IOProcess::(_processLogs) (273440) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:03,587::__init__::225::IOProcess::(_processLogs) (273440) Building response >Thread-18::DEBUG::2014-07-08 16:45:03,589::__init__::225::IOProcess::(_processLogs) (273440) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:03,591::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:03,593::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:03,599::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:03,601::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:45:03,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:03,604::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:03,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:03,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:03,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:03,611::__init__::225::IOProcess::(_processLogs) (273441) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:03,613::__init__::225::IOProcess::(_processLogs) (273441) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:03,615::__init__::225::IOProcess::(_processLogs) DEBUG|(273441) Building response >Thread-18::DEBUG::2014-07-08 16:45:03,617::__init__::225::IOProcess::(_processLogs) (273441) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:03,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:03,620::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:45:04,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:05,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0446881 s, 22.9 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:45:06,513::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:45:06,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbed075a-15ed-46db-9f1f-030ecc0b4f5e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:45:06,515::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:45:06,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:06,531::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbed075a-15ed-46db-9f1f-030ecc0b4f5e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:06,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbed075a-15ed-46db-9f1f-030ecc0b4f5e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:45:06,531::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:45:06,531::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:45:06,532::task::993::Storage.TaskManager.Task::(_decref) Task=`bbed075a-15ed-46db-9f1f-030ecc0b4f5e`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:45:06,544::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:45:06,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`68c2de36-f8a1-439b-806c-655dd5df3da6`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:45:06,545::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:45:06,546::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1fa2416c-6051-463b-a733-eac9c5b42416`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:45:06,546::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:45:06,547::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:45:06,547::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1fa2416c-6051-463b-a733-eac9c5b42416`::Granted request >Thread-6940::DEBUG::2014-07-08 16:45:06,548::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`68c2de36-f8a1-439b-806c-655dd5df3da6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:45:06,548::task::993::Storage.TaskManager.Task::(_decref) Task=`68c2de36-f8a1-439b-806c-655dd5df3da6`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:45:06,567::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:06,567::task::1191::Storage.TaskManager.Task::(prepare) Task=`68c2de36-f8a1-439b-806c-655dd5df3da6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:06,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`68c2de36-f8a1-439b-806c-655dd5df3da6`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:45:06,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:45:06,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:45:06,568::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:45:06,569::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:45:06,569::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:45:06,569::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:45:06,570::task::993::Storage.TaskManager.Task::(_decref) Task=`68c2de36-f8a1-439b-806c-655dd5df3da6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:45:07,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:07,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175199 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:09,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:09,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170562 s, 60.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:11,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-6941::DEBUG::2014-07-08 16:45:11,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc85ff79-c6ee-4dde-88d8-5e46bc741086`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:45:11,891::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:45:11,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456471', 'lastCheck': '8.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:45:11,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc85ff79-c6ee-4dde-88d8-5e46bc741086`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456471', 'lastCheck': '8.3', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:45:11,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc85ff79-c6ee-4dde-88d8-5e46bc741086`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:45:11,893::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:45:11,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:45:11,893::task::993::Storage.TaskManager.Task::(_decref) Task=`bc85ff79-c6ee-4dde-88d8-5e46bc741086`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:45:12,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0926296 s, 11.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:13,627::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:13,627::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:13,627::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:13,628::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:13,628::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:13,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:13,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:13,629::__init__::225::IOProcess::(_processLogs) (273442) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:13,629::__init__::225::IOProcess::(_processLogs) (273442) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:13,629::__init__::225::IOProcess::(_processLogs) (273442) Building response >Thread-18::DEBUG::2014-07-08 16:45:13,629::__init__::225::IOProcess::(_processLogs) (273442) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:13,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:13,630::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:45:13,631::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:45:13,779::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000562907 s, 821 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:13,785::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:13,787::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:13,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:13,790::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:13,792::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:13,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:13,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:13,796::__init__::225::IOProcess::(_processLogs) (273443) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:13,797::__init__::225::IOProcess::(_processLogs) (273443) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:13,798::__init__::225::IOProcess::(_processLogs) (273443) Building response >Thread-18::DEBUG::2014-07-08 16:45:13,800::__init__::225::IOProcess::(_processLogs) (273443) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:13,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:13,803::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:45:13,812::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:13,813::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:45:13,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:13,816::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:13,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:13,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:13,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:13,821::__init__::225::IOProcess::(_processLogs) (273444) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:13,822::__init__::225::IOProcess::(_processLogs) (273444) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:13,824::__init__::225::IOProcess::(_processLogs) (273444) Building response >Thread-18::DEBUG::2014-07-08 16:45:13,826::__init__::225::IOProcess::(_processLogs) (273444) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:13,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:13,828::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:13,833::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:13,834::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:45:13,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:13,837::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:13,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:13,840::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:13,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:13,843::__init__::225::IOProcess::(_processLogs) (273445) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:13,844::__init__::225::IOProcess::(_processLogs) (273445) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:13,845::__init__::225::IOProcess::(_processLogs) (273445) Building response >Thread-18::DEBUG::2014-07-08 16:45:13,847::__init__::225::IOProcess::(_processLogs) (273445) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:13,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:13,850::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:13,855::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:13,856::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:45:13,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:13,859::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:13,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:13,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:13,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:13,865::__init__::225::IOProcess::(_processLogs) (273446) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:13,866::__init__::225::IOProcess::(_processLogs) (273446) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:13,867::__init__::225::IOProcess::(_processLogs) (273446) Building response >Thread-18::DEBUG::2014-07-08 16:45:13,868::__init__::225::IOProcess::(_processLogs) (273446) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:13,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:13,871::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:45:14,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:14,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174216 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:16,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:16,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176663 s, 58.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:45:16,605::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:45:16,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad03e29d-912e-4fe8-9def-babd398b8000`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:45:16,610::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:45:16,625::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:16,627::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad03e29d-912e-4fe8-9def-babd398b8000`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:16,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad03e29d-912e-4fe8-9def-babd398b8000`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:45:16,628::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:45:16,629::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:45:16,629::task::993::Storage.TaskManager.Task::(_decref) Task=`ad03e29d-912e-4fe8-9def-babd398b8000`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:45:16,642::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:45:16,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f464c76-51f3-43d4-9ff6-c2a45eaec3a0`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:45:16,643::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:45:16,644::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2aaf2fe0-8857-41c8-9487-cf947d224f57`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:45:16,644::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:45:16,645::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:45:16,645::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2aaf2fe0-8857-41c8-9487-cf947d224f57`::Granted request >Thread-6940::DEBUG::2014-07-08 16:45:16,650::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5f464c76-51f3-43d4-9ff6-c2a45eaec3a0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:45:16,650::task::993::Storage.TaskManager.Task::(_decref) Task=`5f464c76-51f3-43d4-9ff6-c2a45eaec3a0`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:45:16,669::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:16,670::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f464c76-51f3-43d4-9ff6-c2a45eaec3a0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:16,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f464c76-51f3-43d4-9ff6-c2a45eaec3a0`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:45:16,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:45:16,670::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:45:16,671::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:45:16,671::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:45:16,671::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:45:16,672::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:45:16,672::task::993::Storage.TaskManager.Task::(_decref) Task=`5f464c76-51f3-43d4-9ff6-c2a45eaec3a0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:45:18,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:18,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176688 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:20,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:21,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01763 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:23,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:23,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174713 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:23,877::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:23,877::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:23,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:23,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:23,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:23,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:23,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:23,879::__init__::225::IOProcess::(_processLogs) (273447) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:23,879::__init__::225::IOProcess::(_processLogs) (273447) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:23,879::__init__::225::IOProcess::(_processLogs) (273447) Building response >Thread-18::DEBUG::2014-07-08 16:45:23,879::__init__::225::IOProcess::(_processLogs) (273447) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:23,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:23,880::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:45:23,882::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:45:24,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00293801 s, 157 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:24,042::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:24,043::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:24,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:24,044::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:24,044::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:24,045::__init__::225::IOProcess::(_processLogs) (273448) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:24,045::__init__::225::IOProcess::(_processLogs) (273448) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:24,046::__init__::225::IOProcess::(_processLogs) (273448) Building response >Thread-18::DEBUG::2014-07-08 16:45:24,046::__init__::225::IOProcess::(_processLogs) (273448) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:24,046::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:24,047::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:45:24,061::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:45:24,062::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:24,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:24,063::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:24,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:24,064::__init__::225::IOProcess::(_processLogs) (273449) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:24,064::__init__::225::IOProcess::(_processLogs) (273449) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:24,064::__init__::225::IOProcess::(_processLogs) (273449) Building response >Thread-18::DEBUG::2014-07-08 16:45:24,065::__init__::225::IOProcess::(_processLogs) (273449) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:24,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:24,065::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:24,068::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:45:24,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:24,071::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:24,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:24,074::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:24,075::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:24,077::__init__::225::IOProcess::(_processLogs) (273450) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:24,078::__init__::225::IOProcess::(_processLogs) (273450) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:24,080::__init__::225::IOProcess::(_processLogs) (273450) Building response >Thread-18::DEBUG::2014-07-08 16:45:24,085::__init__::225::IOProcess::(_processLogs) (273450) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:24,089::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:24,093::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:24,107::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:24,111::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:45:24,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:24,116::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:24,119::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:24,123::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:24,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:24,131::__init__::225::IOProcess::(_processLogs) (273451) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:24,134::__init__::225::IOProcess::(_processLogs) (273451) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:24,139::__init__::225::IOProcess::(_processLogs) (273451) Building response >Thread-18::DEBUG::2014-07-08 16:45:24,142::__init__::225::IOProcess::(_processLogs) (273451) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:24,145::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:24,148::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:45:25,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:25,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0951452 s, 10.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:45:26,688::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:45:26,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3663bfb-0fe0-4cf5-9d56-2ff31cf14a0e`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:45:26,689::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:45:26,704::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:26,705::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3663bfb-0fe0-4cf5-9d56-2ff31cf14a0e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:26,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3663bfb-0fe0-4cf5-9d56-2ff31cf14a0e`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:45:26,705::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:45:26,705::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:45:26,706::task::993::Storage.TaskManager.Task::(_decref) Task=`d3663bfb-0fe0-4cf5-9d56-2ff31cf14a0e`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:45:26,717::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:45:26,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeb6b088-a94c-4362-b5c5-9d6a6fc435a7`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:45:26,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:45:26,719::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bd2b2b78-8955-4e0f-9aa0-2a31d6d19ad6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:45:26,719::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:45:26,720::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:45:26,720::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bd2b2b78-8955-4e0f-9aa0-2a31d6d19ad6`::Granted request >Thread-6940::DEBUG::2014-07-08 16:45:26,721::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`eeb6b088-a94c-4362-b5c5-9d6a6fc435a7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:45:26,721::task::993::Storage.TaskManager.Task::(_decref) Task=`eeb6b088-a94c-4362-b5c5-9d6a6fc435a7`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:45:26,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:26,740::task::1191::Storage.TaskManager.Task::(prepare) Task=`eeb6b088-a94c-4362-b5c5-9d6a6fc435a7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:26,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeb6b088-a94c-4362-b5c5-9d6a6fc435a7`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:45:26,741::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:45:26,741::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:45:26,742::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:45:26,742::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:45:26,742::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:45:26,742::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:45:26,743::task::993::Storage.TaskManager.Task::(_decref) Task=`eeb6b088-a94c-4362-b5c5-9d6a6fc435a7`::ref 0 aborting False >Thread-6941::DEBUG::2014-07-08 16:45:27,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`0748a948-1b57-4390-b54a-665215216702`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:45:27,195::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:45:27,195::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00293801', 'lastCheck': '3.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:45:27,196::task::1191::Storage.TaskManager.Task::(prepare) Task=`0748a948-1b57-4390-b54a-665215216702`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00293801', 'lastCheck': '3.0', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:45:27,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`0748a948-1b57-4390-b54a-665215216702`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:45:27,196::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:45:27,196::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:45:27,197::task::993::Storage.TaskManager.Task::(_decref) Task=`0748a948-1b57-4390-b54a-665215216702`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:45:27,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:28,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175417 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:30,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:30,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338473 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:32,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:32,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174529 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:34,159::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:34,160::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:34,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:34,160::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:34,161::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:34,161::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:34,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:34,162::__init__::225::IOProcess::(_processLogs) (273452) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:34,162::__init__::225::IOProcess::(_processLogs) (273452) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:34,162::__init__::225::IOProcess::(_processLogs) (273452) Building response >Thread-18::DEBUG::2014-07-08 16:45:34,162::__init__::225::IOProcess::(_processLogs) (273452) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:34,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:34,163::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:45:34,165::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:45:34,321::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000434122 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:34,336::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:34,339::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:34,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:34,349::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:34,356::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:34,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:34,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:34,377::__init__::225::IOProcess::(_processLogs) (273453) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:34,384::__init__::225::IOProcess::(_processLogs) (273453) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:34,390::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(273453) Building response >Thread-18::DEBUG::2014-07-08 16:45:34,396::__init__::225::IOProcess::(_processLogs) (273453) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:34,402::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:34,408::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:45:34,441::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:34,450::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:45:34,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:34,458::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:34,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:34,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:34,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:34,471::__init__::225::IOProcess::(_processLogs) (273454) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:34,474::__init__::225::IOProcess::(_processLogs) (273454) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:34,477::__init__::225::IOProcess::(_processLogs) (273454) Building response >Thread-18::DEBUG::2014-07-08 16:45:34,481::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(273454) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:34,484::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:34,488::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:34,499::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:34,503::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:45:34,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:34,508::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:34,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:34,514::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:34,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:34,519::__init__::225::IOProcess::(_processLogs) (273455) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:34,522::__init__::225::IOProcess::(_processLogs) (273455) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:34,525::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(273455) Building response >Thread-18::DEBUG::2014-07-08 16:45:34,529::__init__::225::IOProcess::(_processLogs) (273455) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:34,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:34,535::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:34,546::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:34,549::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:45:34,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:34,554::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:34,557::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:34,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:34,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:34,567::__init__::225::IOProcess::(_processLogs) (273456) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:34,570::__init__::225::IOProcess::(_processLogs) (273456) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:34,573::__init__::225::IOProcess::(_processLogs) (273456) Building response >Thread-18::DEBUG::2014-07-08 16:45:34,577::__init__::225::IOProcess::(_processLogs) (273456) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:34,581::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:34,585::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:45:34,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:34,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0649899 s, 15.8 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:45:36,757::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:45:36,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`71fcbc19-766b-424e-b363-27847909afb9`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:45:36,759::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:45:36,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:36,774::task::1191::Storage.TaskManager.Task::(prepare) Task=`71fcbc19-766b-424e-b363-27847909afb9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:36,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`71fcbc19-766b-424e-b363-27847909afb9`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:45:36,775::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:45:36,775::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:45:36,775::task::993::Storage.TaskManager.Task::(_decref) Task=`71fcbc19-766b-424e-b363-27847909afb9`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:45:36,786::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:45:36,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff8ebaa9-ea64-4345-9deb-23b1ad8ca74f`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:45:36,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:45:36,789::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0ce4b495-9194-4927-b477-45e13f29d676`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:45:36,789::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:45:36,789::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:45:36,790::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0ce4b495-9194-4927-b477-45e13f29d676`::Granted request >Thread-6940::DEBUG::2014-07-08 16:45:36,790::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff8ebaa9-ea64-4345-9deb-23b1ad8ca74f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:45:36,791::task::993::Storage.TaskManager.Task::(_decref) Task=`ff8ebaa9-ea64-4345-9deb-23b1ad8ca74f`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:45:36,810::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:36,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff8ebaa9-ea64-4345-9deb-23b1ad8ca74f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:36,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff8ebaa9-ea64-4345-9deb-23b1ad8ca74f`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:45:36,811::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:45:36,812::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:45:36,812::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:45:36,812::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:45:36,813::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:45:36,813::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:45:36,813::task::993::Storage.TaskManager.Task::(_decref) Task=`ff8ebaa9-ea64-4345-9deb-23b1ad8ca74f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:45:37,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:37,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175322 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:39,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:39,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169632 s, 60.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:45:41,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:42,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170797 s, 60.0 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:45:42,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`c82f118a-3465-436e-b43a-2fe3dc6734d5`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:45:42,415::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6941::INFO::2014-07-08 16:45:42,416::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434122', 'lastCheck': '7.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:45:42,416::task::1191::Storage.TaskManager.Task::(prepare) Task=`c82f118a-3465-436e-b43a-2fe3dc6734d5`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434122', 'lastCheck': '7.8', 'valid': True}} >Thread-6941::DEBUG::2014-07-08 16:45:42,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`c82f118a-3465-436e-b43a-2fe3dc6734d5`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:45:42,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:45:42,417::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:45:42,417::task::993::Storage.TaskManager.Task::(_decref) Task=`c82f118a-3465-436e-b43a-2fe3dc6734d5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:45:44,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:44,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174403 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:44,597::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:44,598::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:44,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:44,598::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:44,599::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:44,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:44,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:44,599::__init__::225::IOProcess::(_processLogs) (273457) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:44,600::__init__::225::IOProcess::(_processLogs) (273457) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:44,600::__init__::225::IOProcess::(_processLogs) (273457) Building response >Thread-18::DEBUG::2014-07-08 16:45:44,600::__init__::225::IOProcess::(_processLogs) (273457) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:44,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:44,601::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:45:44,602::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:45:44,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000443341 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:44,750::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:44,750::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:45:44,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:44,751::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:44,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:44,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:44,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:44,752::__init__::225::IOProcess::(_processLogs) (273458) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:44,752::__init__::225::IOProcess::(_processLogs) (273458) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:44,753::__init__::225::IOProcess::(_processLogs) (273458) Building response >Thread-18::DEBUG::2014-07-08 16:45:44,753::__init__::225::IOProcess::(_processLogs) (273458) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:44,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:44,753::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:45:44,755::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:44,756::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:45:44,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:44,756::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:44,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:44,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:44,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:44,757::__init__::225::IOProcess::(_processLogs) (273459) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:44,757::__init__::225::IOProcess::(_processLogs) (273459) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:44,758::__init__::225::IOProcess::(_processLogs) (273459) Building response >Thread-18::DEBUG::2014-07-08 16:45:44,758::__init__::225::IOProcess::(_processLogs) (273459) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:44,758::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:44,758::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:44,759::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:44,760::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:45:44,760::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:44,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:44,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:44,761::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:44,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:44,761::__init__::225::IOProcess::(_processLogs) (273460) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:44,761::__init__::225::IOProcess::(_processLogs) (273460) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:44,762::__init__::225::IOProcess::(_processLogs) (273460) Building response >Thread-18::DEBUG::2014-07-08 16:45:44,762::__init__::225::IOProcess::(_processLogs) (273460) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:44,762::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:44,762::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:44,763::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:44,764::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:45:44,764::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:44,764::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:44,764::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:44,765::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:44,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:44,765::__init__::225::IOProcess::(_processLogs) (273461) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:44,765::__init__::225::IOProcess::(_processLogs) (273461) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:44,766::__init__::225::IOProcess::(_processLogs) (273461) Building response >Thread-18::DEBUG::2014-07-08 16:45:44,766::__init__::225::IOProcess::(_processLogs) (273461) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:44,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:44,766::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:45:46,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:46,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0848416 s, 12.1 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:45:46,828::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6941::DEBUG::2014-07-08 16:45:46,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`713aa2de-515f-40ea-98c3-d0c2b0422c79`::moving from state init -> state preparing >Thread-6941::INFO::2014-07-08 16:45:46,830::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6941::INFO::2014-07-08 16:45:46,844::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:46,845::task::1191::Storage.TaskManager.Task::(prepare) Task=`713aa2de-515f-40ea-98c3-d0c2b0422c79`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6941::DEBUG::2014-07-08 16:45:46,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`713aa2de-515f-40ea-98c3-d0c2b0422c79`::moving from state preparing -> state finished >Thread-6941::DEBUG::2014-07-08 16:45:46,845::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6941::DEBUG::2014-07-08 16:45:46,846::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6941::DEBUG::2014-07-08 16:45:46,846::task::993::Storage.TaskManager.Task::(_decref) Task=`713aa2de-515f-40ea-98c3-d0c2b0422c79`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:45:46,857::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:45:46,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ab09fc3-b318-41b7-aafb-d7ae4019f391`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:45:46,858::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:45:46,859::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9085e2b3-0de2-4a9b-9ebb-5834df0fa039`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:45:46,860::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:45:46,860::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:45:46,860::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9085e2b3-0de2-4a9b-9ebb-5834df0fa039`::Granted request >Thread-6940::DEBUG::2014-07-08 16:45:46,861::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5ab09fc3-b318-41b7-aafb-d7ae4019f391`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:45:46,861::task::993::Storage.TaskManager.Task::(_decref) Task=`5ab09fc3-b318-41b7-aafb-d7ae4019f391`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:45:46,880::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:46,881::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ab09fc3-b318-41b7-aafb-d7ae4019f391`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:46,881::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ab09fc3-b318-41b7-aafb-d7ae4019f391`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:45:46,881::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:45:46,882::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:45:46,882::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:45:46,882::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:45:46,883::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:45:46,883::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:45:46,883::task::993::Storage.TaskManager.Task::(_decref) Task=`5ab09fc3-b318-41b7-aafb-d7ae4019f391`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:45:48,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:48,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172534 s, 59.4 MB/s\n'; <rc> = 0 >Thread-6941::DEBUG::2014-07-08 16:45:50,224::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G1', 'smp': '1', 'numaTune': {'mode': 'preferred'}, 'custom': {'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=18a91000-ba5f-4ac4-86c7-b21f96fc1711, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=755ce754-7bee-49fb-b450-d0b85277bd79, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311e': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=3996d27c-c4e2-4a39-968c-616c4c77311e, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=ee937282-11ea-4d93-b4da-1019bcd29ad1, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79device_988e6a00-cb47-4d6d-b308-befb52ea3952': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=988e6a00-cb47-4d6d-b308-befb52ea3952, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'vm1', 'nice': '0', 'bootMenuEnable': 'false', 'copyPasteEnable': 'true', 'smartcardEnable': 'false', 'fileTransferEnable': 'true', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6f1e54a7-9e7b-4487-b04b-954315a168a4', 'address': {'slot': '0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '0ee274c9-1b7d-4857-8324-eccf458f33f2', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '36ffc40d-feca-42ea-a0ae-e40506318f67', 'volumeID': 'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'specParams': {}, 'readonly': 'false', 'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'deviceId': 'c1abf407-d743-43d7-85bb-157eec06157c', 'address': {'slot': '0x07', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5b', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '538e4604-ff2c-4884-869d-f245d2051300', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'index': '0', 'specParams': {}, 'deviceId': '55d5a62a-e1ba-4197-b991-34cb27d29412', 'address': {'slot': '0x05', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'timeOffset': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [41209ee2] >Thread-6941::INFO::2014-07-08 16:45:50,225::clientIF::393::vds::(createVm) vmContainerLock acquired by vm 9b0bd5aa-d706-426a-a077-62a64954b803 >Thread-6941::DEBUG::2014-07-08 16:45:50,271::clientIF::406::vds::(createVm) Total desktops after creation of 9b0bd5aa-d706-426a-a077-62a64954b803 is 1 >Thread-7075::DEBUG::2014-07-08 16:45:50,271::vm::2186::vm.Vm::(_startUnderlyingVm) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Start >Thread-6941::DEBUG::2014-07-08 16:45:50,273::BindingXMLRPC::1114::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'pid': '0', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G1', 'smp': '1', 'numaTune': {'mode': 'preferred'}, 'custom': {'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=18a91000-ba5f-4ac4-86c7-b21f96fc1711, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=755ce754-7bee-49fb-b450-d0b85277bd79, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311e': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=3996d27c-c4e2-4a39-968c-616c4c77311e, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=ee937282-11ea-4d93-b4da-1019bcd29ad1, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79device_988e6a00-cb47-4d6d-b308-befb52ea3952': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=988e6a00-cb47-4d6d-b308-befb52ea3952, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'vm1', 'nice': '0', 'status': 'WaitForLaunch', 'bootMenuEnable': 'false', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'copyPasteEnable': 'true', 'displayIp': '10.35.128.17', 'displayPort': '-1', 'smartcardEnable': 'false', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'fileTransferEnable': 'true', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6f1e54a7-9e7b-4487-b04b-954315a168a4', 'address': {'slot': '0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '0ee274c9-1b7d-4857-8324-eccf458f33f2', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '36ffc40d-feca-42ea-a0ae-e40506318f67', 'volumeID': 'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'specParams': {}, 'readonly': 'false', 'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'deviceId': 'c1abf407-d743-43d7-85bb-157eec06157c', 'address': {'slot': '0x07', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5b', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '538e4604-ff2c-4884-869d-f245d2051300', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'index': '0', 'specParams': {}, 'deviceId': '55d5a62a-e1ba-4197-b991-34cb27d29412', 'address': {'slot': '0x05', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'timeOffset': '0', 'maxVCpus': '160', 'clientIp': '', 'display': 'qxl'}} >Thread-7075::DEBUG::2014-07-08 16:45:50,275::vm::2190::vm.Vm::(_startUnderlyingVm) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::_ongoingCreations acquired >Thread-7075::INFO::2014-07-08 16:45:50,277::vm::3182::vm.Vm::(_run) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::VM wrapper has started >Thread-7075::DEBUG::2014-07-08 16:45:50,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c46d568-550b-4a83-bd5c-afc4ecd94256`::moving from state init -> state preparing >Thread-7075::INFO::2014-07-08 16:45:50,281::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:45:50,286::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:50,288::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:45:50,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:50,290::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:50,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:50,292::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:50,293::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:50,293::__init__::225::IOProcess::(_processLogs) (273462) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:50,294::__init__::225::IOProcess::(_processLogs) (273462) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:50,294::__init__::225::IOProcess::(_processLogs) (273462) Building response >Thread-18::DEBUG::2014-07-08 16:45:50,294::__init__::225::IOProcess::(_processLogs) (273462) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:50,294::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:50,295::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:45:50,296::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:50,297::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:45:50,297::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:50,297::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:50,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:50,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:50,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:50,298::__init__::225::IOProcess::(_processLogs) (273463) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:50,299::__init__::225::IOProcess::(_processLogs) (273463) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:50,299::__init__::225::IOProcess::(_processLogs) (273463) Building response >Thread-18::DEBUG::2014-07-08 16:45:50,299::__init__::225::IOProcess::(_processLogs) (273463) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:50,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:50,300::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7075::INFO::2014-07-08 16:45:50,301::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7075::DEBUG::2014-07-08 16:45:50,301::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c46d568-550b-4a83-bd5c-afc4ecd94256`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7075::DEBUG::2014-07-08 16:45:50,301::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c46d568-550b-4a83-bd5c-afc4ecd94256`::moving from state preparing -> state finished >Thread-7075::DEBUG::2014-07-08 16:45:50,301::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7075::DEBUG::2014-07-08 16:45:50,302::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7075::DEBUG::2014-07-08 16:45:50,302::task::993::Storage.TaskManager.Task::(_decref) Task=`1c46d568-550b-4a83-bd5c-afc4ecd94256`::ref 0 aborting False >Thread-7075::INFO::2014-07-08 16:45:50,302::clientIF::334::vds::(prepareVolumePath) prepared volume path: >Thread-7075::DEBUG::2014-07-08 16:45:50,303::task::595::Storage.TaskManager.Task::(_updateState) Task=`8775e874-5dd5-442b-b46c-20a350ac59c8`::moving from state init -> state preparing >Thread-7075::INFO::2014-07-08 16:45:50,303::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', leafUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76') >Thread-7075::DEBUG::2014-07-08 16:45:50,304::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.2b5f401c-f143-45db-8578-1a8666cba539`ReqID=`1ecc9bc3-68c4-4a1f-8fac-80d3b1c76475`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3201' at 'prepareImage' >Thread-7075::DEBUG::2014-07-08 16:45:50,304::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' for lock type 'shared' >Thread-7075::DEBUG::2014-07-08 16:45:50,305::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' is free. Now locking as 'shared' (1 active user) >Thread-7075::DEBUG::2014-07-08 16:45:50,305::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.2b5f401c-f143-45db-8578-1a8666cba539`ReqID=`1ecc9bc3-68c4-4a1f-8fac-80d3b1c76475`::Granted request >Thread-7075::DEBUG::2014-07-08 16:45:50,306::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8775e874-5dd5-442b-b46c-20a350ac59c8`::_resourcesAcquired: Storage.2b5f401c-f143-45db-8578-1a8666cba539 (shared) >Thread-7075::DEBUG::2014-07-08 16:45:50,306::task::993::Storage.TaskManager.Task::(_decref) Task=`8775e874-5dd5-442b-b46c-20a350ac59c8`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:45:50,307::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:50,307::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-18::DEBUG::2014-07-08 16:45:50,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:50,308::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:50,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:50,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:50,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:50,309::__init__::225::IOProcess::(_processLogs) (273464) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:45:50,309::__init__::225::IOProcess::(_processLogs) (273464) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:45:50,314::__init__::225::IOProcess::(_processLogs) DEBUG|(273464) Building response >Thread-18::DEBUG::2014-07-08 16:45:50,315::__init__::225::IOProcess::(_processLogs) (273464) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:50,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:50,315::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 796 >Thread-7075::DEBUG::2014-07-08 16:45:50,316::fileSD::497::Storage.StorageDomain::(activateVolumes) Fixing permissions on /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:45:50,317::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:50,318::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:45:50,318::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:50,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:50,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:50,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:50,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:50,319::__init__::225::IOProcess::(_processLogs) (273465) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:50,319::__init__::225::IOProcess::(_processLogs) (273465) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:50,320::__init__::225::IOProcess::(_processLogs) (273465) Building response >Thread-18::DEBUG::2014-07-08 16:45:50,320::__init__::225::IOProcess::(_processLogs) (273465) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:50,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:50,320::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7075::DEBUG::2014-07-08 16:45:50,321::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-7075::WARNING::2014-07-08 16:45:50,323::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/2b5f401c-f143-45db-8578-1a8666cba539 already exists >Thread-7075::DEBUG::2014-07-08 16:45:50,323::fileSD::472::Storage.StorageDomain::(createImageLinks) Creating symlink from /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c to /var/run/vdsm/storage/2b5f401c-f143-45db-8578-1a8666cba539/c1abf407-d743-43d7-85bb-157eec06157c >Thread-7075::DEBUG::2014-07-08 16:45:50,323::fileSD::477::Storage.StorageDomain::(createImageLinks) img run dir already exists: /var/run/vdsm/storage/2b5f401c-f143-45db-8578-1a8666cba539/c1abf407-d743-43d7-85bb-157eec06157c >Thread-18::DEBUG::2014-07-08 16:45:50,325::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:50,325::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-18::DEBUG::2014-07-08 16:45:50,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:50,325::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:50,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:50,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:50,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:50,327::__init__::225::IOProcess::(_processLogs) (273466) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:50,327::__init__::225::IOProcess::(_processLogs) (273466) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:50,327::__init__::225::IOProcess::(_processLogs) (273466) Building response >Thread-18::DEBUG::2014-07-08 16:45:50,327::__init__::225::IOProcess::(_processLogs) (273466) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:50,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:50,328::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:45:50,329::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:50,330::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-18::DEBUG::2014-07-08 16:45:50,330::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:50,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:50,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:50,331::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:50,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:50,331::__init__::225::IOProcess::(_processLogs) (273467) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:50,331::__init__::225::IOProcess::(_processLogs) (273467) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:50,332::__init__::225::IOProcess::(_processLogs) (273467) Building response >Thread-18::DEBUG::2014-07-08 16:45:50,332::__init__::225::IOProcess::(_processLogs) (273467) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:50,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:50,332::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7075::DEBUG::2014-07-08 16:45:50,333::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:45:50,334::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:50,334::__init__::225::IOProcess::(_processLogs) Message size is 238 >Thread-18::DEBUG::2014-07-08 16:45:50,334::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:50,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:50,335::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:50,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:50,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:50,335::__init__::225::IOProcess::(_processLogs) (273468) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:50,336::__init__::225::IOProcess::(_processLogs) (273468) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:50,336::__init__::225::IOProcess::(_processLogs) (273468) Building response >Thread-18::DEBUG::2014-07-08 16:45:50,336::__init__::225::IOProcess::(_processLogs) (273468) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:50,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:50,337::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:50,338::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:50,338::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:45:50,338::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:50,339::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:50,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:50,339::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:50,339::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:50,340::__init__::225::IOProcess::(_processLogs) (273469) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:50,340::__init__::225::IOProcess::(_processLogs) (273469) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:50,340::__init__::225::IOProcess::(_processLogs) (273469) Building response >Thread-18::DEBUG::2014-07-08 16:45:50,340::__init__::225::IOProcess::(_processLogs) (273469) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:50,341::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:50,341::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7075::INFO::2014-07-08 16:45:50,342::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'imgVolumesInfo': [{'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}]} >Thread-7075::DEBUG::2014-07-08 16:45:50,342::task::1191::Storage.TaskManager.Task::(prepare) Task=`8775e874-5dd5-442b-b46c-20a350ac59c8`::finished: {'info': {'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'imgVolumesInfo': [{'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}]} >Thread-7075::DEBUG::2014-07-08 16:45:50,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`8775e874-5dd5-442b-b46c-20a350ac59c8`::moving from state preparing -> state finished >Thread-7075::DEBUG::2014-07-08 16:45:50,342::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.2b5f401c-f143-45db-8578-1a8666cba539': < ResourceRef 'Storage.2b5f401c-f143-45db-8578-1a8666cba539', isValid: 'True' obj: 'None'>} >Thread-7075::DEBUG::2014-07-08 16:45:50,343::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7075::DEBUG::2014-07-08 16:45:50,343::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' >Thread-7075::DEBUG::2014-07-08 16:45:50,343::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' (0 active users) >Thread-7075::DEBUG::2014-07-08 16:45:50,344::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' is free, finding out if anyone is waiting for it. >Thread-7075::DEBUG::2014-07-08 16:45:50,344::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539', Clearing records. >Thread-7075::DEBUG::2014-07-08 16:45:50,344::task::993::Storage.TaskManager.Task::(_decref) Task=`8775e874-5dd5-442b-b46c-20a350ac59c8`::ref 0 aborting False >Thread-7075::INFO::2014-07-08 16:45:50,345::clientIF::334::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-7075::DEBUG::2014-07-08 16:45:50,396::utils::738::root::(execCmd) /usr/libexec/vdsm/hooks/before_vm_start/10_faqemu (cwd None) >Thread-7075::DEBUG::2014-07-08 16:45:50,692::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-7075::INFO::2014-07-08 16:45:50,693::hooks::100::root::(_runHooksDir) >Thread-7075::DEBUG::2014-07-08 16:45:50,693::utils::738::root::(execCmd) /usr/libexec/vdsm/hooks/before_vm_start/50_hostedengine (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:51,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7075::DEBUG::2014-07-08 16:45:51,300::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-7075::INFO::2014-07-08 16:45:51,301::hooks::100::root::(_runHooksDir) >Thread-7075::DEBUG::2014-07-08 16:45:51,302::utils::738::root::(execCmd) /usr/libexec/vdsm/hooks/before_vm_start/50_nestedvt (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:45:51,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.161655 s, 6.3 MB/s\n'; <rc> = 0 >Thread-7075::DEBUG::2014-07-08 16:45:51,619::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-7075::INFO::2014-07-08 16:45:51,619::hooks::100::root::(_runHooksDir) >Thread-7075::DEBUG::2014-07-08 16:45:51,620::vm::3214::vm.Vm::(_run) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::<?xml version="1.0" encoding="utf-8"?><domain type="kvm"> > <name>vm1</name> > <uuid>9b0bd5aa-d706-426a-a077-62a64954b803</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="1">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/9b0bd5aa-d706-426a-a077-62a64954b803.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/9b0bd5aa-d706-426a-a077-62a64954b803.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <memballoon model="none"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x05" type="pci"/> > </controller> > <video> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x02" type="pci"/> > <model heads="1" type="qxl" vram="32768"/> > </video> > <graphics autoport="yes" keymap="en-us" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > <listen network="vdsm-ovirtmgmt" type="network"/> > </graphics> > <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/> > <mac address="00:1a:4a:16:88:5b"/> > <model type="virtio"/> > <source bridge="ovirtmgmt"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > <mac address="00:1a:4a:16:88:5c"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="file"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x07" type="pci"/> > <source file="/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76"/> > <target bus="virtio" dev="vda"/> > <serial>c1abf407-d743-43d7-85bb-157eec06157c</serial> > <driver cache="none" error_policy="stop" io="threads" name="qemu" type="raw"/> > </disk> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">oVirt</entry> > <entry name="product">oVirt Node</entry> > <entry name="version">6Server-6.5.0.1.el6</entry> > <entry name="serial">007EF314-A079-0010-A38A-0016367B3DFE</entry> > <entry name="uuid">9b0bd5aa-d706-426a-a077-62a64954b803</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > <timer name="pit" tickpolicy="delay"/> > <timer name="hpet" present="no"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Opteron_G1</model> > <topology cores="1" sockets="160" threads="1"/> > <feature name="svm" policy="require"/></cpu> ></domain> >libvirtEventLoop::DEBUG::2014-07-08 16:45:53,020::vm::5305::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::event Started detail 0 opaque None >Thread-7075::DEBUG::2014-07-08 16:45:53,083::vm::5145::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-7075::DEBUG::2014-07-08 16:45:53,084::vm::5166::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-7075::DEBUG::2014-07-08 16:45:53,085::vm::5185::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Matched {'name': (u'hdc', None), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, None), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, None), 'path': ('', None), 'type': (u'cdrom', None)} >Thread-7075::DEBUG::2014-07-08 16:45:53,085::vm::5145::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Looking for drive with attributes {'name': u'vda', 'bootOrder': '', 'boot': [], 'readonly': False, 'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'type': u'disk'} >Thread-7075::DEBUG::2014-07-08 16:45:53,086::vm::5166::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Matched {'name': (u'vda', u'vda'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, False), 'address': ({u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76'), 'type': (u'disk', u'disk')} >Thread-7075::DEBUG::2014-07-08 16:45:53,086::vm::5185::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Matched {'name': (u'vda', None), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, None), 'address': ({u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, None), 'path': (u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', None), 'type': (u'disk', None)} >Dummy-6860::DEBUG::2014-07-08 16:45:56,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:45:56,951::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:57,215::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6939::DEBUG::2014-07-08 16:45:57,224::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:45:57,231::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:57,245::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6939::DEBUG::2014-07-08 16:45:57,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`608deb08-d549-42f8-af7a-53f0ac18ee99`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:45:57,258::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6939::INFO::2014-07-08 16:45:57,262::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:45:57,268::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:57,277::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:57,286::__init__::225::IOProcess::(_processLogs) (273470) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:57,293::__init__::225::IOProcess::(_processLogs) (273470) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:57,302::__init__::225::IOProcess::(_processLogs) (273470) Building response >Thread-18::DEBUG::2014-07-08 16:45:57,311::__init__::225::IOProcess::(_processLogs) (273470) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:57,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:57,329::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:45:57,362::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6939::INFO::2014-07-08 16:45:57,520::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:45:57,629::task::1191::Storage.TaskManager.Task::(prepare) Task=`608deb08-d549-42f8-af7a-53f0ac18ee99`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:45:57,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000566539 s, 815 kB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:45:57,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`608deb08-d549-42f8-af7a-53f0ac18ee99`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:45:57,661::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:45:57,747::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-6939::DEBUG::2014-07-08 16:45:57,751::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-6860::DEBUG::2014-07-08 16:45:57,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.529759 s, 1.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:45:57,761::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6939::DEBUG::2014-07-08 16:45:57,763::task::993::Storage.TaskManager.Task::(_decref) Task=`608deb08-d549-42f8-af7a-53f0ac18ee99`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:45:57,775::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:57,788::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:57,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:57,812::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:57,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:57,830::__init__::225::IOProcess::(_processLogs) (273471) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:45:57,839::__init__::225::IOProcess::(_processLogs) (273471) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:45:57,845::__init__::225::IOProcess::(_processLogs) (273471) Building response >Thread-18::DEBUG::2014-07-08 16:45:57,849::__init__::225::IOProcess::(_processLogs) (273471) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:57,853::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:57,858::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:45:57,882::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:57,885::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:45:57,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:57,895::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:57,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:57,903::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:57,907::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:57,912::__init__::225::IOProcess::(_processLogs) (273472) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:57,916::__init__::225::IOProcess::(_processLogs) (273472) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:57,920::__init__::225::IOProcess::(_processLogs) (273472) Building response >Thread-18::DEBUG::2014-07-08 16:45:57,924::__init__::225::IOProcess::(_processLogs) (273472) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:57,928::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:57,932::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:57,948::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:57,954::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:45:57,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:57,964::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:57,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:57,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:57,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:57,980::__init__::225::IOProcess::(_processLogs) (273473) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:57,985::__init__::225::IOProcess::(_processLogs) (273473) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:57,990::__init__::225::IOProcess::(_processLogs) (273473) Building response >Thread-18::DEBUG::2014-07-08 16:45:57,995::__init__::225::IOProcess::(_processLogs) (273473) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:57,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,003::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:58,019::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,024::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:45:58,028::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,033::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,050::__init__::225::IOProcess::(_processLogs) (273474) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,054::__init__::225::IOProcess::(_processLogs) (273474) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,059::__init__::225::IOProcess::(_processLogs) DEBUG|(273474) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,062::__init__::225::IOProcess::(_processLogs) (273474) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,070::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:45:58,092::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:45:58,100::task::595::Storage.TaskManager.Task::(_updateState) Task=`db9df2a5-673a-412d-b6c2-f14006b14b20`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:45:58,104::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:45:58,115::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c40d4d5a-4df1-48d3-98a0-6d288fe22913`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:45:58,118::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:45:58,124::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:45:58,126::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c40d4d5a-4df1-48d3-98a0-6d288fe22913`::Granted request >Thread-6940::DEBUG::2014-07-08 16:45:58,134::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`db9df2a5-673a-412d-b6c2-f14006b14b20`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:45:58,137::task::993::Storage.TaskManager.Task::(_decref) Task=`db9df2a5-673a-412d-b6c2-f14006b14b20`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:45:58,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:58,210::task::1191::Storage.TaskManager.Task::(prepare) Task=`db9df2a5-673a-412d-b6c2-f14006b14b20`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:45:58,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`db9df2a5-673a-412d-b6c2-f14006b14b20`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:45:58,214::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:45:58,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:45:58,219::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:45:58,222::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:45:58,224::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:45:58,225::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:45:58,228::task::993::Storage.TaskManager.Task::(_decref) Task=`db9df2a5-673a-412d-b6c2-f14006b14b20`::ref 0 aborting False >Thread-7075::DEBUG::2014-07-08 16:45:58,648::vm::5621::vm.Vm::(_syncVolumeChain) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::vdsm chain: [u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76'], libvirt chain: [u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76'] >Thread-7075::DEBUG::2014-07-08 16:45:58,649::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3e141c4-0b19-4a26-a0e3-98675c04c704`::moving from state init -> state preparing >Thread-7075::INFO::2014-07-08 16:45:58,649::logUtils::44::dispatcher::(wrapper) Run and protect: imageSyncVolumeChain(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', newChain=[u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76']) >Thread-7075::DEBUG::2014-07-08 16:45:58,650::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c`ReqID=`50be1f5b-4731-4843-adec-c4238b4a052e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1818' at 'imageSyncVolumeChain' >Thread-7075::DEBUG::2014-07-08 16:45:58,651::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:45:58,652::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,652::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-18::DEBUG::2014-07-08 16:45:58,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,653::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,654::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,654::__init__::225::IOProcess::(_processLogs) (273475) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:45:58,654::__init__::225::IOProcess::(_processLogs) (273475) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:45:58,654::__init__::225::IOProcess::(_processLogs) (273475) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,655::__init__::225::IOProcess::(_processLogs) (273475) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,655::__init__::225::IOProcess::(_processLogs) Sending response sized 261 >Thread-18::DEBUG::2014-07-08 16:45:58,656::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,657::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-18::DEBUG::2014-07-08 16:45:58,657::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,658::__init__::225::IOProcess::(_processLogs) (273476) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:58,658::__init__::225::IOProcess::(_processLogs) (273476) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:58,659::__init__::225::IOProcess::(_processLogs) (273476) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,659::__init__::225::IOProcess::(_processLogs) (273476) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,659::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,659::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:45:58,661::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,661::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-18::DEBUG::2014-07-08 16:45:58,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,662::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,663::__init__::225::IOProcess::(_processLogs) (273477) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,663::__init__::225::IOProcess::(_processLogs) (273477) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,663::__init__::225::IOProcess::(_processLogs) (273477) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,664::__init__::225::IOProcess::(_processLogs) (273477) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,664::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7075::DEBUG::2014-07-08 16:45:58,665::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:45:58,665::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,666::__init__::225::IOProcess::(_processLogs) Message size is 238 >Thread-18::DEBUG::2014-07-08 16:45:58,666::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,666::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,667::__init__::225::IOProcess::(_processLogs) (273478) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,667::__init__::225::IOProcess::(_processLogs) (273478) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,668::__init__::225::IOProcess::(_processLogs) (273478) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,668::__init__::225::IOProcess::(_processLogs) (273478) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,668::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,668::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:58,670::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,670::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:45:58,670::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,670::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,671::__init__::225::IOProcess::(_processLogs) (273479) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,672::__init__::225::IOProcess::(_processLogs) (273479) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,672::__init__::225::IOProcess::(_processLogs) (273479) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,672::__init__::225::IOProcess::(_processLogs) (273479) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,672::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,673::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:58,674::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,674::__init__::225::IOProcess::(_processLogs) Message size is 250 >Thread-18::DEBUG::2014-07-08 16:45:58,674::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,675::__init__::225::IOProcess::(_processLogs) (273480) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:45:58,676::__init__::225::IOProcess::(_processLogs) (273480) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:45:58,681::__init__::225::IOProcess::(_processLogs) DEBUG|(273480) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,681::__init__::225::IOProcess::(_processLogs) (273480) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,682::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-18::DEBUG::2014-07-08 16:45:58,683::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,683::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-18::DEBUG::2014-07-08 16:45:58,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,684::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,685::__init__::225::IOProcess::(_processLogs) (273481) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:58,685::__init__::225::IOProcess::(_processLogs) (273481) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:58,685::__init__::225::IOProcess::(_processLogs) (273481) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,686::__init__::225::IOProcess::(_processLogs) (273481) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,686::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:45:58,688::__init__::225::IOProcess::(_processLogs) Message size is 206 >Thread-18::DEBUG::2014-07-08 16:45:58,688::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,688::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,689::__init__::225::IOProcess::(_processLogs) (273482) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,689::__init__::225::IOProcess::(_processLogs) (273482) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,689::__init__::225::IOProcess::(_processLogs) (273482) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,690::__init__::225::IOProcess::(_processLogs) (273482) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,690::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7075::DEBUG::2014-07-08 16:45:58,691::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:45:58,691::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:45:58,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,692::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,693::__init__::225::IOProcess::(_processLogs) (273483) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,693::__init__::225::IOProcess::(_processLogs) (273483) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,693::__init__::225::IOProcess::(_processLogs) (273483) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,693::__init__::225::IOProcess::(_processLogs) (273483) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,694::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,694::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:58,709::__init__::225::IOProcess::(_processLogs) Message size is 248 >Thread-18::DEBUG::2014-07-08 16:45:58,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,710::__init__::225::IOProcess::(_processLogs) (273484) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,711::__init__::225::IOProcess::(_processLogs) (273484) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,711::__init__::225::IOProcess::(_processLogs) (273484) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,711::__init__::225::IOProcess::(_processLogs) (273484) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,712::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:58,713::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:45:58,713::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,714::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,714::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,714::__init__::225::IOProcess::(_processLogs) (273485) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:45:58,714::__init__::225::IOProcess::(_processLogs) (273485) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:45:58,715::__init__::225::IOProcess::(_processLogs) (273485) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,715::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,715::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-18::DEBUG::2014-07-08 16:45:58,716::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-18::DEBUG::2014-07-08 16:45:58,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,717::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,718::__init__::225::IOProcess::(_processLogs) (273486) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:58,718::__init__::225::IOProcess::(_processLogs) (273486) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:58,718::__init__::225::IOProcess::(_processLogs) (273486) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,718::__init__::225::IOProcess::(_processLogs) (273486) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,719::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,719::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:45:58,720::__init__::225::IOProcess::(_processLogs) Message size is 206 >Thread-18::DEBUG::2014-07-08 16:45:58,721::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,722::__init__::225::IOProcess::(_processLogs) (273487) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,722::__init__::225::IOProcess::(_processLogs) (273487) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,722::__init__::225::IOProcess::(_processLogs) (273487) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,722::__init__::225::IOProcess::(_processLogs) (273487) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,723::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,723::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7075::DEBUG::2014-07-08 16:45:58,724::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:45:58,724::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:45:58,725::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,726::__init__::225::IOProcess::(_processLogs) (273488) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,726::__init__::225::IOProcess::(_processLogs) (273488) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,726::__init__::225::IOProcess::(_processLogs) (273488) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,726::__init__::225::IOProcess::(_processLogs) (273488) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,727::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,727::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:58,728::__init__::225::IOProcess::(_processLogs) Message size is 248 >Thread-18::DEBUG::2014-07-08 16:45:58,728::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,729::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,729::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,729::__init__::225::IOProcess::(_processLogs) (273489) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,730::__init__::225::IOProcess::(_processLogs) (273489) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,730::__init__::225::IOProcess::(_processLogs) (273489) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,730::__init__::225::IOProcess::(_processLogs) (273489) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,730::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,730::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:58,731::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:45:58,732::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,732::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,732::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,733::__init__::225::IOProcess::(_processLogs) (273490) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:45:58,733::__init__::225::IOProcess::(_processLogs) (273490) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:45:58,733::__init__::225::IOProcess::(_processLogs) (273490) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,734::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-18::DEBUG::2014-07-08 16:45:58,735::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:45:58,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,736::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,736::__init__::225::IOProcess::(_processLogs) (273491) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:45:58,736::__init__::225::IOProcess::(_processLogs) (273491) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:45:58,737::__init__::225::IOProcess::(_processLogs) (273491) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,737::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,737::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-7075::INFO::2014-07-08 16:45:58,738::image::213::Storage.Image::(getChain) sdUUID=2b5f401c-f143-45db-8578-1a8666cba539 imgUUID=c1abf407-d743-43d7-85bb-157eec06157c chain=[<storage.fileVolume.FileVolume object at 0x7f0df4b8ddd0>] >Thread-18::DEBUG::2014-07-08 16:45:58,739::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:45:58,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,740::__init__::225::IOProcess::(_processLogs) (273492) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:45:58,740::__init__::225::IOProcess::(_processLogs) (273492) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:45:58,741::__init__::225::IOProcess::(_processLogs) (273492) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,741::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-7075::DEBUG::2014-07-08 16:45:58,742::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76`ReqID=`45f28fc2-2616-4724-bbc4-bdf77f662208`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '172' at '__getResourceCandidatesList' >Thread-7075::DEBUG::2014-07-08 16:45:58,743::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' for lock type 'shared' >Thread-7075::DEBUG::2014-07-08 16:45:58,743::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' is free. Now locking as 'shared' (1 active user) >Thread-7075::DEBUG::2014-07-08 16:45:58,743::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76`ReqID=`45f28fc2-2616-4724-bbc4-bdf77f662208`::Granted request >Thread-7075::DEBUG::2014-07-08 16:45:58,744::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' is free. Now locking as 'shared' (1 active user) >Thread-7075::DEBUG::2014-07-08 16:45:58,744::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c`ReqID=`50be1f5b-4731-4843-adec-c4238b4a052e`::Granted request >Thread-18::DEBUG::2014-07-08 16:45:58,745::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-18::DEBUG::2014-07-08 16:45:58,746::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,747::__init__::225::IOProcess::(_processLogs) (273493) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:58,747::__init__::225::IOProcess::(_processLogs) (273493) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:58,747::__init__::225::IOProcess::(_processLogs) (273493) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,747::__init__::225::IOProcess::(_processLogs) (273493) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,748::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,748::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:45:58,749::__init__::225::IOProcess::(_processLogs) Message size is 206 >Thread-18::DEBUG::2014-07-08 16:45:58,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,751::__init__::225::IOProcess::(_processLogs) (273494) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,751::__init__::225::IOProcess::(_processLogs) (273494) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,751::__init__::225::IOProcess::(_processLogs) (273494) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,751::__init__::225::IOProcess::(_processLogs) (273494) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,752::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7075::DEBUG::2014-07-08 16:45:58,752::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:45:58,753::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:45:58,754::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,755::__init__::225::IOProcess::(_processLogs) (273495) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,755::__init__::225::IOProcess::(_processLogs) (273495) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,755::__init__::225::IOProcess::(_processLogs) (273495) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,755::__init__::225::IOProcess::(_processLogs) (273495) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,756::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:58,757::__init__::225::IOProcess::(_processLogs) Message size is 248 >Thread-18::DEBUG::2014-07-08 16:45:58,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,757::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,758::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,758::__init__::225::IOProcess::(_processLogs) (273496) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:45:58,759::__init__::225::IOProcess::(_processLogs) (273496) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:45:58,759::__init__::225::IOProcess::(_processLogs) (273496) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,759::__init__::225::IOProcess::(_processLogs) (273496) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,760::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:45:58,761::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,761::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:45:58,761::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,762::__init__::225::IOProcess::(_processLogs) (273497) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:45:58,763::__init__::225::IOProcess::(_processLogs) (273497) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:45:58,763::__init__::225::IOProcess::(_processLogs) DEBUG|(273497) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,763::__init__::225::IOProcess::(_processLogs) (273497) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,763::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,764::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-18::DEBUG::2014-07-08 16:45:58,765::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,765::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:45:58,765::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,766::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,766::__init__::225::IOProcess::(_processLogs) (273498) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:45:58,767::__init__::225::IOProcess::(_processLogs) (273498) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:45:58,767::__init__::225::IOProcess::(_processLogs) DEBUG|(273498) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,767::__init__::225::IOProcess::(_processLogs) (273498) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,767::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,768::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-7075::INFO::2014-07-08 16:45:58,768::image::213::Storage.Image::(getChain) sdUUID=2b5f401c-f143-45db-8578-1a8666cba539 imgUUID=c1abf407-d743-43d7-85bb-157eec06157c chain=[<storage.fileVolume.FileVolume object at 0x7f0de6905f90>] >Thread-7075::DEBUG::2014-07-08 16:45:58,769::hsm::1826::Storage.HSM::(imageSyncVolumeChain) unlinking subchain: [] >Thread-7075::DEBUG::2014-07-08 16:45:58,769::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' >Thread-7075::DEBUG::2014-07-08 16:45:58,769::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' (0 active users) >Thread-7075::DEBUG::2014-07-08 16:45:58,770::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' is free, finding out if anyone is waiting for it. >Thread-7075::DEBUG::2014-07-08 16:45:58,770::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' >Thread-7075::DEBUG::2014-07-08 16:45:58,770::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' (0 active users) >Thread-7075::DEBUG::2014-07-08 16:45:58,771::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' is free, finding out if anyone is waiting for it. >Thread-7075::DEBUG::2014-07-08 16:45:58,771::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76', Clearing records. >Thread-7075::DEBUG::2014-07-08 16:45:58,771::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c', Clearing records. >Thread-7075::INFO::2014-07-08 16:45:58,772::logUtils::47::dispatcher::(wrapper) Run and protect: imageSyncVolumeChain, Return response: None >Thread-7075::DEBUG::2014-07-08 16:45:58,772::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3e141c4-0b19-4a26-a0e3-98675c04c704`::finished: None >Thread-7075::DEBUG::2014-07-08 16:45:58,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3e141c4-0b19-4a26-a0e3-98675c04c704`::moving from state preparing -> state finished >Thread-7075::DEBUG::2014-07-08 16:45:58,772::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7075::DEBUG::2014-07-08 16:45:58,773::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7075::DEBUG::2014-07-08 16:45:58,773::task::993::Storage.TaskManager.Task::(_decref) Task=`b3e141c4-0b19-4a26-a0e3-98675c04c704`::ref 0 aborting False >Thread-7075::DEBUG::2014-07-08 16:45:58,774::sampling::361::vm.Vm::(start) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Start statistics collection >Thread-7077::DEBUG::2014-07-08 16:45:58,775::sampling::390::vm.Vm::(run) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Stats thread started >Thread-7077::DEBUG::2014-07-08 16:45:58,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad876d31-2450-45b1-8e48-7f14cce7324f`::moving from state init -> state preparing >Thread-7077::INFO::2014-07-08 16:45:58,777::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:45:58,778::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,779::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:45:58,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,779::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,780::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,781::__init__::225::IOProcess::(_processLogs) (273499) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:58,781::__init__::225::IOProcess::(_processLogs) (273499) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:58,781::__init__::225::IOProcess::(_processLogs) DEBUG|(273499) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,781::__init__::225::IOProcess::(_processLogs) (273499) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,782::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:45:58,784::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:45:58,784::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:45:58,785::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:45:58,785::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:45:58,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:45:58,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:45:58,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:45:58,786::__init__::225::IOProcess::(_processLogs) (273500) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:45:58,786::__init__::225::IOProcess::(_processLogs) (273500) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:45:58,786::__init__::225::IOProcess::(_processLogs) (273500) Building response >Thread-18::DEBUG::2014-07-08 16:45:58,787::__init__::225::IOProcess::(_processLogs) (273500) Queuing response >Thread-18::DEBUG::2014-07-08 16:45:58,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:45:58,787::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7077::INFO::2014-07-08 16:45:58,788::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7077::DEBUG::2014-07-08 16:45:58,789::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad876d31-2450-45b1-8e48-7f14cce7324f`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7077::DEBUG::2014-07-08 16:45:58,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad876d31-2450-45b1-8e48-7f14cce7324f`::moving from state preparing -> state finished >Thread-7077::DEBUG::2014-07-08 16:45:58,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7077::DEBUG::2014-07-08 16:45:58,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7077::DEBUG::2014-07-08 16:45:58,790::task::993::Storage.TaskManager.Task::(_decref) Task=`ad876d31-2450-45b1-8e48-7f14cce7324f`::ref 0 aborting False >Thread-7075::DEBUG::2014-07-08 16:45:58,828::vmchannels::199::vds::(register) Add fileno 54 to listener's channels. >Thread-7075::WARNING::2014-07-08 16:45:58,832::vm::3851::vm.Vm::(_readPauseCode) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::_readPauseCode unsupported by libvirt vm >Thread-7075::DEBUG::2014-07-08 16:45:58,912::vm::2212::vm.Vm::(_startUnderlyingVm) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::_ongoingCreations released >VM Channels Listener::DEBUG::2014-07-08 16:45:58,932::vmchannels::107::vds::(_do_add_channels) fileno 54 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-08 16:45:58,934::vmchannels::133::vds::(_handle_unconnected) Trying to connect fileno 54. >VM Channels Listener::DEBUG::2014-07-08 16:45:58,935::guestagent::199::vm.Vm::(_connect) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Attempting connection to /var/lib/libvirt/qemu/channels/9b0bd5aa-d706-426a-a077-62a64954b803.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-08 16:45:58,942::guestagent::202::vm.Vm::(_connect) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Connected to /var/lib/libvirt/qemu/channels/9b0bd5aa-d706-426a-a077-62a64954b803.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-08 16:45:58,943::vmchannels::149::vds::(_handle_unconnected) Connecting to fileno 54 succeeded. >Thread-7077::DEBUG::2014-07-08 16:45:58,954::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7077::ERROR::2014-07-08 16:45:58,955::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-6939::DEBUG::2014-07-08 16:46:00,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`93aefb47-1f2f-4f67-965b-f94777601d6f`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:46:00,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:46:00,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566539', 'lastCheck': '2.2', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:46:00,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`93aefb47-1f2f-4f67-965b-f94777601d6f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566539', 'lastCheck': '2.2', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:46:00,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`93aefb47-1f2f-4f67-965b-f94777601d6f`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:46:00,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:46:00,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:46:00,263::task::993::Storage.TaskManager.Task::(_decref) Task=`93aefb47-1f2f-4f67-965b-f94777601d6f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:46:00,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:00,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172758 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:02,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:03,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112271 s, 9.1 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:03,404::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-6939::DEBUG::2014-07-08 16:46:03,406::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'hash': '4175313268389868316', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '3533', 'displayIp': '10.35.128.17', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'memUsage': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'elapsedTime': '13', 'kvmEnable': 'true', 'network': {}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'vmType': 'kvm', 'cpuUser': '0.00', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.39', 'username': 'Unknown', 'displayType': 'qxl', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-6860::DEBUG::2014-07-08 16:46:05,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:05,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169771 s, 60.3 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:06,431::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-6939::DEBUG::2014-07-08 16:46:06,432::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'hash': '4175313268389868316', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '3533', 'displayIp': '10.35.128.17', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'memUsage': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'elapsedTime': '16', 'kvmEnable': 'true', 'network': {}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'vmType': 'kvm', 'cpuUser': '0.00', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.33', 'username': 'Unknown', 'displayType': 'qxl', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-6860::DEBUG::2014-07-08 16:46:07,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:07,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173174 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:08,083::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:08,084::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:08,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:08,084::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:08,085::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:08,085::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:08,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:08,085::__init__::225::IOProcess::(_processLogs) (273501) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:08,086::__init__::225::IOProcess::(_processLogs) (273501) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:08,086::__init__::225::IOProcess::(_processLogs) (273501) Building response >Thread-18::DEBUG::2014-07-08 16:46:08,086::__init__::225::IOProcess::(_processLogs) (273501) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:08,086::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:08,086::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:46:08,088::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:46:08,324::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:46:08,325::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00248573 s, 186 kB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:08,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbebd506-e06b-45a5-8263-546286766448`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:46:08,338::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-6939::INFO::2014-07-08 16:46:08,340::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:46:08,343::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:08,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:08,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:08,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:08,345::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:08,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:08,345::__init__::225::IOProcess::(_processLogs) (273502) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:08,345::__init__::225::IOProcess::(_processLogs) (273502) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:08,346::__init__::225::IOProcess::(_processLogs) (273502) Building response >Thread-18::DEBUG::2014-07-08 16:46:08,346::__init__::225::IOProcess::(_processLogs) (273502) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:08,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:08,346::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:46:08,350::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:08,351::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:46:08,351::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:08,351::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:08,352::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:08,352::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:08,352::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:08,353::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:08,353::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'...DEBUG|(273503) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:08,354::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'...DEBUG|(273503) Got request for method 'access'DEBUG|(273503) Building response >Thread-18::DEBUG::2014-07-08 16:46:08,354::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'...DEBUG|(273503) Got request for method 'access'DEBUG|(273503) Building responseDEBUG|(273503) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:08,355::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'...DEBUG|(273503) Got request for method 'access'DEBUG|(273503) Building responseDEBUG|(273503) Queuing responseDEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:46:08,355::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:08,356::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'...DEBUG|(273503) Got request for method 'access'DEBUG|(273503) Building responseDEBUG|(273503) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:08,357::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:46:08,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:08,357::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:08,357::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:08,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:08,358::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'...DEBUG|(273503) Got request for method 'access'DEBUG|(273503) Building responseDEBUG|(273503) Queuing responseDEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:08,358::__init__::225::IOProcess::(_processLogs) (273504) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:08,358::__init__::225::IOProcess::(_processLogs) (273504) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:08,359::__init__::225::IOProcess::(_processLogs) (273504) Building response >Thread-18::DEBUG::2014-07-08 16:46:08,359::__init__::225::IOProcess::(_processLogs) (273504) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:08,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:08,359::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:08,361::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'...DEBUG|(273503) Got request for method 'access'DEBUG|(273503) Building responseDEBUG|(273503) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:08,361::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:46:08,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:08,362::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:08,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:08,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:08,367::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'...DEBUG|(273503) Got request for method 'access'DEBUG|(273503) Building responseDEBUG|(273503) Queuing responseDEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:08,367::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information...DEBUG|(273503) Finding callback 'access'...DEBUG|(273503) Got request for method 'access'DEBUG|(273503) Building responseDEBUG|(273503) Queuing responseDEBUGDEBUG|(273505) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:08,368::__init__::225::IOProcess::(_processLogs) (273505) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:08,373::__init__::225::IOProcess::(_processLogs) (273505) Got request for method 'access'DEBUG|(273505) Building response >Thread-18::DEBUG::2014-07-08 16:46:08,373::__init__::225::IOProcess::(_processLogs) (273505) Got request for method 'access'DEBUG|(273505) Building responseDEBUG|(273505) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:08,374::__init__::225::IOProcess::(_processLogs) (273505) Got request for method 'access'DEBUG|(273505) Building responseDEBUG|(273505) Queuing responseDEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:46:08,374::__init__::225::IOProcess::(_processLogs) (273505) Got request for method 'access'DEBUG|(273505) Building responseDEBUG|(273505) Queuing responseDEBUG|Sending response sized 76 >Thread-6939::INFO::2014-07-08 16:46:08,375::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:46:08,376::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbebd506-e06b-45a5-8263-546286766448`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:46:08,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbebd506-e06b-45a5-8263-546286766448`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:46:08,377::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:46:08,378::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:46:08,379::task::993::Storage.TaskManager.Task::(_decref) Task=`cbebd506-e06b-45a5-8263-546286766448`::ref 0 aborting False >Thread-6940::DEBUG::2014-07-08 16:46:08,390::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:46:08,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0610b28-e36f-4c48-a0b8-b5577eb9f755`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:46:08,391::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:46:08,393::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f05c87de-2de5-4b1a-bf27-bc34fc4dd6e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:46:08,393::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:46:08,394::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:46:08,394::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f05c87de-2de5-4b1a-bf27-bc34fc4dd6e0`::Granted request >Thread-6940::DEBUG::2014-07-08 16:46:08,395::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e0610b28-e36f-4c48-a0b8-b5577eb9f755`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:46:08,395::task::993::Storage.TaskManager.Task::(_decref) Task=`e0610b28-e36f-4c48-a0b8-b5577eb9f755`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:46:08,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:46:08,491::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0610b28-e36f-4c48-a0b8-b5577eb9f755`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:46:08,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0610b28-e36f-4c48-a0b8-b5577eb9f755`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:46:08,492::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:46:08,493::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:46:08,494::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:46:08,494::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:46:08,495::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:46:08,495::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:46:08,496::task::993::Storage.TaskManager.Task::(_decref) Task=`e0610b28-e36f-4c48-a0b8-b5577eb9f755`::ref 0 aborting False >Thread-6939::DEBUG::2014-07-08 16:46:09,454::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-6939::DEBUG::2014-07-08 16:46:09,456::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'hash': '4175313268389868316', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '3533', 'displayIp': '10.35.128.17', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'memUsage': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'elapsedTime': '19', 'kvmEnable': 'true', 'network': {}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'vmType': 'kvm', 'cpuUser': '0.00', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.35', 'username': 'Unknown', 'displayType': 'qxl', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-6860::DEBUG::2014-07-08 16:46:09,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:10,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0217067 s, 47.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:12,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:12,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0222676 s, 46.0 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:12,480::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-6939::DEBUG::2014-07-08 16:46:12,482::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'hash': '4175313268389868316', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '3533', 'displayIp': '10.35.128.17', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'memUsage': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'elapsedTime': '22', 'kvmEnable': 'true', 'network': {}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'vmType': 'kvm', 'cpuUser': '0.00', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.38', 'username': 'Unknown', 'displayType': 'qxl', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-7077::DEBUG::2014-07-08 16:46:14,154::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7077::ERROR::2014-07-08 16:46:14,155::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:46:14,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:14,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170171 s, 60.2 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:15,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`031732a2-e130-451b-9fb8-01eeb1877c33`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:46:15,511::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:46:15,512::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00248573', 'lastCheck': '7.1', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:46:15,512::task::1191::Storage.TaskManager.Task::(prepare) Task=`031732a2-e130-451b-9fb8-01eeb1877c33`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00248573', 'lastCheck': '7.1', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:46:15,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`031732a2-e130-451b-9fb8-01eeb1877c33`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:46:15,512::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:46:15,513::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:46:15,513::task::993::Storage.TaskManager.Task::(_decref) Task=`031732a2-e130-451b-9fb8-01eeb1877c33`::ref 0 aborting False >Thread-6939::DEBUG::2014-07-08 16:46:15,591::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:46:16,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:16,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0227677 s, 45.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:18,380::__init__::225::IOProcess::(_processLogs) (273505) Got request for method 'access'DEBUG|(273505) Building responseDEBUG|(273505) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:18,380::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:18,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:18,381::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:18,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:18,381::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:18,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:18,382::__init__::225::IOProcess::(_processLogs) (273506) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:18,382::__init__::225::IOProcess::(_processLogs) (273506) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:18,382::__init__::225::IOProcess::(_processLogs) (273506) Building response >Thread-18::DEBUG::2014-07-08 16:46:18,382::__init__::225::IOProcess::(_processLogs) (273506) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:18,383::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:18,383::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:46:18,384::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:46:18,535::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:46:18,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ee12cc2-6164-4ed8-8f9b-0a31b2782d21`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:46:18,537::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 16:46:18,539::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00423116 s, 109 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:18,541::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:18,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:18,542::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:18,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:18,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:18,543::__init__::225::IOProcess::(_processLogs) (273507) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:18,543::__init__::225::IOProcess::(_processLogs) (273507) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:18,543::__init__::225::IOProcess::(_processLogs) (273507) Building response >Thread-18::DEBUG::2014-07-08 16:46:18,543::__init__::225::IOProcess::(_processLogs) (273507) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:18,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:18,544::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:46:18,546::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:46:18,546::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:18,547::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:18,547::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:18,547::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:18,547::__init__::225::IOProcess::(_processLogs) (273508) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:18,548::__init__::225::IOProcess::(_processLogs) (273508) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:18,548::__init__::225::IOProcess::(_processLogs) (273508) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:18,549::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:18,550::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:46:18,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:18,550::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:18,550::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:18,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:18,551::__init__::225::IOProcess::(_processLogs) (273509) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:18,551::__init__::225::IOProcess::(_processLogs) (273509) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:18,552::__init__::225::IOProcess::(_processLogs) (273509) Building response >Thread-18::DEBUG::2014-07-08 16:46:18,552::__init__::225::IOProcess::(_processLogs) (273509) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:18,552::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:18,552::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:18,553::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:18,554::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:46:18,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:18,555::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6939::INFO::2014-07-08 16:46:18,555::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:46:18,556::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6939::DEBUG::2014-07-08 16:46:18,557::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ee12cc2-6164-4ed8-8f9b-0a31b2782d21`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:46:18,558::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6939::DEBUG::2014-07-08 16:46:18,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ee12cc2-6164-4ed8-8f9b-0a31b2782d21`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:46:18,559::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-6939::DEBUG::2014-07-08 16:46:18,560::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:46:18,561::__init__::225::IOProcess::(_processLogs) (273510) Finding callback 'access'... >Thread-6939::DEBUG::2014-07-08 16:46:18,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:46:18,562::__init__::225::IOProcess::(_processLogs) (273510) Got request for method 'access' >Thread-6939::DEBUG::2014-07-08 16:46:18,562::task::993::Storage.TaskManager.Task::(_decref) Task=`0ee12cc2-6164-4ed8-8f9b-0a31b2782d21`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:46:18,563::__init__::225::IOProcess::(_processLogs) (273510) Building response >Thread-18::DEBUG::2014-07-08 16:46:18,565::__init__::225::IOProcess::(_processLogs) (273510) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:18,566::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:18,567::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:46:18,577::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:46:18,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`52615e13-af06-4c48-889a-cc5d9c934843`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:46:18,578::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:46:18,579::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4a52b3a1-50d9-4012-b8e5-f2d87fa9bc11`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:46:18,580::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:46:18,580::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:46:18,580::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4a52b3a1-50d9-4012-b8e5-f2d87fa9bc11`::Granted request >Thread-6940::DEBUG::2014-07-08 16:46:18,581::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`52615e13-af06-4c48-889a-cc5d9c934843`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:46:18,581::task::993::Storage.TaskManager.Task::(_decref) Task=`52615e13-af06-4c48-889a-cc5d9c934843`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:46:18,600::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:46:18,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`52615e13-af06-4c48-889a-cc5d9c934843`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:46:18,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`52615e13-af06-4c48-889a-cc5d9c934843`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:46:18,601::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:46:18,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:46:18,602::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:46:18,602::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:46:18,603::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:46:18,603::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:46:18,603::task::993::Storage.TaskManager.Task::(_decref) Task=`52615e13-af06-4c48-889a-cc5d9c934843`::ref 0 aborting False >Thread-6939::DEBUG::2014-07-08 16:46:18,696::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-6939::DEBUG::2014-07-08 16:46:18,698::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-6939::DEBUG::2014-07-08 16:46:18,699::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '3533', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '28.27', 'elapsedTime': '28', 'displayType': 'qxl', 'cpuSys': '35.92', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.54', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:46:18,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:19,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0929678 s, 11.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:21,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:21,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169802 s, 60.3 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:21,770::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-6939::DEBUG::2014-07-08 16:46:21,772::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-6939::DEBUG::2014-07-08 16:46:21,772::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '3533', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '28.27', 'elapsedTime': '31', 'displayType': 'qxl', 'cpuSys': '35.92', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.56', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >GuestMonitor-vm1::DEBUG::2014-07-08 16:46:21,981::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:46:21,982::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:46:21,983::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:46:23,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:23,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170964 s, 59.9 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:24,803::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-6939::DEBUG::2014-07-08 16:46:24,805::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-6939::DEBUG::2014-07-08 16:46:24,805::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '3533', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '28.27', 'elapsedTime': '34', 'displayType': 'qxl', 'cpuSys': '35.92', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.59', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:46:25,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:26,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169386 s, 60.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:46:26,991::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:46:26,992::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:46:26,993::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-6939::DEBUG::2014-07-08 16:46:27,829::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-6939::DEBUG::2014-07-08 16:46:27,830::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-6939::DEBUG::2014-07-08 16:46:27,831::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '3533', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '28.27', 'elapsedTime': '37', 'displayType': 'qxl', 'cpuSys': '35.92', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.61', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:46:28,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:28,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169369 s, 60.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:28,571::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:28,571::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:28,571::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:28,572::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:28,572::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:28,572::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:28,572::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:28,573::__init__::225::IOProcess::(_processLogs) (273511) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:28,573::__init__::225::IOProcess::(_processLogs) (273511) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:28,573::__init__::225::IOProcess::(_processLogs) (273511) Building response >Thread-18::DEBUG::2014-07-08 16:46:28,573::__init__::225::IOProcess::(_processLogs) (273511) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:28,574::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:46:28,574::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:46:28,576::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:46:28,723::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6939::DEBUG::2014-07-08 16:46:28,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`de5f9ec4-c7fb-4ec8-8eb6-dc984638f6d9`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:46:28,727::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 16:46:28,727::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000418478 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:28,731::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:28,731::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:28,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:28,732::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:28,732::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:28,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:28,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:28,733::__init__::225::IOProcess::(_processLogs) (273512) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:28,733::__init__::225::IOProcess::(_processLogs) (273512) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:28,738::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(273512) Building response >Thread-18::DEBUG::2014-07-08 16:46:28,738::__init__::225::IOProcess::(_processLogs) (273512) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:28,739::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:46:28,739::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:46:28,744::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:28,745::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:46:28,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:28,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:28,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6939::INFO::2014-07-08 16:46:28,746::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:46:28,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6939::DEBUG::2014-07-08 16:46:28,748::task::1191::Storage.TaskManager.Task::(prepare) Task=`de5f9ec4-c7fb-4ec8-8eb6-dc984638f6d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:46:28,749::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-6939::DEBUG::2014-07-08 16:46:28,750::task::595::Storage.TaskManager.Task::(_updateState) Task=`de5f9ec4-c7fb-4ec8-8eb6-dc984638f6d9`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:46:28,750::__init__::225::IOProcess::(_processLogs) (273513) Finding callback 'access'... >Thread-6939::DEBUG::2014-07-08 16:46:28,751::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:46:28,752::__init__::225::IOProcess::(_processLogs) (273513) Got request for method 'access' >Thread-6939::DEBUG::2014-07-08 16:46:28,753::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:46:28,753::__init__::225::IOProcess::(_processLogs) (273513) Building response >Thread-6939::DEBUG::2014-07-08 16:46:28,754::task::993::Storage.TaskManager.Task::(_decref) Task=`de5f9ec4-c7fb-4ec8-8eb6-dc984638f6d9`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:46:28,755::__init__::225::IOProcess::(_processLogs) (273513) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:28,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:28,758::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:28,761::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:28,761::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:46:28,761::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:28,762::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:28,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:28,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:28,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:28,763::__init__::225::IOProcess::(_processLogs) (273514) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:28,763::__init__::225::IOProcess::(_processLogs) (273514) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:28,763::__init__::225::IOProcess::(_processLogs) (273514) Building response >Thread-18::DEBUG::2014-07-08 16:46:28,763::__init__::225::IOProcess::(_processLogs) (273514) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:28,764::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:28,764::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:28,765::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:28,765::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:46:28,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:28,766::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:28,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:28,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:28,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:28,767::__init__::225::IOProcess::(_processLogs) (273515) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:28,767::__init__::225::IOProcess::(_processLogs) (273515) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:28,767::__init__::225::IOProcess::(_processLogs) (273515) Building response >Thread-18::DEBUG::2014-07-08 16:46:28,768::__init__::225::IOProcess::(_processLogs) (273515) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:28,768::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:28,768::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:46:28,771::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-6940::DEBUG::2014-07-08 16:46:28,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`04c1b941-7b2a-4e9e-9fac-5e8297ef67d5`::moving from state init -> state preparing >Thread-6940::INFO::2014-07-08 16:46:28,772::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-6940::DEBUG::2014-07-08 16:46:28,773::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e0977041-eb93-48bd-b2c7-73e23faa7129`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:46:28,773::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-6940::DEBUG::2014-07-08 16:46:28,774::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-6940::DEBUG::2014-07-08 16:46:28,774::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e0977041-eb93-48bd-b2c7-73e23faa7129`::Granted request >Thread-6940::DEBUG::2014-07-08 16:46:28,775::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`04c1b941-7b2a-4e9e-9fac-5e8297ef67d5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:46:28,775::task::993::Storage.TaskManager.Task::(_decref) Task=`04c1b941-7b2a-4e9e-9fac-5e8297ef67d5`::ref 1 aborting False >Thread-6940::INFO::2014-07-08 16:46:28,795::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:46:28,797::task::1191::Storage.TaskManager.Task::(prepare) Task=`04c1b941-7b2a-4e9e-9fac-5e8297ef67d5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:46:28,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`04c1b941-7b2a-4e9e-9fac-5e8297ef67d5`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:46:28,798::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:46:28,799::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:46:28,801::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:46:28,804::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:46:28,804::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:46:28,805::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:46:28,807::task::993::Storage.TaskManager.Task::(_decref) Task=`04c1b941-7b2a-4e9e-9fac-5e8297ef67d5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-08 16:46:29,127::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 54. >Thread-7077::DEBUG::2014-07-08 16:46:29,244::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7077::ERROR::2014-07-08 16:46:29,244::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-6939::DEBUG::2014-07-08 16:46:30,414::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmDestroy with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} flowID [28c5342e] >Thread-6939::INFO::2014-07-08 16:46:30,414::API::333::vds::(destroy) vmContainerLock acquired by vm 9b0bd5aa-d706-426a-a077-62a64954b803 >Thread-6939::DEBUG::2014-07-08 16:46:30,415::vm::4768::vm.Vm::(destroy) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::destroy Called >Thread-6939::INFO::2014-07-08 16:46:30,415::vm::4701::vm.Vm::(releaseVm) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Release VM resources >Dummy-6860::DEBUG::2014-07-08 16:46:30,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:30,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0814566 s, 12.6 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:30,780::sampling::368::vm.Vm::(stop) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Stop statistics collection >Thread-7077::DEBUG::2014-07-08 16:46:30,782::sampling::399::vm.Vm::(run) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Stats thread finished >Thread-6939::DEBUG::2014-07-08 16:46:30,782::vmchannels::210::vds::(unregister) Delete fileno 54 from listener. >VM Channels Listener::DEBUG::2014-07-08 16:46:31,130::vmchannels::117::vds::(_do_del_channels) fileno 54 was removed from listener. >libvirtEventLoop::DEBUG::2014-07-08 16:46:31,449::vm::5305::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::event Stopped detail 1 opaque None >Thread-6939::DEBUG::2014-07-08 16:46:31,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`d949671d-2657-4861-b87f-1cf6fcca3797`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-07-08 16:46:31,452::vm::2285::vm.Vm::(_onQemuDeath) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::underlying process disconnected >Thread-6939::INFO::2014-07-08 16:46:31,453::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID=None) >Thread-6939::DEBUG::2014-07-08 16:46:31,454::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.2b5f401c-f143-45db-8578-1a8666cba539`ReqID=`66356092-efc9-41e8-9193-b8ad4aaaca6b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3249' at 'teardownImage' >Thread-6939::DEBUG::2014-07-08 16:46:31,454::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' for lock type 'shared' >Thread-6939::DEBUG::2014-07-08 16:46:31,455::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' is free. Now locking as 'shared' (1 active user) >Thread-6939::DEBUG::2014-07-08 16:46:31,455::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.2b5f401c-f143-45db-8578-1a8666cba539`ReqID=`66356092-efc9-41e8-9193-b8ad4aaaca6b`::Granted request >Thread-6939::DEBUG::2014-07-08 16:46:31,456::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d949671d-2657-4861-b87f-1cf6fcca3797`::_resourcesAcquired: Storage.2b5f401c-f143-45db-8578-1a8666cba539 (shared) >Thread-6939::DEBUG::2014-07-08 16:46:31,456::task::993::Storage.TaskManager.Task::(_decref) Task=`d949671d-2657-4861-b87f-1cf6fcca3797`::ref 1 aborting False >Thread-6939::INFO::2014-07-08 16:46:31,456::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-6939::DEBUG::2014-07-08 16:46:31,457::task::1191::Storage.TaskManager.Task::(prepare) Task=`d949671d-2657-4861-b87f-1cf6fcca3797`::finished: None >Thread-6939::DEBUG::2014-07-08 16:46:31,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`d949671d-2657-4861-b87f-1cf6fcca3797`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:46:31,457::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.2b5f401c-f143-45db-8578-1a8666cba539': < ResourceRef 'Storage.2b5f401c-f143-45db-8578-1a8666cba539', isValid: 'True' obj: 'None'>} >Thread-6939::DEBUG::2014-07-08 16:46:31,457::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:46:31,458::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' >Thread-6939::DEBUG::2014-07-08 16:46:31,458::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' (0 active users) >Thread-6939::DEBUG::2014-07-08 16:46:31,458::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' is free, finding out if anyone is waiting for it. >Thread-6939::DEBUG::2014-07-08 16:46:31,458::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539', Clearing records. >Thread-6939::DEBUG::2014-07-08 16:46:31,459::task::993::Storage.TaskManager.Task::(_decref) Task=`d949671d-2657-4861-b87f-1cf6fcca3797`::ref 0 aborting False >Thread-6939::DEBUG::2014-07-08 16:46:31,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`b521e31c-580e-469d-8900-25ea1bf46d89`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:46:31,462::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='9b0bd5aa-d706-426a-a077-62a64954b803') >Thread-6939::INFO::2014-07-08 16:46:31,476::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-6939::DEBUG::2014-07-08 16:46:31,476::task::1191::Storage.TaskManager.Task::(prepare) Task=`b521e31c-580e-469d-8900-25ea1bf46d89`::finished: None >Thread-6939::DEBUG::2014-07-08 16:46:31,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`b521e31c-580e-469d-8900-25ea1bf46d89`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:46:31,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:46:31,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:46:31,477::task::993::Storage.TaskManager.Task::(_decref) Task=`b521e31c-580e-469d-8900-25ea1bf46d89`::ref 0 aborting False >Thread-6939::DEBUG::2014-07-08 16:46:31,479::vm::4762::vm.Vm::(deleteVm) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Total desktops after destroy of 9b0bd5aa-d706-426a-a077-62a64954b803 is 0 >libvirtEventLoop::DEBUG::2014-07-08 16:46:31,479::vm::2729::vm.Vm::(setDownStatus) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Changed state to Down: Admin shut down from the engine (code=6) >Thread-6939::DEBUG::2014-07-08 16:46:31,481::BindingXMLRPC::1114::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >libvirtEventLoop::DEBUG::2014-07-08 16:46:31,481::sampling::368::vm.Vm::(stop) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Stop statistics collection >Thread-6939::DEBUG::2014-07-08 16:46:31,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3cee119-6531-4254-950d-ad73437d36b8`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:46:31,515::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:46:31,516::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418478', 'lastCheck': '2.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:46:31,516::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3cee119-6531-4254-950d-ad73437d36b8`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418478', 'lastCheck': '2.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:46:31,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3cee119-6531-4254-950d-ad73437d36b8`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:46:31,517::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:46:31,517::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:46:31,517::task::993::Storage.TaskManager.Task::(_decref) Task=`d3cee119-6531-4254-950d-ad73437d36b8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:46:32,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:33,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176281 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:35,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:35,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172316 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:37,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:37,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169685 s, 60.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:38,775::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:38,778::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:38,780::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:38,781::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:38,782::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:38,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:38,784::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:38,785::__init__::225::IOProcess::(_processLogs) (273516) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:38,786::__init__::225::IOProcess::(_processLogs) (273516) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:38,787::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(273516) Building response >Thread-18::DEBUG::2014-07-08 16:46:38,788::__init__::225::IOProcess::(_processLogs) (273516) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:38,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:38,790::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:46:38,797::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:46:38,959::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000568774 s, 812 kB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:38,962::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:46:38,979::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-6939::DEBUG::2014-07-08 16:46:38,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbba0001-cfdc-4320-921c-2dabfc8a5d28`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:46:38,987::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6939::INFO::2014-07-08 16:46:38,987::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:46:38,990::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:38,992::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:38,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:38,996::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:39,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:39,008::__init__::225::IOProcess::(_processLogs) (273517) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:39,010::__init__::225::IOProcess::(_processLogs) (273517) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:39,011::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(273517) Building response >Thread-6939::INFO::2014-07-08 16:46:39,012::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:46:39,014::__init__::225::IOProcess::(_processLogs) (273517) Queuing response >Thread-6939::DEBUG::2014-07-08 16:46:39,014::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbba0001-cfdc-4320-921c-2dabfc8a5d28`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:46:39,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbba0001-cfdc-4320-921c-2dabfc8a5d28`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:46:39,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6939::DEBUG::2014-07-08 16:46:39,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:46:39,021::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6939::DEBUG::2014-07-08 16:46:39,021::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:46:39,025::task::993::Storage.TaskManager.Task::(_decref) Task=`cbba0001-cfdc-4320-921c-2dabfc8a5d28`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:46:39,036::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:39,037::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:46:39,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:39,038::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:39,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:39,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:39,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:39,039::__init__::225::IOProcess::(_processLogs) (273518) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:39,039::__init__::225::IOProcess::(_processLogs) (273518) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:39,040::__init__::225::IOProcess::(_processLogs) (273518) Building response >Thread-18::DEBUG::2014-07-08 16:46:39,040::__init__::225::IOProcess::(_processLogs) (273518) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:39,041::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:39,041::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:39,045::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:39,049::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-6940::DEBUG::2014-07-08 16:46:39,051::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:46:39,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:39,055::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::DEBUG::2014-07-08 16:46:39,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`70601648-e23e-4c23-96c2-f7cb4cf92fd2`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:46:39,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::INFO::2014-07-08 16:46:39,060::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:46:39,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:46:39,072::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`978bdb30-c000-43cc-a554-9b546e65fbd3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:46:39,074::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:46:39,076::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:46:39,078::__init__::225::IOProcess::(_processLogs) (273519) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:46:39,081::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:46:39,081::__init__::225::IOProcess::(_processLogs) (273519) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:46:39,083::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`978bdb30-c000-43cc-a554-9b546e65fbd3`::Granted request >Thread-18::DEBUG::2014-07-08 16:46:39,084::__init__::225::IOProcess::(_processLogs) (273519) Building response >Thread-18::DEBUG::2014-07-08 16:46:39,087::__init__::225::IOProcess::(_processLogs) (273519) Queuing response >Thread-6940::DEBUG::2014-07-08 16:46:39,090::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`70601648-e23e-4c23-96c2-f7cb4cf92fd2`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:46:39,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-6940::DEBUG::2014-07-08 16:46:39,093::task::993::Storage.TaskManager.Task::(_decref) Task=`70601648-e23e-4c23-96c2-f7cb4cf92fd2`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:46:39,093::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:39,106::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:39,109::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:46:39,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:39,117::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:39,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:39,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:39,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:39,127::__init__::225::IOProcess::(_processLogs) (273520) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:39,129::__init__::225::IOProcess::(_processLogs) (273520) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:39,130::__init__::225::IOProcess::(_processLogs) (273520) Building response >Thread-18::DEBUG::2014-07-08 16:46:39,131::__init__::225::IOProcess::(_processLogs) (273520) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:39,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:39,134::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::INFO::2014-07-08 16:46:39,140::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:46:39,141::task::1191::Storage.TaskManager.Task::(prepare) Task=`70601648-e23e-4c23-96c2-f7cb4cf92fd2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-6940::DEBUG::2014-07-08 16:46:39,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`70601648-e23e-4c23-96c2-f7cb4cf92fd2`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:46:39,143::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-6940::DEBUG::2014-07-08 16:46:39,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6940::DEBUG::2014-07-08 16:46:39,147::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-6940::DEBUG::2014-07-08 16:46:39,149::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-6940::DEBUG::2014-07-08 16:46:39,150::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:46:39,151::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-6940::DEBUG::2014-07-08 16:46:39,152::task::993::Storage.TaskManager.Task::(_decref) Task=`70601648-e23e-4c23-96c2-f7cb4cf92fd2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:46:39,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:39,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178054 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:42,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:42,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170763 s, 60.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:44,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:44,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0217679 s, 47.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:46,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:46,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172294 s, 59.4 MB/s\n'; <rc> = 0 >Thread-6939::DEBUG::2014-07-08 16:46:46,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`47e56088-66ac-46e6-bc5e-76f4ff1b655c`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:46:46,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-6939::INFO::2014-07-08 16:46:46,835::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568774', 'lastCheck': '7.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:46:46,836::task::1191::Storage.TaskManager.Task::(prepare) Task=`47e56088-66ac-46e6-bc5e-76f4ff1b655c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568774', 'lastCheck': '7.7', 'valid': True}} >Thread-6939::DEBUG::2014-07-08 16:46:46,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`47e56088-66ac-46e6-bc5e-76f4ff1b655c`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:46:46,838::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:46:46,838::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-6939::DEBUG::2014-07-08 16:46:46,839::task::993::Storage.TaskManager.Task::(_decref) Task=`47e56088-66ac-46e6-bc5e-76f4ff1b655c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:46:48,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:49,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171442 s, 59.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:49,146::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:49,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:49,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:49,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:49,162::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:49,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:49,170::__init__::225::IOProcess::(_processLogs) (273521) Got request for method 'statvfs' >Thread-6939::DEBUG::2014-07-08 16:46:49,177::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:46:49,179::__init__::225::IOProcess::(_processLogs) (273521) Building response >Thread-6939::DEBUG::2014-07-08 16:46:49,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1f59d83-52de-434e-a8c7-8df9d748f592`::moving from state init -> state preparing >Thread-6939::INFO::2014-07-08 16:46:49,189::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:46:49,189::__init__::225::IOProcess::(_processLogs) (273521) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:49,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:49,196::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6939::INFO::2014-07-08 16:46:49,207::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:46:49,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1f59d83-52de-434e-a8c7-8df9d748f592`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-6939::DEBUG::2014-07-08 16:46:49,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1f59d83-52de-434e-a8c7-8df9d748f592`::moving from state preparing -> state finished >Thread-6939::DEBUG::2014-07-08 16:46:49,230::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-6939::DEBUG::2014-07-08 16:46:49,235::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-08 16:46:49,237::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-6939::DEBUG::2014-07-08 16:46:49,242::task::993::Storage.TaskManager.Task::(_decref) Task=`d1f59d83-52de-434e-a8c7-8df9d748f592`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 16:46:49,411::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000559553 s, 826 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:49,431::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-6940::DEBUG::2014-07-08 16:46:49,436::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:46:49,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-6940::DEBUG::2014-07-08 16:46:49,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c227dd4-43ed-4638-b607-799a1592e41c`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:46:49,445::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::INFO::2014-07-08 16:46:49,449::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:46:49,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:49,457::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:49,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-6940::DEBUG::2014-07-08 16:46:49,461::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8ab0df45-53dd-4252-a0c7-fdfcb37a422c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-6940::DEBUG::2014-07-08 16:46:49,464::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:46:49,465::__init__::225::IOProcess::(_processLogs) (273522) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:49,470::__init__::225::IOProcess::(_processLogs) (273522) Got request for method 'statvfs' >Thread-6940::DEBUG::2014-07-08 16:46:49,472::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:46:49,474::__init__::225::IOProcess::(_processLogs) (273522) Building response >Thread-6940::DEBUG::2014-07-08 16:46:49,476::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8ab0df45-53dd-4252-a0c7-fdfcb37a422c`::Granted request >Thread-18::DEBUG::2014-07-08 16:46:49,478::__init__::225::IOProcess::(_processLogs) (273522) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:49,483::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:49,487::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-6940::DEBUG::2014-07-08 16:46:49,487::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c227dd4-43ed-4638-b607-799a1592e41c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-6940::DEBUG::2014-07-08 16:46:49,492::task::993::Storage.TaskManager.Task::(_decref) Task=`6c227dd4-43ed-4638-b607-799a1592e41c`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:46:49,515::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:46:49,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:49,524::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:49,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:49,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:49,541::__init__::225::IOProcess::(_processLogs) (273523) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:49,545::__init__::225::IOProcess::(_processLogs) (273523) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:49,549::__init__::225::IOProcess::(_processLogs) (273523) Building response >Thread-18::DEBUG::2014-07-08 16:46:49,553::__init__::225::IOProcess::(_processLogs) (273523) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:49,556::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:49,558::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:49,564::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:46:49,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:49,569::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-6940::INFO::2014-07-08 16:46:49,570::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:46:49,574::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-6940::DEBUG::2014-07-08 16:46:49,576::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c227dd4-43ed-4638-b607-799a1592e41c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:46:49,579::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-6940::DEBUG::2014-07-08 16:46:49,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c227dd4-43ed-4638-b607-799a1592e41c`::moving from state preparing -> state finished >Thread-6940::DEBUG::2014-07-08 16:46:49,584::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:46:49,585::__init__::225::IOProcess::(_processLogs) (273524) Finding callback 'access'... >Thread-6940::DEBUG::2014-07-08 16:46:49,588::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:46:49,590::__init__::225::IOProcess::(_processLogs) (273524) Got request for method 'access' >Thread-6940::DEBUG::2014-07-08 16:46:49,594::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:46:49,595::__init__::225::IOProcess::(_processLogs) (273524) Building response >Thread-6940::DEBUG::2014-07-08 16:46:49,600::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:46:49,601::__init__::225::IOProcess::(_processLogs) (273524) Queuing response >Thread-6940::DEBUG::2014-07-08 16:46:49,603::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-6940::DEBUG::2014-07-08 16:46:49,606::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:46:49,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:49,615::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-6940::DEBUG::2014-07-08 16:46:49,617::task::993::Storage.TaskManager.Task::(_decref) Task=`6c227dd4-43ed-4638-b607-799a1592e41c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:46:49,630::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:46:49,634::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:49,638::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:49,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:49,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:49,647::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:49,649::__init__::225::IOProcess::(_processLogs) (273525) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:49,652::__init__::225::IOProcess::(_processLogs) (273525) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:49,655::__init__::225::IOProcess::(_processLogs) (273525) Building response >Thread-18::DEBUG::2014-07-08 16:46:49,658::__init__::225::IOProcess::(_processLogs) (273525) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:49,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:49,663::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:46:51,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:52,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171992 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:54,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:54,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174241 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:56,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:56,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172082 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:46:58,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:46:58,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172249 s, 59.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:59,673::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:59,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:59,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:59,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:59,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:59,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:59,675::__init__::225::IOProcess::(_processLogs) (273526) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:59,675::__init__::225::IOProcess::(_processLogs) (273526) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:59,675::__init__::225::IOProcess::(_processLogs) DEBUG|(273526) Building response >Thread-18::DEBUG::2014-07-08 16:46:59,675::__init__::225::IOProcess::(_processLogs) (273526) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:59,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:59,676::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:46:59,678::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:46:59,833::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000480216 s, 962 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:46:59,839::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:59,842::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:46:59,844::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:59,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:59,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:59,850::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:59,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:59,853::__init__::225::IOProcess::(_processLogs) (273527) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:46:59,855::__init__::225::IOProcess::(_processLogs) (273527) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:46:59,857::__init__::225::IOProcess::(_processLogs) (273527) Building response >Thread-18::DEBUG::2014-07-08 16:46:59,859::__init__::225::IOProcess::(_processLogs) (273527) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:59,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:59,862::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:46:59,871::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:59,873::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:46:59,874::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:59,875::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:59,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:59,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:59,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:59,881::__init__::225::IOProcess::(_processLogs) (273528) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:59,883::__init__::225::IOProcess::(_processLogs) (273528) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:59,884::__init__::225::IOProcess::(_processLogs) (273528) Building response >Thread-18::DEBUG::2014-07-08 16:46:59,886::__init__::225::IOProcess::(_processLogs) (273528) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:59,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:59,889::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:59,894::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:59,896::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:46:59,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:59,900::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:59,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:59,903::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:59,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:59,906::__init__::225::IOProcess::(_processLogs) (273529) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:59,907::__init__::225::IOProcess::(_processLogs) (273529) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:59,909::__init__::225::IOProcess::(_processLogs) (273529) Building response >Thread-18::DEBUG::2014-07-08 16:46:59,911::__init__::225::IOProcess::(_processLogs) (273529) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:59,912::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:59,914::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:46:59,919::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:46:59,920::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:46:59,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:46:59,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:46:59,925::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:46:59,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:46:59,932::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:46:59,933::__init__::225::IOProcess::(_processLogs) (273530) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:46:59,935::__init__::225::IOProcess::(_processLogs) (273530) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:46:59,936::__init__::225::IOProcess::(_processLogs) (273530) Building response >Thread-18::DEBUG::2014-07-08 16:46:59,938::__init__::225::IOProcess::(_processLogs) (273530) Queuing response >Thread-18::DEBUG::2014-07-08 16:46:59,939::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:46:59,941::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:47:00,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:01,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0906469 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:03,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:03,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173328 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:05,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:05,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403686 s, 25.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:07,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:08,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171671 s, 59.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:47:09,946::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:47:09,953::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:09,957::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:47:09,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:09,959::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:09,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:09,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:09,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:09,960::__init__::225::IOProcess::(_processLogs) (273531) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:47:09,961::__init__::225::IOProcess::(_processLogs) (273531) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:47:09,961::__init__::225::IOProcess::(_processLogs) (273531) Building response >Thread-18::DEBUG::2014-07-08 16:47:09,961::__init__::225::IOProcess::(_processLogs) (273531) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:09,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:09,962::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:47:09,964::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:09,965::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:47:09,965::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:09,966::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:09,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:09,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:09,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:09,967::__init__::225::IOProcess::(_processLogs) DEBUG|(273532) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:47:09,967::__init__::225::IOProcess::(_processLogs) (273532) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:47:09,967::__init__::225::IOProcess::(_processLogs) (273532) Building response >Thread-18::DEBUG::2014-07-08 16:47:09,967::__init__::225::IOProcess::(_processLogs) (273532) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:09,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:09,968::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:47:09,969::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:09,970::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:47:09,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:09,970::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:09,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:09,971::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:09,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:09,971::__init__::225::IOProcess::(_processLogs) (273533) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:47:09,971::__init__::225::IOProcess::(_processLogs) (273533) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:47:09,972::__init__::225::IOProcess::(_processLogs) (273533) Building response >Thread-18::DEBUG::2014-07-08 16:47:09,972::__init__::225::IOProcess::(_processLogs) (273533) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:09,972::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:09,972::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:47:09,974::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:09,976::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:47:09,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:09,980::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:09,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:09,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:09,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-37::DEBUG::2014-07-08 16:47:09,987::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:47:09,988::__init__::225::IOProcess::(_processLogs) (273534) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:47:09,988::__init__::225::IOProcess::(_processLogs) (273534) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:47:09,989::__init__::225::IOProcess::(_processLogs) (273534) Building response >Thread-18::DEBUG::2014-07-08 16:47:09,989::__init__::225::IOProcess::(_processLogs) (273534) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:09,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:09,989::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:47:09,991::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:09,991::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:47:09,992::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:09,994::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:09,996::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:09,998::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:10,000::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:10,001::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:47:10,004::__init__::225::IOProcess::(_processLogs) (273535) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:47:10,005::__init__::225::IOProcess::(_processLogs) (273535) Building response >Thread-18::DEBUG::2014-07-08 16:47:10,006::__init__::225::IOProcess::(_processLogs) (273535) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:10,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:10,009::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:47:10,013::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:47:10,016::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:10,018::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:47:10,020::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:10,022::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:10,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:10,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:10,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:10,028::__init__::225::IOProcess::(_processLogs) (273536) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:47:10,029::__init__::225::IOProcess::(_processLogs) (273536) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:47:10,031::__init__::225::IOProcess::(_processLogs) (273536) Building response >Thread-18::DEBUG::2014-07-08 16:47:10,032::__init__::225::IOProcess::(_processLogs) (273536) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:10,034::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:10,036::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:47:10,039::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:47:10,042::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:10,043::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:47:10,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:10,046::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:10,047::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:10,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:10,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:10,052::__init__::225::IOProcess::(_processLogs) (273537) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:10,053::__init__::225::IOProcess::(_processLogs) (273537) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:10,054::__init__::225::IOProcess::(_processLogs) (273537) Building response >Thread-18::DEBUG::2014-07-08 16:47:10,056::__init__::225::IOProcess::(_processLogs) (273537) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:10,058::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:10,059::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:10,064::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:10,066::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:47:10,068::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:10,070::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:10,071::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:10,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:10,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:10,075::__init__::225::IOProcess::(_processLogs) (273538) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:47:10,076::__init__::225::IOProcess::(_processLogs) (273538) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:47:10,078::__init__::225::IOProcess::(_processLogs) (273538) Building response >Thread-18::DEBUG::2014-07-08 16:47:10,079::__init__::225::IOProcess::(_processLogs) (273538) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:10,080::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:10,081::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:47:10,084::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:47:10,086::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:47:10,087::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:47:10,089::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:10,091::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:10,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:10,094::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:10,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:10,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:10,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:10,099::__init__::225::IOProcess::(_processLogs) (273539) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:10,100::__init__::225::IOProcess::(_processLogs) (273539) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:10,102::__init__::225::IOProcess::(_processLogs) (273539) Building response >Dummy-6860::DEBUG::2014-07-08 16:47:10,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:47:10,255::__init__::225::IOProcess::(_processLogs) (273539) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:10,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:10,259::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:47:10,271::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:47:10,426::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000592519 s, 780 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:10,436::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:10,439::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:10,441::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:10,443::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:10,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:10,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:10,450::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:10,453::__init__::225::IOProcess::(_processLogs) (273540) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:10,456::__init__::225::IOProcess::(_processLogs) (273540) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:10,460::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|(273540) Building response >Thread-18::DEBUG::2014-07-08 16:47:10,462::__init__::225::IOProcess::(_processLogs) (273540) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:10,465::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:10,468::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:47:10,484::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:10,487::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:47:10,489::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:10,494::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:10,574::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 16:47:10,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.231036 s, 4.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:10,577::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:10,580::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:10,583::__init__::225::IOProcess::(_processLogs) (273541) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:10,586::__init__::225::IOProcess::(_processLogs) (273541) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:10,593::__init__::225::IOProcess::(_processLogs) (273541) Building response >Thread-18::DEBUG::2014-07-08 16:47:10,597::__init__::225::IOProcess::(_processLogs) (273541) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:10,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:10,603::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:10,615::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:10,618::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:47:10,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:10,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:10,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:10,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:10,634::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:10,637::__init__::225::IOProcess::(_processLogs) (273542) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:10,640::__init__::225::IOProcess::(_processLogs) (273542) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:10,643::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|(273542) Building response >Thread-18::DEBUG::2014-07-08 16:47:10,646::__init__::225::IOProcess::(_processLogs) (273542) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:10,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:10,653::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:10,664::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:10,668::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:47:10,672::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:10,675::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:10,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:10,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:10,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:10,686::__init__::225::IOProcess::(_processLogs) (273543) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:10,689::__init__::225::IOProcess::(_processLogs) (273543) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:10,693::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|(273543) Building response >Thread-18::DEBUG::2014-07-08 16:47:10,697::__init__::225::IOProcess::(_processLogs) (273543) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:10,700::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:10,703::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:47:12,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:13,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017259 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:15,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:15,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174752 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:17,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:17,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017285 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:19,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:19,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173392 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:20,713::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:20,713::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:20,714::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:20,714::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:20,714::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:20,714::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:20,715::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:20,715::__init__::225::IOProcess::(_processLogs) (273544) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:20,715::__init__::225::IOProcess::(_processLogs) (273544) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:20,715::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|(273544) Building response >Thread-18::DEBUG::2014-07-08 16:47:20,716::__init__::225::IOProcess::(_processLogs) (273544) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:20,716::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:20,716::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:47:20,718::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:47:20,871::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000513181 s, 900 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:20,880::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:20,881::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:20,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:20,882::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:20,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:20,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:20,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:20,883::__init__::225::IOProcess::(_processLogs) (273545) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:20,884::__init__::225::IOProcess::(_processLogs) (273545) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:20,884::__init__::225::IOProcess::(_processLogs) (273545) Building response >Thread-18::DEBUG::2014-07-08 16:47:20,884::__init__::225::IOProcess::(_processLogs) (273545) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:20,885::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:20,885::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:47:20,891::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:20,893::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:47:20,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:20,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:20,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:20,901::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:20,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:20,903::__init__::225::IOProcess::(_processLogs) (273546) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:20,905::__init__::225::IOProcess::(_processLogs) (273546) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:20,906::__init__::225::IOProcess::(_processLogs) (273546) Building response >Thread-18::DEBUG::2014-07-08 16:47:20,908::__init__::225::IOProcess::(_processLogs) (273546) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:20,909::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:20,910::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:20,916::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:20,917::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:47:20,918::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:20,919::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:20,921::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:20,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:20,924::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:20,925::__init__::225::IOProcess::(_processLogs) (273547) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:20,926::__init__::225::IOProcess::(_processLogs) (273547) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:20,928::__init__::225::IOProcess::(_processLogs) (273547) Building response >Thread-18::DEBUG::2014-07-08 16:47:20,929::__init__::225::IOProcess::(_processLogs) (273547) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:20,931::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:20,932::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:20,937::__init__::225::IOProcess::(_processLogs) (273535) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:20,939::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:47:20,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:20,941::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:20,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:20,944::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:20,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:20,947::__init__::225::IOProcess::(_processLogs) (273548) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:20,948::__init__::225::IOProcess::(_processLogs) (273548) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:20,949::__init__::225::IOProcess::(_processLogs) (273548) Building response >Thread-18::DEBUG::2014-07-08 16:47:20,951::__init__::225::IOProcess::(_processLogs) (273548) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:20,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:20,954::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:47:21,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:22,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382824 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:24,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:24,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174375 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:26,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:26,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172333 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:28,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:28,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173297 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:30,959::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:30,960::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:30,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:30,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:30,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:30,961::__init__::225::IOProcess::(_processLogs) (273549) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:30,961::__init__::225::IOProcess::(_processLogs) (273549) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:30,961::__init__::225::IOProcess::(_processLogs) (273549) Building response >Thread-18::DEBUG::2014-07-08 16:47:30,961::__init__::225::IOProcess::(_processLogs) (273549) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:30,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:30,962::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:47:30,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:47:31,113::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00049586 s, 932 kB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:31,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:47:31,276::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:31,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:31,282::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:31,284::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:31,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:31,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:31,289::__init__::225::IOProcess::(_processLogs) (273550) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:31,290::__init__::225::IOProcess::(_processLogs) (273550) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:31,292::__init__::225::IOProcess::(_processLogs) (273550) Building response >Thread-18::DEBUG::2014-07-08 16:47:31,294::__init__::225::IOProcess::(_processLogs) (273550) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:31,297::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:47:31,316::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:47:31,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:31,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:31,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:31,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:31,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:31,336::__init__::225::IOProcess::(_processLogs) (273551) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:31,339::__init__::225::IOProcess::(_processLogs) (273551) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:31,341::__init__::225::IOProcess::(_processLogs) (273551) Building response >Thread-18::DEBUG::2014-07-08 16:47:31,344::__init__::225::IOProcess::(_processLogs) (273551) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:31,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:31,351::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:47:31,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0725054 s, 14.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:31,440::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:47:31,444::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:31,447::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:31,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:31,452::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:31,454::__init__::225::IOProcess::(_processLogs) (273552) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:31,457::__init__::225::IOProcess::(_processLogs) (273552) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:31,459::__init__::225::IOProcess::(_processLogs) (273552) Building response >Thread-18::DEBUG::2014-07-08 16:47:31,462::__init__::225::IOProcess::(_processLogs) (273552) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:31,464::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:31,466::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:31,475::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:47:31,478::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:31,480::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:31,481::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:31,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:31,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:31,492::__init__::225::IOProcess::(_processLogs) (273553) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:31,494::__init__::225::IOProcess::(_processLogs) (273553) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:31,496::__init__::225::IOProcess::(_processLogs) (273553) Building response >Thread-18::DEBUG::2014-07-08 16:47:31,499::__init__::225::IOProcess::(_processLogs) (273553) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:31,502::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:47:33,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:33,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174437 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:35,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:36,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171288 s, 59.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:38,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:38,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235412 s, 43.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:40,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:40,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171302 s, 59.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:41,511::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:41,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:41,511::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:41,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:41,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:41,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:41,512::__init__::225::IOProcess::(_processLogs) (273554) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:41,513::__init__::225::IOProcess::(_processLogs) (273554) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:41,513::__init__::225::IOProcess::(_processLogs) (273554) Building response >Thread-18::DEBUG::2014-07-08 16:47:41,513::__init__::225::IOProcess::(_processLogs) (273554) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:41,513::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:41,514::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:47:41,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:47:41,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000458148 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:41,663::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:41,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:41,664::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:41,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:41,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:41,665::__init__::225::IOProcess::(_processLogs) (273555) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:41,665::__init__::225::IOProcess::(_processLogs) (273555) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:41,665::__init__::225::IOProcess::(_processLogs) (273555) Building response >Thread-18::DEBUG::2014-07-08 16:47:41,666::__init__::225::IOProcess::(_processLogs) (273555) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:41,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:41,666::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:47:41,668::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:47:41,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:41,669::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:41,669::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:41,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:41,670::__init__::225::IOProcess::(_processLogs) (273556) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:41,670::__init__::225::IOProcess::(_processLogs) (273556) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:41,670::__init__::225::IOProcess::(_processLogs) (273556) Building response >Thread-18::DEBUG::2014-07-08 16:47:41,670::__init__::225::IOProcess::(_processLogs) (273556) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:41,670::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:41,671::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:41,672::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:47:41,672::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:41,672::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:41,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:41,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:41,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:41,673::__init__::225::IOProcess::(_processLogs) (273557) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:41,674::__init__::225::IOProcess::(_processLogs) (273557) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:41,674::__init__::225::IOProcess::(_processLogs) (273557) Building response >Thread-18::DEBUG::2014-07-08 16:47:41,674::__init__::225::IOProcess::(_processLogs) (273557) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:41,674::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:41,675::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:41,676::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:41,676::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:47:41,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:41,676::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:41,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:41,677::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:41,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:41,677::__init__::225::IOProcess::(_processLogs) (273558) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:41,678::__init__::225::IOProcess::(_processLogs) (273558) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:41,678::__init__::225::IOProcess::(_processLogs) (273558) Building response >Thread-18::DEBUG::2014-07-08 16:47:41,678::__init__::225::IOProcess::(_processLogs) (273558) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:41,678::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:41,679::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:47:42,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:43,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170017 s, 60.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:45,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:45,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017195 s, 59.6 MB/s\n'; <rc> = 0 >Detector thread::DEBUG::2014-07-08 16:47:45,546::protocoldetector::159::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.162.23:42132 >Detector thread::DEBUG::2014-07-08 16:47:45,556::protocoldetector::170::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.162.23:42132 >Detector thread::DEBUG::2014-07-08 16:47:45,557::protocoldetector::196::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.162.23:42132 >Detector thread::DEBUG::2014-07-08 16:47:45,559::BindingXMLRPC::1147::XmlDetector::(handleSocket) xml over http detected from ('10.35.162.23', 42132) >Thread-7082::DEBUG::2014-07-08 16:47:45,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd485bfc-e652-4e68-a26e-6c485f3017d3`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:47:45,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:47:45,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458148', 'lastCheck': '3.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:47:45,566::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd485bfc-e652-4e68-a26e-6c485f3017d3`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458148', 'lastCheck': '3.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:47:45,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd485bfc-e652-4e68-a26e-6c485f3017d3`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:47:45,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:47:45,567::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:47:45,567::task::993::Storage.TaskManager.Task::(_decref) Task=`fd485bfc-e652-4e68-a26e-6c485f3017d3`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:47:46,828::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call getCapabilities with () {} >Thread-7082::DEBUG::2014-07-08 16:47:46,831::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-7082::DEBUG::2014-07-08 16:47:46,993::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:47:47,099::BindingXMLRPC::1114::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:orange-vdsc'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.17.1.el6.x86_64', 'buildtime': 1397226420.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '3.git601f786.el6', 'buildtime': 1404118673L, 'version': '4.16.0'}, 'qemu-kvm': {'release': '2.415.el6_5.11', 'buildtime': 1403019242L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.11', 'buildtime': 1403019242L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Dual-Core AMD Opteron(tm) Processor 2210', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}, '10_faqemu': {'md5': 'e3cb338be6b9075a04bed0e7400ab7e2'}, '50_nestedvt': {'md5': '1eb86fc52cea5ee7812978176ce2d545'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 1, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.128.17', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745e/64'], 'gateway': '10.35.128.254', 'bootproto4': 'none', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.128.17/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}, 'net5': {'iface': 'net5', 'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net5', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'gateway': '', 'bootproto4': 'none', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth3.5']}, 'net3': {'iface': 'net3', 'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net3', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'gateway': '', 'bootproto4': 'none', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth3.4093']}, 'net1': {'iface': 'net1', 'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net1', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745f/64'], 'gateway': '', 'bootproto4': 'none', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['bond0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.128.17', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745e/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.128.17/24'], 'ipv6gateway': '::', 'gateway': '10.35.128.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '18', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745e', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745e', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '18', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}, 'net5': {'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net5', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': '', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '118', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745d', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745d', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '18', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth3.5']}, 'net3': {'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net3', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': '', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '17', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745d', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745d', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '17', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth3.4093']}, 'net1': {'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net1', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745f/64'], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': '', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '117', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745f', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745f', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '17', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['bond0']}}, 'uuid': '007EF314-A079-0010-A38A-0016367B3DFE', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth3': {'addr': '', 'cfg': {'DEVICE': 'eth3', 'HWADDR': '00:16:36:84:74:5d', 'ONBOOT': 'no', 'NM_CONTROLLED': 'no', 'MTU': '1500'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5d', 'speed': 1000}, 'eth2': {'permhwaddr': '00:16:36:84:74:5C', 'addr': '', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '5000', 'HWADDR': '00:16:36:84:74:5c', 'MASTER': 'bond0', 'DEVICE': 'eth2', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5f', 'speed': 1000}, 'eth1': {'permhwaddr': '00:16:36:84:74:5F', 'addr': '', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '5000', 'HWADDR': '00:16:36:84:74:5f', 'MASTER': 'bond0', 'DEVICE': 'eth1', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '5000', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5f', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:16:36:84:74:5e', 'DEVICE': 'eth0', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5e', 'speed': 0}}, 'software_revision': '3', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ht,syscall,nx,mmxext,fxsr_opt,rdtscp,lm,3dnowext,3dnow,rep_good,extd_apicid,pni,cx16,lahf_lm,cmp_legacy,svm,extapic,cr8_legacy,model_athlon,model_Opteron_G1,model_Opteron_G2', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:orange-vdsc', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond0': {'addr': '', 'cfg': {'BRIDGE': 'net1', 'HOTPLUG': 'no', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BONDING_OPTS': 'mode=1 miimon=100', 'DEVICE': 'bond0', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745f/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5f', 'slaves': ['eth1', 'eth2'], 'opts': {'miimon': '100', 'mode': '1'}}, 'bond1': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond2': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond3': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}}, 'software_version': '4.16', 'memSize': '3830', 'cpuSpeed': '1809.257', 'numaNodes': {u'0': {'totalMemory': '3830', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {'eth3.5': {'iface': 'eth3', 'addr': '', 'cfg': {'BRIDGE': 'net5', 'VLAN': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'DEVICE': 'eth3.5', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'vlanid': 5, 'mtu': '1500', 'netmask': '', 'ipv4addrs': []}, 'eth3.4093': {'iface': 'eth3', 'addr': '', 'cfg': {'BRIDGE': 'net3', 'VLAN': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'DEVICE': 'eth3.4093', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'vlanid': 4093, 'mtu': '1500', 'netmask': '', 'ipv4addrs': []}}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.162.23'}} >Thread-7082::DEBUG::2014-07-08 16:47:47,364::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call getHardwareInfo with () {} >Thread-7082::DEBUG::2014-07-08 16:47:47,368::BindingXMLRPC::1114::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Sun Fire X2200 M2', 'systemSerialNumber': '0643QBT010', 'systemFamily': 'To Be Filled By O.E.M.', 'systemVersion': 'Rev 50', 'systemUUID': '007ef314-a079-0010-a38a-0016367b3dfe', 'systemManufacturer': 'Sun Microsystems'}} >Dummy-6860::DEBUG::2014-07-08 16:47:47,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:47,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172618 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:49,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:49,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171761 s, 59.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:51,681::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:51,682::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:51,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:51,682::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:51,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:51,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:51,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:51,683::__init__::225::IOProcess::(_processLogs) (273559) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:51,684::__init__::225::IOProcess::(_processLogs) (273559) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:51,684::__init__::225::IOProcess::(_processLogs) (273559) Building response >Thread-18::DEBUG::2014-07-08 16:47:51,684::__init__::225::IOProcess::(_processLogs) (273559) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:51,684::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:51,685::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:47:51,686::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:47:51,835::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000599782 s, 770 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:47:51,841::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:51,843::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:47:51,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:51,846::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:51,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:51,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:51,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:51,852::__init__::225::IOProcess::(_processLogs) (273560) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:47:51,853::__init__::225::IOProcess::(_processLogs) (273560) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:47:51,855::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273560) Building response >Thread-18::DEBUG::2014-07-08 16:47:51,856::__init__::225::IOProcess::(_processLogs) (273560) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:51,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:51,859::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:47:51,869::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:51,871::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:47:51,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:51,874::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:51,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:51,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:51,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:51,880::__init__::225::IOProcess::(_processLogs) (273561) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:51,882::__init__::225::IOProcess::(_processLogs) (273561) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:51,884::__init__::225::IOProcess::(_processLogs) (273561) Building response >Thread-18::DEBUG::2014-07-08 16:47:51,885::__init__::225::IOProcess::(_processLogs) (273561) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:51,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:51,889::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:51,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:51,896::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:47:51,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:51,899::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:51,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:47:51,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:51,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:51,906::__init__::225::IOProcess::(_processLogs) (273562) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:51,907::__init__::225::IOProcess::(_processLogs) (273562) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:51,908::__init__::225::IOProcess::(_processLogs) (273562) Building response >Thread-18::DEBUG::2014-07-08 16:47:51,910::__init__::225::IOProcess::(_processLogs) (273562) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:51,911::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:51,913::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:47:51,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:47:51,920::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:47:51,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:47:51,923::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:47:51,926::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 16:47:51,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:47:51,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:47:52,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:47:52,088::__init__::225::IOProcess::(_processLogs) (273563) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:47:52,090::__init__::225::IOProcess::(_processLogs) (273563) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:47:52,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(273563) Building response >Thread-18::DEBUG::2014-07-08 16:47:52,093::__init__::225::IOProcess::(_processLogs) (273563) Queuing response >Thread-18::DEBUG::2014-07-08 16:47:52,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:47:52,099::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:47:52,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502445 s, 20.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:47:53,429::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6b1df169] >Thread-7082::DEBUG::2014-07-08 16:47:53,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`acadc72a-0fd7-4355-a48d-77cb54f06a82`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:47:53,431::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:47:53,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:47:53,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`acadc72a-0fd7-4355-a48d-77cb54f06a82`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:47:53,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`acadc72a-0fd7-4355-a48d-77cb54f06a82`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:47:53,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:47:53,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:47:53,448::task::993::Storage.TaskManager.Task::(_decref) Task=`acadc72a-0fd7-4355-a48d-77cb54f06a82`::ref 0 aborting False >Detector thread::DEBUG::2014-07-08 16:47:53,763::protocoldetector::159::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.162.23:54037 >Detector thread::DEBUG::2014-07-08 16:47:53,764::protocoldetector::170::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.162.23:54037 >Detector thread::DEBUG::2014-07-08 16:47:53,764::protocoldetector::196::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.162.23:54037 >Detector thread::DEBUG::2014-07-08 16:47:53,765::BindingXMLRPC::1147::XmlDetector::(handleSocket) xml over http detected from ('10.35.162.23', 54037) >Thread-7083::DEBUG::2014-07-08 16:47:53,768::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6b1df169] >Thread-7083::DEBUG::2014-07-08 16:47:53,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`44b36ac8-8e7d-4364-8d44-06ab6748ae1d`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:47:53,769::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:47:53,770::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f867514c-7d05-446a-aad7-e166f954f44d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:47:53,770::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:47:53,771::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:47:53,771::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f867514c-7d05-446a-aad7-e166f954f44d`::Granted request >Thread-7083::DEBUG::2014-07-08 16:47:53,772::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`44b36ac8-8e7d-4364-8d44-06ab6748ae1d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:47:53,772::task::993::Storage.TaskManager.Task::(_decref) Task=`44b36ac8-8e7d-4364-8d44-06ab6748ae1d`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:47:53,794::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:47:53,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`44b36ac8-8e7d-4364-8d44-06ab6748ae1d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:47:53,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`44b36ac8-8e7d-4364-8d44-06ab6748ae1d`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:47:53,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:47:53,795::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:47:53,795::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:47:53,796::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:47:53,796::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:47:53,796::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:47:53,796::task::993::Storage.TaskManager.Task::(_decref) Task=`44b36ac8-8e7d-4364-8d44-06ab6748ae1d`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:47:53,970::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6b1df169] >Thread-7082::DEBUG::2014-07-08 16:47:53,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`f601a691-8d75-4747-8156-583d6e1ffa3d`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:47:53,971::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksInfo(spUUID=None, options=None) >Thread-7082::DEBUG::2014-07-08 16:47:53,971::taskManager::191::Storage.TaskManager::(getAllTasksInfo) Entry. >Thread-7082::DEBUG::2014-07-08 16:47:53,972::taskManager::202::Storage.TaskManager::(getAllTasksInfo) Return. Response: {} >Thread-7082::INFO::2014-07-08 16:47:53,972::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksInfo, Return response: {'allTasksInfo': {}} >Thread-7082::DEBUG::2014-07-08 16:47:53,972::task::1191::Storage.TaskManager.Task::(prepare) Task=`f601a691-8d75-4747-8156-583d6e1ffa3d`::finished: {'allTasksInfo': {}} >Thread-7082::DEBUG::2014-07-08 16:47:53,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`f601a691-8d75-4747-8156-583d6e1ffa3d`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:47:53,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:47:53,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:47:53,973::task::993::Storage.TaskManager.Task::(_decref) Task=`f601a691-8d75-4747-8156-583d6e1ffa3d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:47:54,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:54,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170626 s, 60.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:56,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:56,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0258976 s, 39.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:47:58,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:47:59,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173783 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:48:01,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:01,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017178 s, 59.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:02,111::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:02,111::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:02,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:02,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:02,113::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:02,113::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:02,113::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:02,113::__init__::225::IOProcess::(_processLogs) (273564) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:02,114::__init__::225::IOProcess::(_processLogs) (273564) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:02,114::__init__::225::IOProcess::(_processLogs) (273564) Building response >Thread-18::DEBUG::2014-07-08 16:48:02,114::__init__::225::IOProcess::(_processLogs) (273564) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:02,114::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:02,115::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:48:02,116::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:48:02,268::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000505918 s, 913 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:02,270::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:02,271::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:02,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:02,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:02,271::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:02,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:02,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:02,272::__init__::225::IOProcess::(_processLogs) (273565) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:02,272::__init__::225::IOProcess::(_processLogs) (273565) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:02,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(273565) Building response >Thread-18::DEBUG::2014-07-08 16:48:02,273::__init__::225::IOProcess::(_processLogs) (273565) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:02,273::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:02,273::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:48:02,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:02,276::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:48:02,276::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:02,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:02,277::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:02,277::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:02,278::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:02,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(273566) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:02,278::__init__::225::IOProcess::(_processLogs) (273566) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:02,278::__init__::225::IOProcess::(_processLogs) (273566) Building response >Thread-18::DEBUG::2014-07-08 16:48:02,279::__init__::225::IOProcess::(_processLogs) (273566) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:02,279::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:02,279::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:02,280::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:02,281::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:48:02,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:02,281::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:02,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:02,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:02,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:02,282::__init__::225::IOProcess::(_processLogs) (273567) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:02,282::__init__::225::IOProcess::(_processLogs) (273567) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:02,283::__init__::225::IOProcess::(_processLogs) (273567) Building response >Thread-18::DEBUG::2014-07-08 16:48:02,283::__init__::225::IOProcess::(_processLogs) (273567) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:02,283::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:02,283::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:02,285::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:48:02,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:02,285::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:02,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:02,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:02,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:02,286::__init__::225::IOProcess::(_processLogs) (273568) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:02,286::__init__::225::IOProcess::(_processLogs) (273568) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:02,287::__init__::225::IOProcess::(_processLogs) (273568) Building response >Thread-18::DEBUG::2014-07-08 16:48:02,287::__init__::225::IOProcess::(_processLogs) (273568) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:02,287::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:02,287::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:48:03,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:03,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175744 s, 58.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:03,910::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:48:03,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ebe6c6a-138a-4594-aa62-90fdd95d4848`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:03,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:48:03,932::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:03,933::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ebe6c6a-138a-4594-aa62-90fdd95d4848`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:03,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ebe6c6a-138a-4594-aa62-90fdd95d4848`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:03,934::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:03,934::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:03,934::task::993::Storage.TaskManager.Task::(_decref) Task=`8ebe6c6a-138a-4594-aa62-90fdd95d4848`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:48:04,080::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:48:04,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`91ac38d9-f79e-48df-86f2-68d86f3dfd36`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:48:04,081::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:48:04,083::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24ef0eb5-38eb-4c09-9eae-3c854e66d8a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:48:04,083::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:48:04,087::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:48:04,088::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`24ef0eb5-38eb-4c09-9eae-3c854e66d8a5`::Granted request >Thread-7083::DEBUG::2014-07-08 16:48:04,089::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`91ac38d9-f79e-48df-86f2-68d86f3dfd36`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:48:04,089::task::993::Storage.TaskManager.Task::(_decref) Task=`91ac38d9-f79e-48df-86f2-68d86f3dfd36`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:48:04,108::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:04,109::task::1191::Storage.TaskManager.Task::(prepare) Task=`91ac38d9-f79e-48df-86f2-68d86f3dfd36`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:04,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`91ac38d9-f79e-48df-86f2-68d86f3dfd36`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:48:04,109::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:48:04,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:48:04,110::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:48:04,110::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:48:04,111::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:48:04,111::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:48:04,111::task::993::Storage.TaskManager.Task::(_decref) Task=`91ac38d9-f79e-48df-86f2-68d86f3dfd36`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:48:05,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`b481f24e-7275-4c46-92a7-4102bedc0610`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:05,366::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:48:05,367::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505918', 'lastCheck': '3.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:48:05,367::task::1191::Storage.TaskManager.Task::(prepare) Task=`b481f24e-7275-4c46-92a7-4102bedc0610`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505918', 'lastCheck': '3.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:48:05,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`b481f24e-7275-4c46-92a7-4102bedc0610`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:05,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:05,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:05,368::task::993::Storage.TaskManager.Task::(_decref) Task=`b481f24e-7275-4c46-92a7-4102bedc0610`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:48:05,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:06,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173149 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:48:08,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:08,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171216 s, 59.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:48:10,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:10,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171316 s, 59.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:12,290::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:12,291::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:12,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:12,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:12,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:12,292::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:12,292::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:12,292::__init__::225::IOProcess::(_processLogs) (273569) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:12,292::__init__::225::IOProcess::(_processLogs) (273569) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:12,293::__init__::225::IOProcess::(_processLogs) (273569) Building response >Thread-18::DEBUG::2014-07-08 16:48:12,293::__init__::225::IOProcess::(_processLogs) (273569) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:12,293::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:12,293::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:48:12,301::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:48:12,460::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000519326 s, 890 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:12,465::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:12,468::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:12,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:12,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:12,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:12,474::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:12,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:12,476::__init__::225::IOProcess::(_processLogs) (273570) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:12,478::__init__::225::IOProcess::(_processLogs) (273570) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:12,479::__init__::225::IOProcess::(_processLogs) (273570) Building response >Thread-18::DEBUG::2014-07-08 16:48:12,480::__init__::225::IOProcess::(_processLogs) (273570) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:12,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:12,483::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:48:12,492::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:48:12,493::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:12,495::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:12,496::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:12,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:12,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:12,500::__init__::225::IOProcess::(_processLogs) (273571) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:12,501::__init__::225::IOProcess::(_processLogs) (273571) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:12,503::__init__::225::IOProcess::(_processLogs) (273571) Building response >Thread-18::DEBUG::2014-07-08 16:48:12,504::__init__::225::IOProcess::(_processLogs) (273571) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:12,506::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:12,511::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:48:12,513::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:12,514::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:12,516::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:12,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:12,519::__init__::225::IOProcess::(_processLogs) (273572) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:12,520::__init__::225::IOProcess::(_processLogs) (273572) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:12,521::__init__::225::IOProcess::(_processLogs) (273572) Building response >Thread-18::DEBUG::2014-07-08 16:48:12,523::__init__::225::IOProcess::(_processLogs) (273572) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:12,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:12,527::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:12,532::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:48:12,533::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:12,534::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:12,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:12,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:12,538::__init__::225::IOProcess::(_processLogs) (273573) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:12,540::__init__::225::IOProcess::(_processLogs) (273573) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:12,541::__init__::225::IOProcess::(_processLogs) (273573) Building response >Thread-18::DEBUG::2014-07-08 16:48:12,543::__init__::225::IOProcess::(_processLogs) (273573) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:12,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:12,545::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:48:12,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:12,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01733 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:14,180::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:48:14,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6d12378-d1a5-4660-b138-3e5bdc945c35`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:14,182::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:48:14,196::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:14,197::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6d12378-d1a5-4660-b138-3e5bdc945c35`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:14,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6d12378-d1a5-4660-b138-3e5bdc945c35`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:14,197::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:14,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:14,198::task::993::Storage.TaskManager.Task::(_decref) Task=`b6d12378-d1a5-4660-b138-3e5bdc945c35`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:48:14,218::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:48:14,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5d8c828-5df1-4fdb-ab30-0b48f3a4b2a0`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:48:14,219::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:48:14,220::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a7de7edf-812f-4434-b898-79e7d6176f96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:48:14,220::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:48:14,221::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:48:14,221::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a7de7edf-812f-4434-b898-79e7d6176f96`::Granted request >Thread-7083::DEBUG::2014-07-08 16:48:14,222::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b5d8c828-5df1-4fdb-ab30-0b48f3a4b2a0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:48:14,222::task::993::Storage.TaskManager.Task::(_decref) Task=`b5d8c828-5df1-4fdb-ab30-0b48f3a4b2a0`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:48:14,241::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:14,241::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5d8c828-5df1-4fdb-ab30-0b48f3a4b2a0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:14,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5d8c828-5df1-4fdb-ab30-0b48f3a4b2a0`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:48:14,242::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:48:14,242::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:48:14,243::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:48:14,243::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:48:14,243::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:48:14,243::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:48:14,244::task::993::Storage.TaskManager.Task::(_decref) Task=`b5d8c828-5df1-4fdb-ab30-0b48f3a4b2a0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:48:14,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:15,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343677 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:48:17,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:17,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172325 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:48:19,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:19,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188556 s, 54.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:21,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6104080-7567-492e-88fb-99a682d03363`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:21,465::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:48:21,466::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519326', 'lastCheck': '8.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:48:21,466::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6104080-7567-492e-88fb-99a682d03363`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519326', 'lastCheck': '8.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:48:21,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6104080-7567-492e-88fb-99a682d03363`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:21,466::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:21,466::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:21,467::task::993::Storage.TaskManager.Task::(_decref) Task=`e6104080-7567-492e-88fb-99a682d03363`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:48:21,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:21,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174096 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:22,551::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:22,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:22,552::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:22,553::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:22,553::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:22,553::__init__::225::IOProcess::(_processLogs) (273574) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:22,554::__init__::225::IOProcess::(_processLogs) (273574) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:22,554::__init__::225::IOProcess::(_processLogs) (273574) Building response >Thread-18::DEBUG::2014-07-08 16:48:22,554::__init__::225::IOProcess::(_processLogs) (273574) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:22,554::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:22,555::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:48:22,556::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:48:22,704::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00043496 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:22,710::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:22,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:22,713::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:22,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:22,715::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:22,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:22,718::__init__::225::IOProcess::(_processLogs) (273575) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:22,719::__init__::225::IOProcess::(_processLogs) (273575) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:22,721::__init__::225::IOProcess::(_processLogs) (273575) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:22,722::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:22,723::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:48:22,731::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:48:22,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:22,734::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:22,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:22,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:22,738::__init__::225::IOProcess::(_processLogs) (273576) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:22,740::__init__::225::IOProcess::(_processLogs) (273576) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:22,745::__init__::225::IOProcess::(_processLogs) (273576) Building response >Thread-18::DEBUG::2014-07-08 16:48:22,746::__init__::225::IOProcess::(_processLogs) (273576) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:22,748::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:22,749::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:22,753::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:48:22,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:22,756::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:22,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:22,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:22,760::__init__::225::IOProcess::(_processLogs) (273577) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:22,761::__init__::225::IOProcess::(_processLogs) (273577) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:22,763::__init__::225::IOProcess::(_processLogs) (273577) Building response >Thread-18::DEBUG::2014-07-08 16:48:22,764::__init__::225::IOProcess::(_processLogs) (273577) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:22,765::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:22,766::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:22,771::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:48:22,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:22,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:22,776::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:22,777::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:22,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:22,780::__init__::225::IOProcess::(_processLogs) (273578) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:22,782::__init__::225::IOProcess::(_processLogs) (273578) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:22,783::__init__::225::IOProcess::(_processLogs) (273578) Building response >Thread-18::DEBUG::2014-07-08 16:48:22,784::__init__::225::IOProcess::(_processLogs) (273578) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:22,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:22,787::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:48:23,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:24,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0885403 s, 11.6 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:24,321::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:48:24,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eb403a4-31b5-4755-80dc-b047adbe91e7`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:24,326::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:48:24,342::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:24,342::task::1191::Storage.TaskManager.Task::(prepare) Task=`1eb403a4-31b5-4755-80dc-b047adbe91e7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:24,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eb403a4-31b5-4755-80dc-b047adbe91e7`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:24,343::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:24,343::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:24,343::task::993::Storage.TaskManager.Task::(_decref) Task=`1eb403a4-31b5-4755-80dc-b047adbe91e7`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:48:24,365::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:48:24,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`acc2ccd4-5cbb-4277-9b3e-ab658063b1bb`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:48:24,367::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:48:24,368::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`67427a62-ae2c-4a51-82cb-a662e10f39d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:48:24,368::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:48:24,368::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:48:24,369::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`67427a62-ae2c-4a51-82cb-a662e10f39d0`::Granted request >Thread-7083::DEBUG::2014-07-08 16:48:24,369::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`acc2ccd4-5cbb-4277-9b3e-ab658063b1bb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:48:24,370::task::993::Storage.TaskManager.Task::(_decref) Task=`acc2ccd4-5cbb-4277-9b3e-ab658063b1bb`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:48:24,396::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:24,396::task::1191::Storage.TaskManager.Task::(prepare) Task=`acc2ccd4-5cbb-4277-9b3e-ab658063b1bb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:24,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`acc2ccd4-5cbb-4277-9b3e-ab658063b1bb`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:48:24,397::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:48:24,397::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:48:24,398::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:48:24,398::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:48:24,398::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:48:24,398::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:48:24,399::task::993::Storage.TaskManager.Task::(_decref) Task=`acc2ccd4-5cbb-4277-9b3e-ab658063b1bb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:48:26,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:26,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173146 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:48:28,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:28,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172615 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:48:30,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:31,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181504 s, 56.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:32,793::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:32,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:32,794::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:32,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:32,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:32,795::__init__::225::IOProcess::(_processLogs) (273579) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:32,795::__init__::225::IOProcess::(_processLogs) (273579) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:32,795::__init__::225::IOProcess::(_processLogs) (273579) Building response >Thread-18::DEBUG::2014-07-08 16:48:32,796::__init__::225::IOProcess::(_processLogs) (273579) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:32,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:32,796::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:48:32,798::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:48:32,946::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00157055 s, 294 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:32,950::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:32,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:32,950::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:32,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:32,953::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:32,954::__init__::225::IOProcess::(_processLogs) (273580) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:32,956::__init__::225::IOProcess::(_processLogs) (273580) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:32,958::__init__::225::IOProcess::(_processLogs) (273580) Building response >Thread-18::DEBUG::2014-07-08 16:48:32,959::__init__::225::IOProcess::(_processLogs) (273580) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:32,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:32,962::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:48:32,971::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:48:32,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:32,973::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:32,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:32,977::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:32,978::__init__::225::IOProcess::(_processLogs) (273581) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:32,980::__init__::225::IOProcess::(_processLogs) (273581) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:32,981::__init__::225::IOProcess::(_processLogs) (273581) Building response >Thread-18::DEBUG::2014-07-08 16:48:32,983::__init__::225::IOProcess::(_processLogs) (273581) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:32,984::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:32,986::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:32,990::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:48:32,991::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:32,991::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:32,992::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:32,992::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:32,992::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:32,992::__init__::225::IOProcess::(_processLogs) (273582) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:32,993::__init__::225::IOProcess::(_processLogs) (273582) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:32,993::__init__::225::IOProcess::(_processLogs) (273582) Building response >Thread-18::DEBUG::2014-07-08 16:48:32,993::__init__::225::IOProcess::(_processLogs) (273582) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:32,994::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:32,996::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:33,001::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:33,002::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:48:33,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:33,005::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:33,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:33,008::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:33,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:33,011::__init__::225::IOProcess::(_processLogs) (273583) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:33,013::__init__::225::IOProcess::(_processLogs) (273583) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:33,014::__init__::225::IOProcess::(_processLogs) (273583) Building response >Thread-18::DEBUG::2014-07-08 16:48:33,020::__init__::225::IOProcess::(_processLogs) (273583) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:33,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:33,023::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:48:33,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:33,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034425 s, 29.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:34,434::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:48:34,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`dcbf7593-5c2a-4f2b-8f46-569b31617cb5`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:34,439::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:48:34,455::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:34,456::task::1191::Storage.TaskManager.Task::(prepare) Task=`dcbf7593-5c2a-4f2b-8f46-569b31617cb5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:34,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`dcbf7593-5c2a-4f2b-8f46-569b31617cb5`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:34,458::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:34,459::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:34,460::task::993::Storage.TaskManager.Task::(_decref) Task=`dcbf7593-5c2a-4f2b-8f46-569b31617cb5`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:48:34,490::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:48:34,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`c74d832a-237b-4e18-ba59-e4c97be4b262`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:48:34,494::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:48:34,575::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a282ce30-d371-4145-bea5-515b31d02cde`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:48:34,584::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:48:34,587::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:48:34,588::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a282ce30-d371-4145-bea5-515b31d02cde`::Granted request >Thread-7083::DEBUG::2014-07-08 16:48:34,592::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c74d832a-237b-4e18-ba59-e4c97be4b262`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:48:34,597::task::993::Storage.TaskManager.Task::(_decref) Task=`c74d832a-237b-4e18-ba59-e4c97be4b262`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:48:34,655::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:34,657::task::1191::Storage.TaskManager.Task::(prepare) Task=`c74d832a-237b-4e18-ba59-e4c97be4b262`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:34,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`c74d832a-237b-4e18-ba59-e4c97be4b262`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:48:34,660::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:48:34,661::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:48:34,663::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:48:34,665::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:48:34,666::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:48:34,668::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:48:34,670::task::993::Storage.TaskManager.Task::(_decref) Task=`c74d832a-237b-4e18-ba59-e4c97be4b262`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:48:35,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:35,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170836 s, 59.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:36,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`488047aa-4f2a-41a2-a48c-6d926abad9f1`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:36,898::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:48:36,898::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157055', 'lastCheck': '3.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:48:36,898::task::1191::Storage.TaskManager.Task::(prepare) Task=`488047aa-4f2a-41a2-a48c-6d926abad9f1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157055', 'lastCheck': '3.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:48:36,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`488047aa-4f2a-41a2-a48c-6d926abad9f1`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:36,899::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:36,899::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:36,899::task::993::Storage.TaskManager.Task::(_decref) Task=`488047aa-4f2a-41a2-a48c-6d926abad9f1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:48:37,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:37,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170246 s, 60.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:39,184::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G1', 'smp': '1', 'numaTune': {'mode': 'preferred'}, 'custom': {'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=18a91000-ba5f-4ac4-86c7-b21f96fc1711, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=755ce754-7bee-49fb-b450-d0b85277bd79, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311e': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=3996d27c-c4e2-4a39-968c-616c4c77311e, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=ee937282-11ea-4d93-b4da-1019bcd29ad1, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79device_988e6a00-cb47-4d6d-b308-befb52ea3952': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=988e6a00-cb47-4d6d-b308-befb52ea3952, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'vm1', 'nice': '0', 'bootMenuEnable': 'false', 'copyPasteEnable': 'true', 'smartcardEnable': 'false', 'fileTransferEnable': 'true', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6f1e54a7-9e7b-4487-b04b-954315a168a4', 'address': {'slot': '0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '0ee274c9-1b7d-4857-8324-eccf458f33f2', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '36ffc40d-feca-42ea-a0ae-e40506318f67', 'volumeID': 'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'specParams': {}, 'readonly': 'false', 'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'deviceId': 'c1abf407-d743-43d7-85bb-157eec06157c', 'address': {'slot': '0x07', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5b', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '538e4604-ff2c-4884-869d-f245d2051300', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'index': '0', 'specParams': {}, 'deviceId': '55d5a62a-e1ba-4197-b991-34cb27d29412', 'address': {'slot': '0x05', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'timeOffset': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [37dc8896] >Thread-7082::INFO::2014-07-08 16:48:39,185::clientIF::393::vds::(createVm) vmContainerLock acquired by vm 9b0bd5aa-d706-426a-a077-62a64954b803 >Thread-7082::DEBUG::2014-07-08 16:48:39,203::clientIF::406::vds::(createVm) Total desktops after creation of 9b0bd5aa-d706-426a-a077-62a64954b803 is 1 >Thread-7084::DEBUG::2014-07-08 16:48:39,204::vm::2186::vm.Vm::(_startUnderlyingVm) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Start >Thread-7082::DEBUG::2014-07-08 16:48:39,205::BindingXMLRPC::1114::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'pid': '0', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G1', 'smp': '1', 'numaTune': {'mode': 'preferred'}, 'custom': {'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=18a91000-ba5f-4ac4-86c7-b21f96fc1711, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=755ce754-7bee-49fb-b450-d0b85277bd79, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311e': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=3996d27c-c4e2-4a39-968c-616c4c77311e, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=ee937282-11ea-4d93-b4da-1019bcd29ad1, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79device_988e6a00-cb47-4d6d-b308-befb52ea3952': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=988e6a00-cb47-4d6d-b308-befb52ea3952, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'vm1', 'nice': '0', 'status': 'WaitForLaunch', 'bootMenuEnable': 'false', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'copyPasteEnable': 'true', 'displayIp': '10.35.128.17', 'displayPort': '-1', 'smartcardEnable': 'false', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'fileTransferEnable': 'true', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6f1e54a7-9e7b-4487-b04b-954315a168a4', 'address': {'slot': '0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '0ee274c9-1b7d-4857-8324-eccf458f33f2', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '36ffc40d-feca-42ea-a0ae-e40506318f67', 'volumeID': 'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'specParams': {}, 'readonly': 'false', 'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'deviceId': 'c1abf407-d743-43d7-85bb-157eec06157c', 'address': {'slot': '0x07', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5b', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '538e4604-ff2c-4884-869d-f245d2051300', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'index': '0', 'specParams': {}, 'deviceId': '55d5a62a-e1ba-4197-b991-34cb27d29412', 'address': {'slot': '0x05', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'timeOffset': '0', 'maxVCpus': '160', 'clientIp': '', 'display': 'qxl'}} >Thread-7084::DEBUG::2014-07-08 16:48:39,207::vm::2190::vm.Vm::(_startUnderlyingVm) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::_ongoingCreations acquired >Thread-7084::INFO::2014-07-08 16:48:39,209::vm::3182::vm.Vm::(_run) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::VM wrapper has started >Thread-7084::DEBUG::2014-07-08 16:48:39,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1fb92b2-fdf4-4b63-8721-077ed1398386`::moving from state init -> state preparing >Thread-7084::INFO::2014-07-08 16:48:39,213::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:48:39,217::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:39,219::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:48:39,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:39,221::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:39,222::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:39,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:39,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:39,225::__init__::225::IOProcess::(_processLogs) (273584) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:39,227::__init__::225::IOProcess::(_processLogs) (273584) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:39,228::__init__::225::IOProcess::(_processLogs) (273584) Building response >Thread-18::DEBUG::2014-07-08 16:48:39,228::__init__::225::IOProcess::(_processLogs) (273584) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:39,229::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:39,229::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:48:39,231::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:39,231::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:48:39,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:39,232::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:39,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:39,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:39,233::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:39,233::__init__::225::IOProcess::(_processLogs) (273585) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:39,233::__init__::225::IOProcess::(_processLogs) (273585) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:39,233::__init__::225::IOProcess::(_processLogs) (273585) Building response >Thread-18::DEBUG::2014-07-08 16:48:39,234::__init__::225::IOProcess::(_processLogs) (273585) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:39,234::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:39,234::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7084::INFO::2014-07-08 16:48:39,235::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7084::DEBUG::2014-07-08 16:48:39,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1fb92b2-fdf4-4b63-8721-077ed1398386`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7084::DEBUG::2014-07-08 16:48:39,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1fb92b2-fdf4-4b63-8721-077ed1398386`::moving from state preparing -> state finished >Thread-7084::DEBUG::2014-07-08 16:48:39,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7084::DEBUG::2014-07-08 16:48:39,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7084::DEBUG::2014-07-08 16:48:39,237::task::993::Storage.TaskManager.Task::(_decref) Task=`a1fb92b2-fdf4-4b63-8721-077ed1398386`::ref 0 aborting False >Thread-7084::INFO::2014-07-08 16:48:39,237::clientIF::334::vds::(prepareVolumePath) prepared volume path: >Thread-7084::DEBUG::2014-07-08 16:48:39,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4420b38-ce7f-494b-802b-9fb66cd35bb6`::moving from state init -> state preparing >Thread-7084::INFO::2014-07-08 16:48:39,238::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', leafUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76') >Thread-7084::DEBUG::2014-07-08 16:48:39,239::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.2b5f401c-f143-45db-8578-1a8666cba539`ReqID=`05781669-d2b3-47b9-b728-8f18670f7f2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3201' at 'prepareImage' >Thread-7084::DEBUG::2014-07-08 16:48:39,239::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' for lock type 'shared' >Thread-7084::DEBUG::2014-07-08 16:48:39,239::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' is free. Now locking as 'shared' (1 active user) >Thread-7084::DEBUG::2014-07-08 16:48:39,240::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.2b5f401c-f143-45db-8578-1a8666cba539`ReqID=`05781669-d2b3-47b9-b728-8f18670f7f2e`::Granted request >Thread-7084::DEBUG::2014-07-08 16:48:39,240::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a4420b38-ce7f-494b-802b-9fb66cd35bb6`::_resourcesAcquired: Storage.2b5f401c-f143-45db-8578-1a8666cba539 (shared) >Thread-7084::DEBUG::2014-07-08 16:48:39,241::task::993::Storage.TaskManager.Task::(_decref) Task=`a4420b38-ce7f-494b-802b-9fb66cd35bb6`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:48:39,241::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:39,242::__init__::225::IOProcess::(_processLogs) Message size is 163 >Thread-18::DEBUG::2014-07-08 16:48:39,242::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:39,242::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:39,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:39,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:39,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:39,244::__init__::225::IOProcess::(_processLogs) (273586) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:48:39,244::__init__::225::IOProcess::(_processLogs) (273586) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:48:39,244::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273586) Building response >Thread-18::DEBUG::2014-07-08 16:48:39,244::__init__::225::IOProcess::(_processLogs) (273586) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:39,245::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:39,245::__init__::225::IOProcess::(_processLogs) Sending response sized 796 >Thread-7084::DEBUG::2014-07-08 16:48:39,246::fileSD::497::Storage.StorageDomain::(activateVolumes) Fixing permissions on /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:48:39,247::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:39,247::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:48:39,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:39,248::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:39,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:39,248::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:39,248::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:39,249::__init__::225::IOProcess::(_processLogs) (273587) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:39,249::__init__::225::IOProcess::(_processLogs) (273587) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:39,249::__init__::225::IOProcess::(_processLogs) (273587) Building response >Thread-18::DEBUG::2014-07-08 16:48:39,249::__init__::225::IOProcess::(_processLogs) (273587) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:39,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:39,250::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7084::DEBUG::2014-07-08 16:48:39,251::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-7084::WARNING::2014-07-08 16:48:39,252::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/2b5f401c-f143-45db-8578-1a8666cba539 already exists >Thread-7084::DEBUG::2014-07-08 16:48:39,253::fileSD::472::Storage.StorageDomain::(createImageLinks) Creating symlink from /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c to /var/run/vdsm/storage/2b5f401c-f143-45db-8578-1a8666cba539/c1abf407-d743-43d7-85bb-157eec06157c >Thread-7084::DEBUG::2014-07-08 16:48:39,253::fileSD::477::Storage.StorageDomain::(createImageLinks) img run dir already exists: /var/run/vdsm/storage/2b5f401c-f143-45db-8578-1a8666cba539/c1abf407-d743-43d7-85bb-157eec06157c >Thread-18::DEBUG::2014-07-08 16:48:39,254::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:39,254::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-18::DEBUG::2014-07-08 16:48:39,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:39,255::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:39,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:39,256::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:39,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:39,256::__init__::225::IOProcess::(_processLogs) (273588) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:39,256::__init__::225::IOProcess::(_processLogs) (273588) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:39,256::__init__::225::IOProcess::(_processLogs) (273588) Building response >Thread-18::DEBUG::2014-07-08 16:48:39,257::__init__::225::IOProcess::(_processLogs) (273588) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:39,257::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:39,257::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:48:39,259::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:39,259::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-18::DEBUG::2014-07-08 16:48:39,259::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:39,260::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:39,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:39,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:39,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:39,261::__init__::225::IOProcess::(_processLogs) (273589) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:39,261::__init__::225::IOProcess::(_processLogs) (273589) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:39,261::__init__::225::IOProcess::(_processLogs) (273589) Building response >Thread-18::DEBUG::2014-07-08 16:48:39,261::__init__::225::IOProcess::(_processLogs) (273589) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:39,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:39,262::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7084::DEBUG::2014-07-08 16:48:39,262::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:48:39,263::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:39,263::__init__::225::IOProcess::(_processLogs) Message size is 238 >Thread-18::DEBUG::2014-07-08 16:48:39,264::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:39,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:39,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:39,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:39,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:39,265::__init__::225::IOProcess::(_processLogs) (273590) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:39,265::__init__::225::IOProcess::(_processLogs) (273590) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:39,265::__init__::225::IOProcess::(_processLogs) (273590) Building response >Thread-18::DEBUG::2014-07-08 16:48:39,266::__init__::225::IOProcess::(_processLogs) (273590) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:39,266::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:39,266::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:39,267::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:39,268::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:48:39,268::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:39,268::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:39,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:39,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:39,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:39,269::__init__::225::IOProcess::(_processLogs) (273591) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:39,269::__init__::225::IOProcess::(_processLogs) (273591) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:39,270::__init__::225::IOProcess::(_processLogs) (273591) Building response >Thread-18::DEBUG::2014-07-08 16:48:39,270::__init__::225::IOProcess::(_processLogs) (273591) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:39,270::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:39,270::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7084::INFO::2014-07-08 16:48:39,271::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'imgVolumesInfo': [{'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}]} >Thread-7084::DEBUG::2014-07-08 16:48:39,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4420b38-ce7f-494b-802b-9fb66cd35bb6`::finished: {'info': {'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'imgVolumesInfo': [{'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}]} >Thread-7084::DEBUG::2014-07-08 16:48:39,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4420b38-ce7f-494b-802b-9fb66cd35bb6`::moving from state preparing -> state finished >Thread-7084::DEBUG::2014-07-08 16:48:39,272::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.2b5f401c-f143-45db-8578-1a8666cba539': < ResourceRef 'Storage.2b5f401c-f143-45db-8578-1a8666cba539', isValid: 'True' obj: 'None'>} >Thread-7084::DEBUG::2014-07-08 16:48:39,272::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7084::DEBUG::2014-07-08 16:48:39,273::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' >Thread-7084::DEBUG::2014-07-08 16:48:39,273::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' (0 active users) >Thread-7084::DEBUG::2014-07-08 16:48:39,273::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539' is free, finding out if anyone is waiting for it. >Thread-7084::DEBUG::2014-07-08 16:48:39,273::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.2b5f401c-f143-45db-8578-1a8666cba539', Clearing records. >Thread-7084::DEBUG::2014-07-08 16:48:39,274::task::993::Storage.TaskManager.Task::(_decref) Task=`a4420b38-ce7f-494b-802b-9fb66cd35bb6`::ref 0 aborting False >Thread-7084::INFO::2014-07-08 16:48:39,274::clientIF::334::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-7084::DEBUG::2014-07-08 16:48:39,327::utils::738::root::(execCmd) /usr/libexec/vdsm/hooks/before_vm_start/10_faqemu (cwd None) >Thread-7084::DEBUG::2014-07-08 16:48:39,626::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-7084::INFO::2014-07-08 16:48:39,626::hooks::100::root::(_runHooksDir) >Thread-7084::DEBUG::2014-07-08 16:48:39,627::utils::738::root::(execCmd) /usr/libexec/vdsm/hooks/before_vm_start/50_hostedengine (cwd None) >Thread-7084::DEBUG::2014-07-08 16:48:39,956::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-7084::INFO::2014-07-08 16:48:39,957::hooks::100::root::(_runHooksDir) >Thread-7084::DEBUG::2014-07-08 16:48:39,957::utils::738::root::(execCmd) /usr/libexec/vdsm/hooks/before_vm_start/50_nestedvt (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:40,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7084::DEBUG::2014-07-08 16:48:40,276::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-7084::INFO::2014-07-08 16:48:40,276::hooks::100::root::(_runHooksDir) >Thread-7084::DEBUG::2014-07-08 16:48:40,277::vm::3214::vm.Vm::(_run) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::<?xml version="1.0" encoding="utf-8"?><domain type="kvm"> > <name>vm1</name> > <uuid>9b0bd5aa-d706-426a-a077-62a64954b803</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="1">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/9b0bd5aa-d706-426a-a077-62a64954b803.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/9b0bd5aa-d706-426a-a077-62a64954b803.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <memballoon model="none"/> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x05" type="pci"/> > </controller> > <video> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x02" type="pci"/> > <model heads="1" type="qxl" vram="32768"/> > </video> > <graphics autoport="yes" keymap="en-us" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > <listen network="vdsm-ovirtmgmt" type="network"/> > </graphics> > <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/> > <mac address="00:1a:4a:16:88:5b"/> > <model type="virtio"/> > <source bridge="ovirtmgmt"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > <mac address="00:1a:4a:16:88:5c"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="file"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x07" type="pci"/> > <source file="/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76"/> > <target bus="virtio" dev="vda"/> > <serial>c1abf407-d743-43d7-85bb-157eec06157c</serial> > <driver cache="none" error_policy="stop" io="threads" name="qemu" type="raw"/> > </disk> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">oVirt</entry> > <entry name="product">oVirt Node</entry> > <entry name="version">6Server-6.5.0.1.el6</entry> > <entry name="serial">007EF314-A079-0010-A38A-0016367B3DFE</entry> > <entry name="uuid">9b0bd5aa-d706-426a-a077-62a64954b803</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > <timer name="pit" tickpolicy="delay"/> > <timer name="hpet" present="no"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Opteron_G1</model> > <topology cores="1" sockets="160" threads="1"/> > <feature name="svm" policy="require"/></cpu> ></domain> >Dummy-6860::DEBUG::2014-07-08 16:48:40,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0210097 s, 48.7 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-07-08 16:48:41,509::vm::5305::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::event Started detail 0 opaque None >Thread-7084::DEBUG::2014-07-08 16:48:41,602::vm::5145::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-7084::DEBUG::2014-07-08 16:48:41,602::vm::5166::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-7084::DEBUG::2014-07-08 16:48:41,603::vm::5185::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Matched {'name': (u'hdc', None), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, None), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, None), 'path': ('', None), 'type': (u'cdrom', None)} >Thread-7084::DEBUG::2014-07-08 16:48:41,604::vm::5145::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Looking for drive with attributes {'name': u'vda', 'bootOrder': '', 'boot': [], 'readonly': False, 'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'type': u'disk'} >Thread-7084::DEBUG::2014-07-08 16:48:41,604::vm::5166::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Matched {'name': (u'vda', u'vda'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, False), 'address': ({u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76'), 'type': (u'disk', u'disk')} >Thread-7084::DEBUG::2014-07-08 16:48:41,604::vm::5185::vm.Vm::(_getUnderlyingDriveInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Matched {'name': (u'vda', None), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, None), 'address': ({u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, None), 'path': (u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', None), 'type': (u'disk', None)} >Thread-7084::DEBUG::2014-07-08 16:48:41,773::vm::5621::vm.Vm::(_syncVolumeChain) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::vdsm chain: [u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76'], libvirt chain: [u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76'] >Thread-7084::DEBUG::2014-07-08 16:48:41,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd94fd8a-aa09-4fe7-9b8c-c62a170ee383`::moving from state init -> state preparing >Thread-7084::INFO::2014-07-08 16:48:41,775::logUtils::44::dispatcher::(wrapper) Run and protect: imageSyncVolumeChain(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', newChain=[u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76']) >Thread-7084::DEBUG::2014-07-08 16:48:41,776::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c`ReqID=`316e8f6e-622d-4c4c-8395-b404aa7f19b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1818' at 'imageSyncVolumeChain' >Thread-7084::DEBUG::2014-07-08 16:48:41,776::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:48:41,778::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,778::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-18::DEBUG::2014-07-08 16:48:41,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,779::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,779::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,779::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,780::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,780::__init__::225::IOProcess::(_processLogs) (273592) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:48:41,780::__init__::225::IOProcess::(_processLogs) (273592) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:48:41,780::__init__::225::IOProcess::(_processLogs) (273592) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,780::__init__::225::IOProcess::(_processLogs) (273592) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,781::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,781::__init__::225::IOProcess::(_processLogs) Sending response sized 261 >Thread-18::DEBUG::2014-07-08 16:48:41,782::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,783::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-18::DEBUG::2014-07-08 16:48:41,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,784::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,784::__init__::225::IOProcess::(_processLogs) (273593) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:41,785::__init__::225::IOProcess::(_processLogs) (273593) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:41,785::__init__::225::IOProcess::(_processLogs) (273593) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,785::__init__::225::IOProcess::(_processLogs) (273593) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,786::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:48:41,788::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,788::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-18::DEBUG::2014-07-08 16:48:41,788::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,789::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,790::__init__::225::IOProcess::(_processLogs) (273594) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,790::__init__::225::IOProcess::(_processLogs) (273594) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,790::__init__::225::IOProcess::(_processLogs) (273594) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,790::__init__::225::IOProcess::(_processLogs) (273594) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,791::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,791::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7084::DEBUG::2014-07-08 16:48:41,792::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:48:41,792::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,793::__init__::225::IOProcess::(_processLogs) Message size is 238 >Thread-18::DEBUG::2014-07-08 16:48:41,793::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,793::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,794::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,794::__init__::225::IOProcess::(_processLogs) (273595) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,795::__init__::225::IOProcess::(_processLogs) (273595) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,795::__init__::225::IOProcess::(_processLogs) (273595) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,795::__init__::225::IOProcess::(_processLogs) (273595) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,795::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,795::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:41,797::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,797::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:48:41,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,798::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,798::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,798::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,799::__init__::225::IOProcess::(_processLogs) (273596) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,799::__init__::225::IOProcess::(_processLogs) (273596) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,799::__init__::225::IOProcess::(_processLogs) (273596) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,799::__init__::225::IOProcess::(_processLogs) (273596) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,799::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,800::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:41,801::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,801::__init__::225::IOProcess::(_processLogs) Message size is 250 >Thread-18::DEBUG::2014-07-08 16:48:41,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,802::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,802::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,803::__init__::225::IOProcess::(_processLogs) (273597) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:48:41,803::__init__::225::IOProcess::(_processLogs) (273597) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:48:41,804::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273597) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,804::__init__::225::IOProcess::(_processLogs) (273597) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,804::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,804::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-18::DEBUG::2014-07-08 16:48:41,806::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,806::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-18::DEBUG::2014-07-08 16:48:41,806::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,806::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,807::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,807::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,807::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,807::__init__::225::IOProcess::(_processLogs) (273598) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:41,808::__init__::225::IOProcess::(_processLogs) (273598) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:41,808::__init__::225::IOProcess::(_processLogs) (273598) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,808::__init__::225::IOProcess::(_processLogs) (273598) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,808::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,809::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:48:41,810::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,810::__init__::225::IOProcess::(_processLogs) Message size is 206 >Thread-18::DEBUG::2014-07-08 16:48:41,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,811::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,812::__init__::225::IOProcess::(_processLogs) (273599) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,812::__init__::225::IOProcess::(_processLogs) (273599) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,812::__init__::225::IOProcess::(_processLogs) (273599) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,813::__init__::225::IOProcess::(_processLogs) (273599) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,813::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7084::DEBUG::2014-07-08 16:48:41,814::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:48:41,814::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,815::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:48:41,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,815::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,816::__init__::225::IOProcess::(_processLogs) (273600) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,816::__init__::225::IOProcess::(_processLogs) (273600) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,817::__init__::225::IOProcess::(_processLogs) (273600) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,817::__init__::225::IOProcess::(_processLogs) (273600) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,817::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:41,819::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,819::__init__::225::IOProcess::(_processLogs) Message size is 248 >Thread-18::DEBUG::2014-07-08 16:48:41,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,820::__init__::225::IOProcess::(_processLogs) (273601) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,821::__init__::225::IOProcess::(_processLogs) (273601) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,821::__init__::225::IOProcess::(_processLogs) (273601) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,821::__init__::225::IOProcess::(_processLogs) (273601) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,821::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,822::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:41,823::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,823::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:48:41,823::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,823::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,824::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,824::__init__::225::IOProcess::(_processLogs) (273602) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:48:41,825::__init__::225::IOProcess::(_processLogs) (273602) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:48:41,825::__init__::225::IOProcess::(_processLogs) DEBUG|(273602) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,826::__init__::225::IOProcess::(_processLogs) (273602) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,826::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,826::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-18::DEBUG::2014-07-08 16:48:41,827::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,828::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-18::DEBUG::2014-07-08 16:48:41,828::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,828::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,828::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,829::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,829::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,829::__init__::225::IOProcess::(_processLogs) (273603) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:41,829::__init__::225::IOProcess::(_processLogs) (273603) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:41,830::__init__::225::IOProcess::(_processLogs) (273603) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,830::__init__::225::IOProcess::(_processLogs) (273603) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,830::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:48:41,832::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,832::__init__::225::IOProcess::(_processLogs) Message size is 206 >Thread-18::DEBUG::2014-07-08 16:48:41,832::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,833::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,834::__init__::225::IOProcess::(_processLogs) (273604) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,834::__init__::225::IOProcess::(_processLogs) (273604) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,834::__init__::225::IOProcess::(_processLogs) (273604) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,834::__init__::225::IOProcess::(_processLogs) (273604) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,835::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7084::DEBUG::2014-07-08 16:48:41,835::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:48:41,836::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,837::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:48:41,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,837::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,838::__init__::225::IOProcess::(_processLogs) (273605) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,838::__init__::225::IOProcess::(_processLogs) (273605) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,838::__init__::225::IOProcess::(_processLogs) (273605) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,839::__init__::225::IOProcess::(_processLogs) (273605) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,839::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,839::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:41,840::__init__::225::IOProcess::(_processLogs) Message size is 248 >Thread-18::DEBUG::2014-07-08 16:48:41,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,842::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,842::__init__::225::IOProcess::(_processLogs) (273606) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,842::__init__::225::IOProcess::(_processLogs) (273606) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,842::__init__::225::IOProcess::(_processLogs) (273606) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,843::__init__::225::IOProcess::(_processLogs) (273606) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,843::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,843::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:41,844::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,845::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:48:41,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,846::__init__::225::IOProcess::(_processLogs) (273607) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:48:41,846::__init__::225::IOProcess::(_processLogs) (273607) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:48:41,847::__init__::225::IOProcess::(_processLogs) DEBUG|(273607) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,847::__init__::225::IOProcess::(_processLogs) (273607) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,848::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,848::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-18::DEBUG::2014-07-08 16:48:41,849::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,849::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:48:41,850::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,850::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,851::__init__::225::IOProcess::(_processLogs) (273608) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:48:41,851::__init__::225::IOProcess::(_processLogs) (273608) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:48:41,852::__init__::225::IOProcess::(_processLogs) DEBUG|(273608) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,852::__init__::225::IOProcess::(_processLogs) (273608) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,852::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,853::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-7084::INFO::2014-07-08 16:48:41,853::image::213::Storage.Image::(getChain) sdUUID=2b5f401c-f143-45db-8578-1a8666cba539 imgUUID=c1abf407-d743-43d7-85bb-157eec06157c chain=[<storage.fileVolume.FileVolume object at 0x7f0de6b4ef90>] >Thread-18::DEBUG::2014-07-08 16:48:41,854::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,854::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:48:41,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,855::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,855::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,856::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,856::__init__::225::IOProcess::(_processLogs) (273609) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:48:41,856::__init__::225::IOProcess::(_processLogs) (273609) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:48:41,857::__init__::225::IOProcess::(_processLogs) (273609) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,857::__init__::225::IOProcess::(_processLogs) Sending response sized 422 >Thread-7084::DEBUG::2014-07-08 16:48:41,859::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76`ReqID=`4c5fef05-7241-4229-85b3-eaa28b829d50`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '172' at '__getResourceCandidatesList' >Thread-7084::DEBUG::2014-07-08 16:48:41,859::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' for lock type 'shared' >Thread-7084::DEBUG::2014-07-08 16:48:41,859::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' is free. Now locking as 'shared' (1 active user) >Thread-7084::DEBUG::2014-07-08 16:48:41,860::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76`ReqID=`4c5fef05-7241-4229-85b3-eaa28b829d50`::Granted request >Thread-7084::DEBUG::2014-07-08 16:48:41,860::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' is free. Now locking as 'shared' (1 active user) >Thread-7084::DEBUG::2014-07-08 16:48:41,860::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c`ReqID=`316e8f6e-622d-4c4c-8395-b404aa7f19b9`::Granted request >Thread-18::DEBUG::2014-07-08 16:48:41,862::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-18::DEBUG::2014-07-08 16:48:41,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,863::__init__::225::IOProcess::(_processLogs) (273610) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:41,863::__init__::225::IOProcess::(_processLogs) (273610) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:41,863::__init__::225::IOProcess::(_processLogs) (273610) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,864::__init__::225::IOProcess::(_processLogs) (273610) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,864::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-18::DEBUG::2014-07-08 16:48:41,866::__init__::225::IOProcess::(_processLogs) Message size is 206 >Thread-18::DEBUG::2014-07-08 16:48:41,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,867::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,868::__init__::225::IOProcess::(_processLogs) (273611) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,868::__init__::225::IOProcess::(_processLogs) (273611) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,868::__init__::225::IOProcess::(_processLogs) (273611) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,868::__init__::225::IOProcess::(_processLogs) (273611) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,869::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,869::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7084::DEBUG::2014-07-08 16:48:41,869::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for f49c2dc9-a84e-484a-b8d7-efe4afd34c76 >Thread-18::DEBUG::2014-07-08 16:48:41,870::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,871::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-18::DEBUG::2014-07-08 16:48:41,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,871::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,872::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,872::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,872::__init__::225::IOProcess::(_processLogs) (273612) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,872::__init__::225::IOProcess::(_processLogs) (273612) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,873::__init__::225::IOProcess::(_processLogs) (273612) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,873::__init__::225::IOProcess::(_processLogs) (273612) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,873::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:41,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,875::__init__::225::IOProcess::(_processLogs) Message size is 248 >Thread-18::DEBUG::2014-07-08 16:48:41,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,875::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,876::__init__::225::IOProcess::(_processLogs) (273613) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:41,877::__init__::225::IOProcess::(_processLogs) (273613) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:41,877::__init__::225::IOProcess::(_processLogs) (273613) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,877::__init__::225::IOProcess::(_processLogs) (273613) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,877::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,877::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:41,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,879::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:48:41,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,880::__init__::225::IOProcess::(_processLogs) (273614) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:48:41,881::__init__::225::IOProcess::(_processLogs) (273614) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:48:41,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(273614) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,882::__init__::225::IOProcess::(_processLogs) (273614) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 422 >Thread-18::DEBUG::2014-07-08 16:48:41,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,884::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-18::DEBUG::2014-07-08 16:48:41,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,885::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,885::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,886::__init__::225::IOProcess::(_processLogs) (273615) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:48:41,886::__init__::225::IOProcess::(_processLogs) (273615) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:48:41,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(273615) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,887::__init__::225::IOProcess::(_processLogs) (273615) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 422 >Thread-7084::INFO::2014-07-08 16:48:41,888::image::213::Storage.Image::(getChain) sdUUID=2b5f401c-f143-45db-8578-1a8666cba539 imgUUID=c1abf407-d743-43d7-85bb-157eec06157c chain=[<storage.fileVolume.FileVolume object at 0x7f0dec7cdb10>] >Thread-7084::DEBUG::2014-07-08 16:48:41,889::hsm::1826::Storage.HSM::(imageSyncVolumeChain) unlinking subchain: [] >Thread-7084::DEBUG::2014-07-08 16:48:41,889::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' >Thread-7084::DEBUG::2014-07-08 16:48:41,890::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' (0 active users) >Thread-7084::DEBUG::2014-07-08 16:48:41,890::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c' is free, finding out if anyone is waiting for it. >Thread-7084::DEBUG::2014-07-08 16:48:41,890::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' >Thread-7084::DEBUG::2014-07-08 16:48:41,890::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' (0 active users) >Thread-7084::DEBUG::2014-07-08 16:48:41,891::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76' is free, finding out if anyone is waiting for it. >Thread-7084::DEBUG::2014-07-08 16:48:41,891::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '2b5f401c-f143-45db-8578-1a8666cba539_volumeNS.f49c2dc9-a84e-484a-b8d7-efe4afd34c76', Clearing records. >Thread-7084::DEBUG::2014-07-08 16:48:41,891::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '2b5f401c-f143-45db-8578-1a8666cba539_imageNS.c1abf407-d743-43d7-85bb-157eec06157c', Clearing records. >Thread-7084::INFO::2014-07-08 16:48:41,892::logUtils::47::dispatcher::(wrapper) Run and protect: imageSyncVolumeChain, Return response: None >Thread-7084::DEBUG::2014-07-08 16:48:41,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd94fd8a-aa09-4fe7-9b8c-c62a170ee383`::finished: None >Thread-7084::DEBUG::2014-07-08 16:48:41,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd94fd8a-aa09-4fe7-9b8c-c62a170ee383`::moving from state preparing -> state finished >Thread-7084::DEBUG::2014-07-08 16:48:41,892::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7084::DEBUG::2014-07-08 16:48:41,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7084::DEBUG::2014-07-08 16:48:41,893::task::993::Storage.TaskManager.Task::(_decref) Task=`bd94fd8a-aa09-4fe7-9b8c-c62a170ee383`::ref 0 aborting False >Thread-7084::DEBUG::2014-07-08 16:48:41,894::sampling::361::vm.Vm::(start) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Start statistics collection >Thread-7086::DEBUG::2014-07-08 16:48:41,895::sampling::390::vm.Vm::(run) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Stats thread started >Thread-7086::DEBUG::2014-07-08 16:48:41,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`6859d1ed-a649-4a57-8b5c-8c6a26b32923`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:48:41,898::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:48:41,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,899::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:48:41,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,901::__init__::225::IOProcess::(_processLogs) (273616) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:41,901::__init__::225::IOProcess::(_processLogs) (273616) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:41,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(273616) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,902::__init__::225::IOProcess::(_processLogs) (273616) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,902::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,902::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:48:41,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:41,905::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:48:41,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:41,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:41,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:41,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:41,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:41,906::__init__::225::IOProcess::(_processLogs) (273617) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:48:41,906::__init__::225::IOProcess::(_processLogs) (273617) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:48:41,907::__init__::225::IOProcess::(_processLogs) (273617) Building response >Thread-18::DEBUG::2014-07-08 16:48:41,907::__init__::225::IOProcess::(_processLogs) (273617) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:41,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:41,907::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:48:41,908::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:48:41,909::task::1191::Storage.TaskManager.Task::(prepare) Task=`6859d1ed-a649-4a57-8b5c-8c6a26b32923`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:48:41,910::task::595::Storage.TaskManager.Task::(_updateState) Task=`6859d1ed-a649-4a57-8b5c-8c6a26b32923`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:48:41,911::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:48:41,911::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:48:41,911::task::993::Storage.TaskManager.Task::(_decref) Task=`6859d1ed-a649-4a57-8b5c-8c6a26b32923`::ref 0 aborting False >Thread-7084::DEBUG::2014-07-08 16:48:41,925::vmchannels::199::vds::(register) Add fileno 52 to listener's channels. >Thread-7084::WARNING::2014-07-08 16:48:41,930::vm::3851::vm.Vm::(_readPauseCode) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::_readPauseCode unsupported by libvirt vm >Thread-7084::DEBUG::2014-07-08 16:48:41,997::vm::2212::vm.Vm::(_startUnderlyingVm) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::_ongoingCreations released >Thread-7086::DEBUG::2014-07-08 16:48:42,083::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:48:42,083::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >VM Channels Listener::DEBUG::2014-07-08 16:48:42,273::vmchannels::107::vds::(_do_add_channels) fileno 52 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-08 16:48:42,274::vmchannels::133::vds::(_handle_unconnected) Trying to connect fileno 52. >VM Channels Listener::DEBUG::2014-07-08 16:48:42,274::guestagent::199::vm.Vm::(_connect) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Attempting connection to /var/lib/libvirt/qemu/channels/9b0bd5aa-d706-426a-a077-62a64954b803.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-08 16:48:42,277::guestagent::202::vm.Vm::(_connect) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Connected to /var/lib/libvirt/qemu/channels/9b0bd5aa-d706-426a-a077-62a64954b803.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-08 16:48:42,278::vmchannels::149::vds::(_handle_unconnected) Connecting to fileno 52 succeeded. >Dummy-6860::DEBUG::2014-07-08 16:48:42,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:42,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170274 s, 60.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:43,029::__init__::225::IOProcess::(_processLogs) Message size is 225DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:48:43,030::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:43,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:43,030::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:43,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:43,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:43,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:43,031::__init__::225::IOProcess::(_processLogs) (273618) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:43,032::__init__::225::IOProcess::(_processLogs) (273618) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:43,032::__init__::225::IOProcess::(_processLogs) (273618) Building response >Thread-18::DEBUG::2014-07-08 16:48:43,032::__init__::225::IOProcess::(_processLogs) (273618) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:43,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:43,033::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:48:43,034::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:48:43,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00218849 s, 211 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:43,191::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:43,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:43,192::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:43,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:43,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:43,193::__init__::225::IOProcess::(_processLogs) (273619) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:43,194::__init__::225::IOProcess::(_processLogs) (273619) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:43,194::__init__::225::IOProcess::(_processLogs) (273619) Building response >Thread-18::DEBUG::2014-07-08 16:48:43,194::__init__::225::IOProcess::(_processLogs) (273619) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:43,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:43,195::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:48:43,200::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:48:43,201::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:43,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:43,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:43,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:43,209::__init__::225::IOProcess::(_processLogs) (273620) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:43,210::__init__::225::IOProcess::(_processLogs) (273620) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:43,212::__init__::225::IOProcess::(_processLogs) (273620) Building response >Thread-18::DEBUG::2014-07-08 16:48:43,213::__init__::225::IOProcess::(_processLogs) (273620) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:43,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:43,216::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:43,221::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:48:43,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:43,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:43,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:43,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:43,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:43,228::__init__::225::IOProcess::(_processLogs) (273621) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:43,230::__init__::225::IOProcess::(_processLogs) (273621) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:43,231::__init__::225::IOProcess::(_processLogs) (273621) Building response >Thread-18::DEBUG::2014-07-08 16:48:43,232::__init__::225::IOProcess::(_processLogs) (273621) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:43,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:43,234::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:43,240::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:48:43,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:43,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:43,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:43,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:43,246::__init__::225::IOProcess::(_processLogs) (273622) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:43,247::__init__::225::IOProcess::(_processLogs) (273622) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:43,249::__init__::225::IOProcess::(_processLogs) (273622) Building response >Thread-18::DEBUG::2014-07-08 16:48:43,250::__init__::225::IOProcess::(_processLogs) (273622) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:43,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:43,253::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 16:48:43,324::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7082::DEBUG::2014-07-08 16:48:43,326::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'hash': '4175313268389868316', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'displayIp': '10.35.128.17', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'memUsage': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'elapsedTime': '4', 'kvmEnable': 'true', 'network': {}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'vmType': 'kvm', 'cpuUser': '0.00', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.43', 'username': 'Unknown', 'displayType': 'qxl', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-6860::DEBUG::2014-07-08 16:48:44,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:48:44,854::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:48:44,880::task::595::Storage.TaskManager.Task::(_updateState) Task=`506ee1a9-ef64-4f1d-8c81-80545f2a7bbb`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:44,882::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:48:44,960::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:48:44,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390864 s, 26.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:44,964::task::1191::Storage.TaskManager.Task::(prepare) Task=`506ee1a9-ef64-4f1d-8c81-80545f2a7bbb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:45,057::task::595::Storage.TaskManager.Task::(_updateState) Task=`506ee1a9-ef64-4f1d-8c81-80545f2a7bbb`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:45,058::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:45,062::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:45,065::task::993::Storage.TaskManager.Task::(_decref) Task=`506ee1a9-ef64-4f1d-8c81-80545f2a7bbb`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:48:45,089::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:48:45,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`83c260d0-dbb8-4777-aca7-7caeac4c9935`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:48:45,095::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:48:45,100::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fdb2c325-cf16-47c3-97f4-a266690b2f08`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:48:45,102::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:48:45,105::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:48:45,106::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fdb2c325-cf16-47c3-97f4-a266690b2f08`::Granted request >Thread-7083::DEBUG::2014-07-08 16:48:45,115::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`83c260d0-dbb8-4777-aca7-7caeac4c9935`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:48:45,117::task::993::Storage.TaskManager.Task::(_decref) Task=`83c260d0-dbb8-4777-aca7-7caeac4c9935`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:48:45,166::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:45,166::task::1191::Storage.TaskManager.Task::(prepare) Task=`83c260d0-dbb8-4777-aca7-7caeac4c9935`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:45,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`83c260d0-dbb8-4777-aca7-7caeac4c9935`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:48:45,167::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:48:45,167::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:48:45,167::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:48:45,168::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:48:45,168::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:48:45,168::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:48:45,169::task::993::Storage.TaskManager.Task::(_decref) Task=`83c260d0-dbb8-4777-aca7-7caeac4c9935`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:48:46,473::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7082::DEBUG::2014-07-08 16:48:46,475::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'hash': '4175313268389868316', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'displayIp': '10.35.128.17', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'memUsage': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'elapsedTime': '7', 'kvmEnable': 'true', 'network': {}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'vmType': 'kvm', 'cpuUser': '0.00', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.39', 'username': 'Unknown', 'displayType': 'qxl', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-6860::DEBUG::2014-07-08 16:48:47,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:47,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181326 s, 56.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:48:49,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:49,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177624 s, 57.6 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:49,700::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7082::DEBUG::2014-07-08 16:48:49,709::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'hash': '4175313268389868316', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'displayIp': '10.35.128.17', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'memUsage': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'elapsedTime': '10', 'kvmEnable': 'true', 'network': {}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'vmType': 'kvm', 'cpuUser': '0.00', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.62', 'username': 'Unknown', 'displayType': 'qxl', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-6860::DEBUG::2014-07-08 16:48:51,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:52,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172266 s, 59.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:52,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`2841b0ad-eea4-4ae9-b4bc-e1f32d5722fe`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:52,777::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:48:52,778::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00218849', 'lastCheck': '9.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:48:52,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`2841b0ad-eea4-4ae9-b4bc-e1f32d5722fe`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00218849', 'lastCheck': '9.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:48:52,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`2841b0ad-eea4-4ae9-b4bc-e1f32d5722fe`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:52,779::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:52,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:52,779::task::993::Storage.TaskManager.Task::(_decref) Task=`2841b0ad-eea4-4ae9-b4bc-e1f32d5722fe`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:48:53,260::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:53,260::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:53,260::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:53,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:53,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:53,261::__init__::225::IOProcess::(_processLogs) (273623) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:53,261::__init__::225::IOProcess::(_processLogs) (273623) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:53,262::__init__::225::IOProcess::(_processLogs) (273623) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:53,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:53,262::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:48:53,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:48:53,418::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000481334 s, 960 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:48:53,424::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:48:53,426::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:53,427::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:53,428::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:53,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:53,431::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:53,433::__init__::225::IOProcess::(_processLogs) (273624) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:48:53,434::__init__::225::IOProcess::(_processLogs) (273624) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:48:53,436::__init__::225::IOProcess::(_processLogs) (273624) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:53,437::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:53,438::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:48:53,448::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:48:53,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:53,451::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:53,452::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:53,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:53,455::__init__::225::IOProcess::(_processLogs) (273625) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:53,456::__init__::225::IOProcess::(_processLogs) (273625) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:53,457::__init__::225::IOProcess::(_processLogs) (273625) Building response >Thread-18::DEBUG::2014-07-08 16:48:53,459::__init__::225::IOProcess::(_processLogs) (273625) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:53,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:53,461::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:53,467::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:48:53,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:53,471::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:53,473::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:53,474::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:53,476::__init__::225::IOProcess::(_processLogs) (273626) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:53,478::__init__::225::IOProcess::(_processLogs) (273626) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:53,479::__init__::225::IOProcess::(_processLogs) (273626) Building response >Thread-18::DEBUG::2014-07-08 16:48:53,481::__init__::225::IOProcess::(_processLogs) (273626) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:53,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:53,484::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:48:53,490::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:48:53,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:48:53,493::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:48:53,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:48:53,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:48:53,497::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:48:53,498::__init__::225::IOProcess::(_processLogs) (273627) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:48:53,500::__init__::225::IOProcess::(_processLogs) (273627) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:48:53,501::__init__::225::IOProcess::(_processLogs) (273627) Building response >Thread-18::DEBUG::2014-07-08 16:48:53,502::__init__::225::IOProcess::(_processLogs) (273627) Queuing response >Thread-18::DEBUG::2014-07-08 16:48:53,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:48:53,505::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:48:54,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:54,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172914 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:55,228::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:48:55,229::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d041318-fcef-4c01-8358-721f4e111a25`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:48:55,230::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:48:55,248::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:55,249::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d041318-fcef-4c01-8358-721f4e111a25`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:48:55,249::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d041318-fcef-4c01-8358-721f4e111a25`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:48:55,249::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:48:55,250::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:48:55,250::task::993::Storage.TaskManager.Task::(_decref) Task=`6d041318-fcef-4c01-8358-721f4e111a25`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:48:55,273::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:48:55,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`28451527-dee8-427b-8100-156a68ae276f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:48:55,274::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:48:55,275::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d47d9636-cf4c-4ae2-bd2e-e49bab019c54`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:48:55,275::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:48:55,276::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:48:55,276::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d47d9636-cf4c-4ae2-bd2e-e49bab019c54`::Granted request >Thread-7083::DEBUG::2014-07-08 16:48:55,277::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`28451527-dee8-427b-8100-156a68ae276f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:48:55,277::task::993::Storage.TaskManager.Task::(_decref) Task=`28451527-dee8-427b-8100-156a68ae276f`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:48:55,296::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:55,297::task::1191::Storage.TaskManager.Task::(prepare) Task=`28451527-dee8-427b-8100-156a68ae276f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:48:55,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`28451527-dee8-427b-8100-156a68ae276f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:48:55,297::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:48:55,297::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:48:55,298::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:48:55,298::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:48:55,298::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:48:55,299::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:48:55,299::task::993::Storage.TaskManager.Task::(_decref) Task=`28451527-dee8-427b-8100-156a68ae276f`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:48:56,108::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7082::DEBUG::2014-07-08 16:48:56,110::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'hash': '4175313268389868316', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'displayIp': '10.35.128.17', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'memUsage': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'elapsedTime': '16', 'kvmEnable': 'true', 'network': {}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'vmType': 'kvm', 'cpuUser': '0.00', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.90', 'username': 'Unknown', 'displayType': 'qxl', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-6860::DEBUG::2014-07-08 16:48:56,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:56,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0194341 s, 52.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:48:57,256::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:48:57,257::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:48:58,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:48:58,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017333 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:48:59,229::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7082::DEBUG::2014-07-08 16:48:59,231::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:48:59,232::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '17.81', 'elapsedTime': '20', 'displayType': 'qxl', 'cpuSys': '31.34', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.97', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:49:00,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:01,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176023 s, 58.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:49:02,281::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7082::DEBUG::2014-07-08 16:49:02,283::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:49:02,284::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '17.81', 'elapsedTime': '23', 'displayType': 'qxl', 'cpuSys': '31.34', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.02', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:02,437::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:02,438::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:02,439::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:03,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:03,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0236558 s, 43.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:03,511::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:03,512::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:03,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:03,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:03,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:03,513::__init__::225::IOProcess::(_processLogs) (273628) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:03,513::__init__::225::IOProcess::(_processLogs) (273628) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:03,514::__init__::225::IOProcess::(_processLogs) (273628) Building response >Thread-18::DEBUG::2014-07-08 16:49:03,514::__init__::225::IOProcess::(_processLogs) (273628) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:03,514::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:03,515::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:49:03,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:49:03,677::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00197422 s, 234 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:03,681::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:03,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:03,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:03,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:03,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:03,684::__init__::225::IOProcess::(_processLogs) (273629) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:03,684::__init__::225::IOProcess::(_processLogs) (273629) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:03,685::__init__::225::IOProcess::(_processLogs) (273629) Building response >Thread-18::DEBUG::2014-07-08 16:49:03,685::__init__::225::IOProcess::(_processLogs) (273629) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:03,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:03,686::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:49:03,692::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:49:03,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:03,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:03,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:03,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:03,705::__init__::225::IOProcess::(_processLogs) (273630) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:03,707::__init__::225::IOProcess::(_processLogs) (273630) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:03,709::__init__::225::IOProcess::(_processLogs) (273630) Building response >Thread-18::DEBUG::2014-07-08 16:49:03,710::__init__::225::IOProcess::(_processLogs) (273630) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:03,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:03,713::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:03,719::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:49:03,720::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:03,722::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:03,722::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:03,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:03,723::__init__::225::IOProcess::(_processLogs) (273631) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:03,724::__init__::225::IOProcess::(_processLogs) (273631) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:03,724::__init__::225::IOProcess::(_processLogs) (273631) Building response >Thread-18::DEBUG::2014-07-08 16:49:03,725::__init__::225::IOProcess::(_processLogs) (273631) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:03,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:03,726::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:03,728::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:49:03,729::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:03,730::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:03,730::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:03,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:03,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:03,734::__init__::225::IOProcess::(_processLogs) (273632) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:03,735::__init__::225::IOProcess::(_processLogs) (273632) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:03,735::__init__::225::IOProcess::(_processLogs) (273632) Building response >Thread-18::DEBUG::2014-07-08 16:49:03,736::__init__::225::IOProcess::(_processLogs) (273632) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:03,736::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:03,737::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 16:49:05,339::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:49:05,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`d79d9078-e1b7-4c3c-910c-c956ad16f2d6`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:49:05,340::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:49:05,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:49:05,355::task::1191::Storage.TaskManager.Task::(prepare) Task=`d79d9078-e1b7-4c3c-910c-c956ad16f2d6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:49:05,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`d79d9078-e1b7-4c3c-910c-c956ad16f2d6`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:49:05,356::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:49:05,357::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:49:05,357::task::993::Storage.TaskManager.Task::(_decref) Task=`d79d9078-e1b7-4c3c-910c-c956ad16f2d6`::ref 0 aborting False >Detector thread::DEBUG::2014-07-08 16:49:05,360::protocoldetector::159::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.162.23:48904 >Detector thread::DEBUG::2014-07-08 16:49:05,360::protocoldetector::170::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.162.23:48904 >Detector thread::DEBUG::2014-07-08 16:49:05,361::protocoldetector::196::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.162.23:48904 >Detector thread::DEBUG::2014-07-08 16:49:05,361::BindingXMLRPC::1147::XmlDetector::(handleSocket) xml over http detected from ('10.35.162.23', 48904) >Thread-7083::DEBUG::2014-07-08 16:49:05,383::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:49:05,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ee347d0-2432-4269-8f2c-3f41f223d09f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:49:05,384::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:49:05,385::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e18bf930-d6f5-4f1f-a946-c340912de675`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:49:05,385::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:49:05,385::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:49:05,386::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e18bf930-d6f5-4f1f-a946-c340912de675`::Granted request >Thread-7083::DEBUG::2014-07-08 16:49:05,386::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3ee347d0-2432-4269-8f2c-3f41f223d09f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:49:05,387::task::993::Storage.TaskManager.Task::(_decref) Task=`3ee347d0-2432-4269-8f2c-3f41f223d09f`::ref 1 aborting False >Dummy-6860::DEBUG::2014-07-08 16:49:05,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7083::INFO::2014-07-08 16:49:05,556::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:05,557::task::1191::Storage.TaskManager.Task::(prepare) Task=`3ee347d0-2432-4269-8f2c-3f41f223d09f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:05,557::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ee347d0-2432-4269-8f2c-3f41f223d09f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:49:05,557::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:49:05,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:49:05,560::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:49:05,561::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7087::DEBUG::2014-07-08 16:49:05,564::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7083::DEBUG::2014-07-08 16:49:05,563::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:49:05,566::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7087::DEBUG::2014-07-08 16:49:05,569::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7083::DEBUG::2014-07-08 16:49:05,574::task::993::Storage.TaskManager.Task::(_decref) Task=`3ee347d0-2432-4269-8f2c-3f41f223d09f`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:49:05,579::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '17.81', 'elapsedTime': '26', 'displayType': 'qxl', 'cpuSys': '31.34', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.31', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:49:05,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501316 s, 20.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:07,447::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:07,448::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:07,449::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:07,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:07,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193869 s, 52.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:49:08,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a9ec39d-c927-4ce4-b04d-69e761c366a7`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:49:08,636::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:49:08,637::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197422', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:49:08,637::task::1191::Storage.TaskManager.Task::(prepare) Task=`4a9ec39d-c927-4ce4-b04d-69e761c366a7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197422', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:49:08,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a9ec39d-c927-4ce4-b04d-69e761c366a7`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:49:08,637::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:49:08,638::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:49:08,638::task::993::Storage.TaskManager.Task::(_decref) Task=`4a9ec39d-c927-4ce4-b04d-69e761c366a7`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:49:08,700::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:09,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:10,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241868 s, 42.3 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:49:12,092::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7087::DEBUG::2014-07-08 16:49:12,097::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:12,098::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '17.81', 'elapsedTime': '32', 'displayType': 'qxl', 'cpuSys': '31.34', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.84', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Thread-7086::DEBUG::2014-07-08 16:49:12,293::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:49:12,295::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:49:12,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:12,461::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:12,466::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:12,468::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:12,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407919 s, 25.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:49:12,572::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-18::DEBUG::2014-07-08 16:49:13,742::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:13,742::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:13,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:13,743::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:13,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:13,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:13,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:13,744::__init__::225::IOProcess::(_processLogs) (273633) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:13,744::__init__::225::IOProcess::(_processLogs) (273633) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:13,744::__init__::225::IOProcess::(_processLogs) (273633) Building response >Thread-18::DEBUG::2014-07-08 16:49:13,744::__init__::225::IOProcess::(_processLogs) (273633) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:13,745::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:49:13,745::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:49:13,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:49:13,900::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000482732 s, 957 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:13,905::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:13,907::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:13,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:13,909::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:13,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:13,912::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:13,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:13,915::__init__::225::IOProcess::(_processLogs) (273634) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:13,916::__init__::225::IOProcess::(_processLogs) (273634) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:13,917::__init__::225::IOProcess::(_processLogs) (273634) Building response >Thread-18::DEBUG::2014-07-08 16:49:13,918::__init__::225::IOProcess::(_processLogs) (273634) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:13,919::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:13,920::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:49:13,928::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:13,929::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:49:13,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:13,933::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:13,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:13,935::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:13,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:13,937::__init__::225::IOProcess::(_processLogs) (273635) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:13,939::__init__::225::IOProcess::(_processLogs) (273635) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:13,940::__init__::225::IOProcess::(_processLogs) (273635) Building response >Thread-18::DEBUG::2014-07-08 16:49:13,942::__init__::225::IOProcess::(_processLogs) (273635) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:13,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:13,944::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:13,954::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:13,955::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:49:13,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:13,958::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:13,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:13,961::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:13,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:13,964::__init__::225::IOProcess::(_processLogs) (273636) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:13,965::__init__::225::IOProcess::(_processLogs) (273636) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:13,966::__init__::225::IOProcess::(_processLogs) (273636) Building response >Thread-18::DEBUG::2014-07-08 16:49:13,967::__init__::225::IOProcess::(_processLogs) (273636) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:13,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:13,970::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:13,975::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:13,976::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:49:13,977::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:13,979::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:13,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:13,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:13,982::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:13,983::__init__::225::IOProcess::(_processLogs) (273637) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:13,984::__init__::225::IOProcess::(_processLogs) (273637) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:13,986::__init__::225::IOProcess::(_processLogs) (273637) Building response >Thread-18::DEBUG::2014-07-08 16:49:13,988::__init__::225::IOProcess::(_processLogs) (273637) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:13,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:13,990::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:49:14,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:14,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0168093 s, 60.9 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:49:15,138::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7087::DEBUG::2014-07-08 16:49:15,139::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:15,140::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '47.92', 'elapsedTime': '35', 'displayType': 'qxl', 'cpuSys': '54.01', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.84', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Thread-7087::DEBUG::2014-07-08 16:49:15,613::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 16:49:15,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`838f864b-d2e9-4db9-9e2e-2529be33a617`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:49:15,614::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 16:49:15,630::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:15,630::task::1191::Storage.TaskManager.Task::(prepare) Task=`838f864b-d2e9-4db9-9e2e-2529be33a617`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:15,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`838f864b-d2e9-4db9-9e2e-2529be33a617`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:49:15,631::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:49:15,631::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:49:15,631::task::993::Storage.TaskManager.Task::(_decref) Task=`838f864b-d2e9-4db9-9e2e-2529be33a617`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:49:15,644::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:49:15,644::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75c8887-3086-4c27-afdc-d64644d0b113`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:49:15,645::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:49:15,646::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0efa4a1b-db05-481f-8ffe-6de5124cc1ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:49:15,646::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:49:15,647::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:49:15,647::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0efa4a1b-db05-481f-8ffe-6de5124cc1ab`::Granted request >Thread-7083::DEBUG::2014-07-08 16:49:15,648::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f75c8887-3086-4c27-afdc-d64644d0b113`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:49:15,648::task::993::Storage.TaskManager.Task::(_decref) Task=`f75c8887-3086-4c27-afdc-d64644d0b113`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:49:15,667::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:15,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`f75c8887-3086-4c27-afdc-d64644d0b113`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:15,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75c8887-3086-4c27-afdc-d64644d0b113`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:49:15,668::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:49:15,668::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:49:15,668::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:49:15,669::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:49:15,669::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:49:15,669::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:49:15,669::task::993::Storage.TaskManager.Task::(_decref) Task=`f75c8887-3086-4c27-afdc-d64644d0b113`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:49:16,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:17,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169132 s, 60.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:17,485::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:17,487::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:17,488::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:18,192::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7087::DEBUG::2014-07-08 16:49:18,193::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:18,194::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '47.92', 'elapsedTime': '38', 'displayType': 'qxl', 'cpuSys': '54.01', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.90', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:49:19,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:19,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174121 s, 58.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:49:21,243::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7087::DEBUG::2014-07-08 16:49:21,244::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:21,245::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '47.92', 'elapsedTime': '42', 'displayType': 'qxl', 'cpuSys': '54.01', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.95', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:49:21,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:21,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017057 s, 60.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:22,495::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:22,497::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:22,498::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:23,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:23,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170858 s, 59.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:23,996::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:23,996::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:23,997::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:23,997::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:23,997::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:23,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:23,998::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:23,998::__init__::225::IOProcess::(_processLogs) (273638) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:23,998::__init__::225::IOProcess::(_processLogs) (273638) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:23,998::__init__::225::IOProcess::(_processLogs) (273638) Building response >Thread-18::DEBUG::2014-07-08 16:49:23,999::__init__::225::IOProcess::(_processLogs) (273638) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:23,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:23,999::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:49:24,001::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:49:24,151::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00044809 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:24,158::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:24,160::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:24,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:24,164::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:24,167::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:24,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:24,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:24,172::__init__::225::IOProcess::(_processLogs) (273639) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:24,173::__init__::225::IOProcess::(_processLogs) (273639) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:24,175::__init__::225::IOProcess::(_processLogs) (273639) Building response >Thread-18::DEBUG::2014-07-08 16:49:24,176::__init__::225::IOProcess::(_processLogs) (273639) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:24,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:24,178::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:49:24,187::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:24,188::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:49:24,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:24,191::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:24,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:24,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:24,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:24,198::__init__::225::IOProcess::(_processLogs) (273640) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:24,199::__init__::225::IOProcess::(_processLogs) (273640) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:24,201::__init__::225::IOProcess::(_processLogs) DEBUG|(273640) Building response >Thread-18::DEBUG::2014-07-08 16:49:24,202::__init__::225::IOProcess::(_processLogs) (273640) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:24,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:24,205::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:24,210::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:24,211::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:49:24,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:24,214::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:24,215::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:24,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:24,218::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:24,220::__init__::225::IOProcess::(_processLogs) (273641) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:24,221::__init__::225::IOProcess::(_processLogs) (273641) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:24,222::__init__::225::IOProcess::(_processLogs) (273641) Building response >Thread-18::DEBUG::2014-07-08 16:49:24,223::__init__::225::IOProcess::(_processLogs) (273641) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:24,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:24,226::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:24,235::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:24,237::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:49:24,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:24,240::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:24,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:24,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:24,245::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:24,247::__init__::225::IOProcess::(_processLogs) (273642) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:24,248::__init__::225::IOProcess::(_processLogs) (273642) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:24,250::__init__::225::IOProcess::(_processLogs) (273642) Building response >Thread-18::DEBUG::2014-07-08 16:49:24,251::__init__::225::IOProcess::(_processLogs) (273642) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:24,253::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:24,254::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 16:49:24,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`db31ac20-fe37-4fda-81f8-03a8cc30919c`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:49:24,305::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:49:24,307::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044809', 'lastCheck': '0.0', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:49:24,308::task::1191::Storage.TaskManager.Task::(prepare) Task=`db31ac20-fe37-4fda-81f8-03a8cc30919c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044809', 'lastCheck': '0.0', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:49:24,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`db31ac20-fe37-4fda-81f8-03a8cc30919c`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:49:24,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:49:24,311::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:49:24,313::task::993::Storage.TaskManager.Task::(_decref) Task=`db31ac20-fe37-4fda-81f8-03a8cc30919c`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:49:24,390::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:25,723::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 16:49:25,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`763a422d-530f-4693-b7f4-cbd8e18d062b`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:49:25,724::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 16:49:25,739::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:25,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`763a422d-530f-4693-b7f4-cbd8e18d062b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:25,740::task::595::Storage.TaskManager.Task::(_updateState) Task=`763a422d-530f-4693-b7f4-cbd8e18d062b`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:49:25,740::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:49:25,740::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:49:25,740::task::993::Storage.TaskManager.Task::(_decref) Task=`763a422d-530f-4693-b7f4-cbd8e18d062b`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:49:25,759::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:49:25,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5bd04c6-ae47-46c3-b9d2-a1153a8224d2`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:49:25,761::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:49:25,761::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d93bff92-a498-4ed9-ac44-039db2b0ad84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:49:25,762::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:49:25,762::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:49:25,762::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d93bff92-a498-4ed9-ac44-039db2b0ad84`::Granted request >Thread-7083::DEBUG::2014-07-08 16:49:25,763::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a5bd04c6-ae47-46c3-b9d2-a1153a8224d2`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:49:25,763::task::993::Storage.TaskManager.Task::(_decref) Task=`a5bd04c6-ae47-46c3-b9d2-a1153a8224d2`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:49:25,782::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:25,783::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5bd04c6-ae47-46c3-b9d2-a1153a8224d2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:25,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5bd04c6-ae47-46c3-b9d2-a1153a8224d2`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:49:25,783::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:49:25,783::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:49:25,784::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:49:25,784::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:49:25,785::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:49:25,785::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:49:25,785::task::993::Storage.TaskManager.Task::(_decref) Task=`a5bd04c6-ae47-46c3-b9d2-a1153a8224d2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:49:25,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:26,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174143 s, 58.8 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:49:27,328::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:49:27,329::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:27,501::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:27,503::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:27,504::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:27,567::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7087::DEBUG::2014-07-08 16:49:27,568::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:27,569::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '5.12', 'elapsedTime': '48', 'displayType': 'qxl', 'cpuSys': '6.85', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.27', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:49:28,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:28,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018144 s, 56.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:49:30,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:49:30,816::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7087::DEBUG::2014-07-08 16:49:30,826::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:30,835::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '5.12', 'elapsedTime': '51', 'displayType': 'qxl', 'cpuSys': '6.85', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.31', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:49:30,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0981804 s, 10.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:32,511::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:32,512::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:32,515::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:32,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:33,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173059 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:49:33,930::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7087::DEBUG::2014-07-08 16:49:33,932::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:33,932::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '5.12', 'elapsedTime': '54', 'displayType': 'qxl', 'cpuSys': '6.85', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.42', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Thread-18::DEBUG::2014-07-08 16:49:34,261::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:34,262::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:34,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:34,262::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:34,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:34,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:34,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:34,263::__init__::225::IOProcess::(_processLogs) (273643) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:34,264::__init__::225::IOProcess::(_processLogs) (273643) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:34,264::__init__::225::IOProcess::(_processLogs) (273643) Building response >Thread-18::DEBUG::2014-07-08 16:49:34,264::__init__::225::IOProcess::(_processLogs) (273643) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:34,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:34,265::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:49:34,266::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:49:34,421::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000478819 s, 965 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:34,430::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:34,433::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:34,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:34,439::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:34,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:34,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:34,450::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:34,454::__init__::225::IOProcess::(_processLogs) (273644) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:34,457::__init__::225::IOProcess::(_processLogs) (273644) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:34,460::__init__::225::IOProcess::(_processLogs) (273644) Building response >Thread-18::DEBUG::2014-07-08 16:49:34,464::__init__::225::IOProcess::(_processLogs) (273644) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:34,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:34,471::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:49:34,492::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:34,497::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:49:34,502::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:34,505::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:34,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:34,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:34,524::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:34,528::__init__::225::IOProcess::(_processLogs) (273645) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:34,531::__init__::225::IOProcess::(_processLogs) (273645) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:34,534::__init__::225::IOProcess::(_processLogs) (273645) Building response >Thread-18::DEBUG::2014-07-08 16:49:34,536::__init__::225::IOProcess::(_processLogs) (273645) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:34,539::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:34,543::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:34,551::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:34,554::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:49:34,556::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:34,559::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:34,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:34,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:34,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:34,572::__init__::225::IOProcess::(_processLogs) (273646) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:34,576::__init__::225::IOProcess::(_processLogs) (273646) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:34,578::__init__::225::IOProcess::(_processLogs) (273646) Building response >Thread-18::DEBUG::2014-07-08 16:49:34,581::__init__::225::IOProcess::(_processLogs) (273646) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:34,584::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:34,588::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:34,599::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:34,602::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:49:34,606::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:34,610::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:34,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:34,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:34,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:34,624::__init__::225::IOProcess::(_processLogs) (273647) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:34,627::__init__::225::IOProcess::(_processLogs) (273647) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:34,631::__init__::225::IOProcess::(_processLogs) (273647) Building response >Thread-18::DEBUG::2014-07-08 16:49:34,635::__init__::225::IOProcess::(_processLogs) (273647) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:34,638::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:34,642::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:49:35,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:35,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016983 s, 60.3 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:49:35,815::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 16:49:35,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`9da8b4f2-50f8-4e42-9862-13d163eb3fbd`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:49:35,817::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 16:49:35,831::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:35,832::task::1191::Storage.TaskManager.Task::(prepare) Task=`9da8b4f2-50f8-4e42-9862-13d163eb3fbd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:35,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`9da8b4f2-50f8-4e42-9862-13d163eb3fbd`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:49:35,832::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:49:35,833::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:49:35,833::task::993::Storage.TaskManager.Task::(_decref) Task=`9da8b4f2-50f8-4e42-9862-13d163eb3fbd`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:49:35,845::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:49:35,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`4efefcbe-76fe-4501-9317-0e9f04a1c0e5`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:49:35,847::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:49:35,848::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9e88fb05-f77f-40be-a77c-4d64297f2745`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:49:35,848::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:49:35,848::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:49:35,849::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9e88fb05-f77f-40be-a77c-4d64297f2745`::Granted request >Thread-7083::DEBUG::2014-07-08 16:49:35,849::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4efefcbe-76fe-4501-9317-0e9f04a1c0e5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:49:35,850::task::993::Storage.TaskManager.Task::(_decref) Task=`4efefcbe-76fe-4501-9317-0e9f04a1c0e5`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:49:35,868::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:35,869::task::1191::Storage.TaskManager.Task::(prepare) Task=`4efefcbe-76fe-4501-9317-0e9f04a1c0e5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:35,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`4efefcbe-76fe-4501-9317-0e9f04a1c0e5`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:49:35,869::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:49:35,870::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:49:35,870::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:49:35,870::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:49:35,870::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:49:35,871::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:49:35,871::task::993::Storage.TaskManager.Task::(_decref) Task=`4efefcbe-76fe-4501-9317-0e9f04a1c0e5`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:49:37,018::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmGetStats with ('9b0bd5aa-d706-426a-a077-62a64954b803',) {} >Thread-7087::DEBUG::2014-07-08 16:49:37,020::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:49:37,020::BindingXMLRPC::1114::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.128.17', 'type': 'spice', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '4092', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:1a:4a:16:88:5b', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}, u'vnet1': {'macAddr': '00:1a:4a:16:88:5c', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmJobs': {}, 'cpuUser': '5.12', 'elapsedTime': '57', 'displayType': 'qxl', 'cpuSys': '6.85', 'appsList': [], 'vcpuCount': '1', 'clientIp': '', 'hash': '4175313268389868316', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'displayIp': '10.35.128.17', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'flushLatency': '0', 'truesize': '24576'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '0.50', 'username': 'Unknown', 'status': 'Powering up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': u'5901'}]} >Dummy-6860::DEBUG::2014-07-08 16:49:37,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:37,670::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:37,673::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:37,677::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:37,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241069 s, 42.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:49:39,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:40,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0183653 s, 55.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:49:40,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`74016c17-c5ef-4c02-a9da-7821147ca286`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:49:40,053::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:49:40,054::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478819', 'lastCheck': '5.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:49:40,054::task::1191::Storage.TaskManager.Task::(prepare) Task=`74016c17-c5ef-4c02-a9da-7821147ca286`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478819', 'lastCheck': '5.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:49:40,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`74016c17-c5ef-4c02-a9da-7821147ca286`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:49:40,054::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:49:40,055::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:49:40,055::task::993::Storage.TaskManager.Task::(_decref) Task=`74016c17-c5ef-4c02-a9da-7821147ca286`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:49:40,164::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:42,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:42,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171822 s, 59.6 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:49:42,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe7b9606-0d7c-471e-a478-9b60fcae891a`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:49:42,525::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:49:42,526::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:42,527::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:49:42,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:42,527::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:42,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:42,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:42,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:42,528::__init__::225::IOProcess::(_processLogs) (273648) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:49:42,529::__init__::225::IOProcess::(_processLogs) (273648) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:49:42,529::__init__::225::IOProcess::(_processLogs) (273648) Building response >Thread-18::DEBUG::2014-07-08 16:49:42,529::__init__::225::IOProcess::(_processLogs) (273648) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:42,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:42,529::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:49:42,531::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:42,532::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:49:42,532::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:42,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:42,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:42,533::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:42,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:42,533::__init__::225::IOProcess::(_processLogs) (273649) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:49:42,533::__init__::225::IOProcess::(_processLogs) (273649) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:49:42,534::__init__::225::IOProcess::(_processLogs) (273649) Building response >Thread-18::DEBUG::2014-07-08 16:49:42,534::__init__::225::IOProcess::(_processLogs) (273649) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:42,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:42,534::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:49:42,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:49:42,536::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe7b9606-0d7c-471e-a478-9b60fcae891a`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:49:42,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe7b9606-0d7c-471e-a478-9b60fcae891a`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:49:42,536::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:49:42,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:49:42,537::task::993::Storage.TaskManager.Task::(_decref) Task=`fe7b9606-0d7c-471e-a478-9b60fcae891a`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:49:42,618::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:49:42,619::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:42,686::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:42,688::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:42,689::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 16:49:42,940::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:49:44,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:44,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0892993 s, 11.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:44,657::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:44,658::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:44,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:44,659::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:44,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:44,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:44,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:44,660::__init__::225::IOProcess::(_processLogs) (273650) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:44,661::__init__::225::IOProcess::(_processLogs) (273650) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:44,661::__init__::225::IOProcess::(_processLogs) (273650) Building response >Thread-18::DEBUG::2014-07-08 16:49:44,662::__init__::225::IOProcess::(_processLogs) (273650) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:44,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:44,662::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:49:44,665::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:49:44,823::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00600788 s, 76.9 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:44,825::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:44,825::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:44,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:44,826::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:44,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:44,826::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:44,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:44,827::__init__::225::IOProcess::(_processLogs) (273651) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:44,827::__init__::225::IOProcess::(_processLogs) (273651) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:44,827::__init__::225::IOProcess::(_processLogs) (273651) Building response >Thread-18::DEBUG::2014-07-08 16:49:44,827::__init__::225::IOProcess::(_processLogs) (273651) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:44,828::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:44,828::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:49:44,830::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:49:44,830::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:49:44,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:44,831::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:44,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:44,831::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:44,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:44,832::__init__::225::IOProcess::(_processLogs) (273652) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:44,832::__init__::225::IOProcess::(_processLogs) (273652) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:44,832::__init__::225::IOProcess::(_processLogs) (273652) Building response >Thread-18::DEBUG::2014-07-08 16:49:44,833::__init__::225::IOProcess::(_processLogs) (273652) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:44,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:44,833::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:44,834::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:49:44,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:44,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:44,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:44,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:44,835::__init__::225::IOProcess::(_processLogs) (273653) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:44,836::__init__::225::IOProcess::(_processLogs) (273653) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:44,836::__init__::225::IOProcess::(_processLogs) (273653) Building response >Thread-18::DEBUG::2014-07-08 16:49:44,836::__init__::225::IOProcess::(_processLogs) (273653) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:44,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:44,837::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:44,838::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:49:44,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:44,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:44,839::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:44,839::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:44,839::__init__::225::IOProcess::(_processLogs) (273654) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:44,839::__init__::225::IOProcess::(_processLogs) (273654) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:44,839::__init__::225::IOProcess::(_processLogs) (273654) Building response >Thread-18::DEBUG::2014-07-08 16:49:44,840::__init__::225::IOProcess::(_processLogs) (273654) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:44,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:44,840::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 16:49:45,912::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 16:49:45,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa6d75c5-b1a5-420b-929e-49aea1ff3217`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:49:45,914::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 16:49:45,928::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:45,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa6d75c5-b1a5-420b-929e-49aea1ff3217`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:45,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa6d75c5-b1a5-420b-929e-49aea1ff3217`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:49:45,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:49:45,930::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:49:45,930::task::993::Storage.TaskManager.Task::(_decref) Task=`fa6d75c5-b1a5-420b-929e-49aea1ff3217`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:49:45,948::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:49:45,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`010d287b-a194-487b-a899-e09040546e7e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:49:45,949::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:49:45,950::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`dce86d35-d0cb-4a17-bec1-c387614d9749`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:49:45,950::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:49:45,951::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:49:45,951::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`dce86d35-d0cb-4a17-bec1-c387614d9749`::Granted request >Thread-7083::DEBUG::2014-07-08 16:49:45,951::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`010d287b-a194-487b-a899-e09040546e7e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:49:45,952::task::993::Storage.TaskManager.Task::(_decref) Task=`010d287b-a194-487b-a899-e09040546e7e`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:49:45,971::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:45,971::task::1191::Storage.TaskManager.Task::(prepare) Task=`010d287b-a194-487b-a899-e09040546e7e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:45,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`010d287b-a194-487b-a899-e09040546e7e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:49:45,972::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:49:45,972::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:49:45,973::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:49:45,973::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:49:45,973::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:49:45,973::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:49:45,974::task::993::Storage.TaskManager.Task::(_decref) Task=`010d287b-a194-487b-a899-e09040546e7e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:49:46,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:47,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171615 s, 59.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:47,696::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:47,698::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:47,699::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:49,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:49,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253632 s, 40.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:49:51,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:51,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171233 s, 59.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:52,707::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:52,708::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:52,709::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:53,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:53,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171319 s, 59.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:54,843::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:54,844::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:54,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:54,844::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:54,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:54,845::__init__::225::IOProcess::(_processLogs) (273655) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:54,845::__init__::225::IOProcess::(_processLogs) (273655) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:54,845::__init__::225::IOProcess::(_processLogs) (273655) Building response >Thread-18::DEBUG::2014-07-08 16:49:54,846::__init__::225::IOProcess::(_processLogs) (273655) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:54,846::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:54,846::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:49:54,848::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:49:55,002::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00051793 s, 892 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:49:55,004::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:49:55,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:55,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:55,006::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:55,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:55,093::__init__::225::IOProcess::(_processLogs) (273656) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:49:55,097::__init__::225::IOProcess::(_processLogs) (273656) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:49:55,099::__init__::225::IOProcess::(_processLogs) (273656) Building response >Thread-18::DEBUG::2014-07-08 16:49:55,101::__init__::225::IOProcess::(_processLogs) (273656) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:55,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:55,104::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:49:55,135::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:49:55,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:55,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:55,139::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:55,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:55,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:55,144::__init__::225::IOProcess::(_processLogs) (273657) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:55,146::__init__::225::IOProcess::(_processLogs) (273657) Building response >Thread-18::DEBUG::2014-07-08 16:49:55,147::__init__::225::IOProcess::(_processLogs) (273657) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:55,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:55,149::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:55,154::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:49:55,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:49:55,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:55,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:55,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:55,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:55,163::__init__::225::IOProcess::(_processLogs) (273658) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:55,164::__init__::225::IOProcess::(_processLogs) (273658) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:55,166::__init__::225::IOProcess::(_processLogs) (273658) Building response >Thread-18::DEBUG::2014-07-08 16:49:55,167::__init__::225::IOProcess::(_processLogs) (273658) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:55,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:55,170::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:49:55,174::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:49:55,176::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:49:55,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:49:55,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:49:55,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:49:55,267::__init__::225::IOProcess::(_processLogs) (273659) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:49:55,269::__init__::225::IOProcess::(_processLogs) (273659) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:49:55,272::__init__::225::IOProcess::(_processLogs) (273659) Building response >Thread-18::DEBUG::2014-07-08 16:49:55,273::__init__::225::IOProcess::(_processLogs) (273659) Queuing response >Thread-18::DEBUG::2014-07-08 16:49:55,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:49:55,275::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 16:49:55,473::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c22f8ab-b961-41d3-bb99-421147cab21d`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:49:55,474::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:49:55,474::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051793', 'lastCheck': '0.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:49:55,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c22f8ab-b961-41d3-bb99-421147cab21d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051793', 'lastCheck': '0.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:49:55,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c22f8ab-b961-41d3-bb99-421147cab21d`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:49:55,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:49:55,475::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:49:55,476::task::993::Storage.TaskManager.Task::(_decref) Task=`4c22f8ab-b961-41d3-bb99-421147cab21d`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:49:55,528::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:55,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:49:56,099::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 16:49:56,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa6a7193-d699-4017-bbfa-4f70e197ca73`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:49:56,101::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 16:49:56,125::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:56,127::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa6a7193-d699-4017-bbfa-4f70e197ca73`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:49:56,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa6a7193-d699-4017-bbfa-4f70e197ca73`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:49:56,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Dummy-6860::DEBUG::2014-07-08 16:49:56,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274617 s, 37.3 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:49:56,194::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:49:56,195::task::993::Storage.TaskManager.Task::(_decref) Task=`aa6a7193-d699-4017-bbfa-4f70e197ca73`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:49:56,221::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:49:56,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`2749311d-5cd4-4ce0-89f8-2f8cabb0690d`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:49:56,222::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:49:56,223::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`aaaa1f48-e8c3-48dd-abed-ab70f25d5366`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:49:56,223::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:49:56,224::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:49:56,224::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`aaaa1f48-e8c3-48dd-abed-ab70f25d5366`::Granted request >Thread-7083::DEBUG::2014-07-08 16:49:56,225::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2749311d-5cd4-4ce0-89f8-2f8cabb0690d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:49:56,225::task::993::Storage.TaskManager.Task::(_decref) Task=`2749311d-5cd4-4ce0-89f8-2f8cabb0690d`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:49:56,244::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:56,245::task::1191::Storage.TaskManager.Task::(prepare) Task=`2749311d-5cd4-4ce0-89f8-2f8cabb0690d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:49:56,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`2749311d-5cd4-4ce0-89f8-2f8cabb0690d`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:49:56,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:49:56,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:49:56,246::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:49:56,246::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:49:56,247::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:49:56,247::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:49:56,247::task::993::Storage.TaskManager.Task::(_decref) Task=`2749311d-5cd4-4ce0-89f8-2f8cabb0690d`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:49:57,665::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:49:57,665::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:57,716::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:57,718::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:49:57,719::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:49:58,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:49:58,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169981 s, 60.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:50:00,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:00,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0892147 s, 11.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:02,728::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:02,730::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:02,731::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:02,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:03,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175482 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:50:05,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:50:05,292::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:05,296::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:05,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:05,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:05,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:05,309::__init__::225::IOProcess::(_processLogs) (273660) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:50:05,313::__init__::225::IOProcess::(_processLogs) (273660) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:50:05,317::__init__::225::IOProcess::(_processLogs) (273660) Building response >Thread-18::DEBUG::2014-07-08 16:50:05,320::__init__::225::IOProcess::(_processLogs) (273660) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:05,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:05,327::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Dummy-6860::DEBUG::2014-07-08 16:50:05,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0662573 s, 15.5 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:50:05,412::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:50:05,577::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000828577 s, 558 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:50:05,589::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:05,594::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:05,598::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:05,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:05,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:05,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:05,619::__init__::225::IOProcess::(_processLogs) (273661) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:50:05,624::__init__::225::IOProcess::(_processLogs) (273661) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:50:05,633::__init__::225::IOProcess::(_processLogs) (273661) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:05,638::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:05,644::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:50:05,674::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:50:05,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:05,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:05,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:05,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:05,695::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:05,701::__init__::225::IOProcess::(_processLogs) (273662) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:05,707::__init__::225::IOProcess::(_processLogs) (273662) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:05,713::__init__::225::IOProcess::(_processLogs) (273662) Building response >Thread-18::DEBUG::2014-07-08 16:50:05,719::__init__::225::IOProcess::(_processLogs) (273662) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:05,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:05,738::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:50:05,741::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:05,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:05,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:05,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:05,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:05,760::__init__::225::IOProcess::(_processLogs) (273663) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:05,764::__init__::225::IOProcess::(_processLogs) (273663) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:05,768::__init__::225::IOProcess::(_processLogs) (273663) Building response >Thread-18::DEBUG::2014-07-08 16:50:05,772::__init__::225::IOProcess::(_processLogs) (273663) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:05,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:05,782::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:50:05,793::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:05,795::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:50:05,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:05,801::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:05,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:05,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:05,811::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:05,814::__init__::225::IOProcess::(_processLogs) (273664) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:05,817::__init__::225::IOProcess::(_processLogs) (273664) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:05,820::__init__::225::IOProcess::(_processLogs) (273664) Building response >Thread-18::DEBUG::2014-07-08 16:50:05,823::__init__::225::IOProcess::(_processLogs) (273664) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:05,826::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:05,829::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 16:50:06,267::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 16:50:06,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`90cccfc1-4f95-4868-a330-0525cfd4a538`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:50:06,269::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 16:50:06,284::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:50:06,285::task::1191::Storage.TaskManager.Task::(prepare) Task=`90cccfc1-4f95-4868-a330-0525cfd4a538`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:50:06,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`90cccfc1-4f95-4868-a330-0525cfd4a538`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:50:06,285::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:50:06,285::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:50:06,286::task::993::Storage.TaskManager.Task::(_decref) Task=`90cccfc1-4f95-4868-a330-0525cfd4a538`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:50:06,307::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:50:06,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`1be0f5c6-d9a3-47a7-befa-e49dabefd5d4`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:50:06,309::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:50:06,310::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6f4fbcf5-078e-4cee-a43c-de6d44d65c67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:50:06,310::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:50:06,310::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:50:06,311::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6f4fbcf5-078e-4cee-a43c-de6d44d65c67`::Granted request >Thread-7083::DEBUG::2014-07-08 16:50:06,311::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1be0f5c6-d9a3-47a7-befa-e49dabefd5d4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:50:06,312::task::993::Storage.TaskManager.Task::(_decref) Task=`1be0f5c6-d9a3-47a7-befa-e49dabefd5d4`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:50:06,332::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:50:06,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`1be0f5c6-d9a3-47a7-befa-e49dabefd5d4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576395776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:50:06,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`1be0f5c6-d9a3-47a7-befa-e49dabefd5d4`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:50:06,333::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:50:06,333::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:50:06,334::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:50:06,334::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:50:06,334::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:50:06,334::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:50:06,335::task::993::Storage.TaskManager.Task::(_decref) Task=`1be0f5c6-d9a3-47a7-befa-e49dabefd5d4`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:07,740::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:07,746::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:07,751::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:08,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:08,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171316 s, 59.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:50:10,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:10,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176247 s, 58.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:50:10,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`55ac611f-7ee0-40f6-9184-acd69569f5b3`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:50:10,849::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:50:10,849::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000828577', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:50:10,850::task::1191::Storage.TaskManager.Task::(prepare) Task=`55ac611f-7ee0-40f6-9184-acd69569f5b3`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000828577', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:50:10,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`55ac611f-7ee0-40f6-9184-acd69569f5b3`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:50:10,850::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:50:10,851::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:50:10,851::task::993::Storage.TaskManager.Task::(_decref) Task=`55ac611f-7ee0-40f6-9184-acd69569f5b3`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:50:10,916::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:12,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:12,851::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:12,861::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:12,868::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 16:50:12,945::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:50:12,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396744 s, 25.8 MB/s\n'; <rc> = 0 >Thread-7086::ERROR::2014-07-08 16:50:12,947::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >VM Channels Listener::DEBUG::2014-07-08 16:50:13,145::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:50:14,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:15,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176124 s, 58.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:50:15,931::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:15,931::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:15,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:15,932::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:15,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:15,932::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:15,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:15,933::__init__::225::IOProcess::(_processLogs) (273665) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:50:15,933::__init__::225::IOProcess::(_processLogs) (273665) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:50:15,933::__init__::225::IOProcess::(_processLogs) (273665) Building response >Thread-18::DEBUG::2014-07-08 16:50:15,933::__init__::225::IOProcess::(_processLogs) (273665) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:15,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:15,934::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:50:15,936::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:50:16,093::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000534971 s, 864 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:50:16,098::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:16,099::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:16,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:16,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:16,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:16,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:16,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:16,107::__init__::225::IOProcess::(_processLogs) (273666) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:50:16,109::__init__::225::IOProcess::(_processLogs) (273666) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:50:16,110::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|(273666) Building response >Thread-18::DEBUG::2014-07-08 16:50:16,111::__init__::225::IOProcess::(_processLogs) (273666) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:16,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:16,114::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:50:16,121::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:16,123::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:50:16,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:16,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:16,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:16,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:16,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:16,130::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|(273667) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:16,131::__init__::225::IOProcess::(_processLogs) (273667) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:16,132::__init__::225::IOProcess::(_processLogs) (273667) Building response >Thread-18::DEBUG::2014-07-08 16:50:16,134::__init__::225::IOProcess::(_processLogs) (273667) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:16,135::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:16,136::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:50:16,141::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:16,143::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:50:16,144::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:16,146::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:16,147::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:16,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:16,150::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:16,152::__init__::225::IOProcess::(_processLogs) (273668) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:16,153::__init__::225::IOProcess::(_processLogs) (273668) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:16,154::__init__::225::IOProcess::(_processLogs) (273668) Building response >Thread-18::DEBUG::2014-07-08 16:50:16,156::__init__::225::IOProcess::(_processLogs) (273668) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:16,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:16,158::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:50:16,163::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:16,165::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:50:16,166::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:16,168::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:16,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:16,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:16,172::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:16,173::__init__::225::IOProcess::(_processLogs) (273669) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:16,175::__init__::225::IOProcess::(_processLogs) (273669) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:16,176::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|(273669) Building response >Thread-18::DEBUG::2014-07-08 16:50:16,178::__init__::225::IOProcess::(_processLogs) (273669) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:16,179::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:16,180::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 16:50:16,354::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 16:50:16,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d6d1d9b-4deb-4a8d-b390-03b31f708728`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:50:16,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 16:50:16,370::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:50:16,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d6d1d9b-4deb-4a8d-b390-03b31f708728`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:50:16,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d6d1d9b-4deb-4a8d-b390-03b31f708728`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:50:16,371::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:50:16,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:50:16,372::task::993::Storage.TaskManager.Task::(_decref) Task=`3d6d1d9b-4deb-4a8d-b390-03b31f708728`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:50:16,502::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:50:16,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b5cf479-99de-4ccc-bbad-6a7f126fd953`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:50:16,503::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:50:16,504::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c2a79d86-1197-4f90-a91a-193e0700e26c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:50:16,504::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:50:16,505::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:50:16,505::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c2a79d86-1197-4f90-a91a-193e0700e26c`::Granted request >Thread-7083::DEBUG::2014-07-08 16:50:16,506::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4b5cf479-99de-4ccc-bbad-6a7f126fd953`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:50:16,506::task::993::Storage.TaskManager.Task::(_decref) Task=`4b5cf479-99de-4ccc-bbad-6a7f126fd953`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:50:16,525::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:50:16,525::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b5cf479-99de-4ccc-bbad-6a7f126fd953`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:50:16,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b5cf479-99de-4ccc-bbad-6a7f126fd953`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:50:16,526::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:50:16,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:50:16,526::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:50:16,527::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:50:16,527::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:50:16,527::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:50:16,528::task::993::Storage.TaskManager.Task::(_decref) Task=`4b5cf479-99de-4ccc-bbad-6a7f126fd953`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:50:17,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:17,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169056 s, 60.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:17,876::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:17,878::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:17,879::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:19,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:19,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172096 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:50:21,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:22,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125422 s, 8.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:22,886::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:22,888::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:22,889::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:24,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:24,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170062 s, 60.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:50:26,186::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:26,187::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:26,188::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:26,191::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:26,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:26,194::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:26,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::DEBUG::2014-07-08 16:50:26,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec1b08c8-93f9-40f9-bfb1-ca7fca143e39`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:50:26,197::__init__::225::IOProcess::(_processLogs) (273670) Finding callback 'statvfs'... >Thread-7087::INFO::2014-07-08 16:50:26,198::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::DEBUG::2014-07-08 16:50:26,199::__init__::225::IOProcess::(_processLogs) (273670) Got request for method 'statvfs' >Thread-7087::INFO::2014-07-08 16:50:26,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534971', 'lastCheck': '10.0', 'valid': True}} >Thread-18::DEBUG::2014-07-08 16:50:26,201::__init__::225::IOProcess::(_processLogs) (273670) Building response >Thread-7087::DEBUG::2014-07-08 16:50:26,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec1b08c8-93f9-40f9-bfb1-ca7fca143e39`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534971', 'lastCheck': '10.0', 'valid': True}} >Thread-18::DEBUG::2014-07-08 16:50:26,202::__init__::225::IOProcess::(_processLogs) (273670) Queuing response >Thread-7087::DEBUG::2014-07-08 16:50:26,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec1b08c8-93f9-40f9-bfb1-ca7fca143e39`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:50:26,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:50:26,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::DEBUG::2014-07-08 16:50:26,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:50:26,206::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::DEBUG::2014-07-08 16:50:26,206::task::993::Storage.TaskManager.Task::(_decref) Task=`ec1b08c8-93f9-40f9-bfb1-ca7fca143e39`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 16:50:26,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:50:26,370::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000629394 s, 734 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:50:26,382::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:26,385::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:26,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:26,391::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:26,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:26,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:26,402::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:26,405::__init__::225::IOProcess::(_processLogs) (273671) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:50:26,408::__init__::225::IOProcess::(_processLogs) (273671) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:50:26,411::__init__::225::IOProcess::(_processLogs) (273671) Building response >Thread-18::DEBUG::2014-07-08 16:50:26,414::__init__::225::IOProcess::(_processLogs) (273671) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:26,417::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:26,420::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:50:26,441::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:26,443::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:50:26,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:26,452::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:26,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:26,463::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:26,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:26,479::__init__::225::IOProcess::(_processLogs) (273672) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:26,486::__init__::225::IOProcess::(_processLogs) (273672) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:26,493::__init__::225::IOProcess::(_processLogs) (273672) Building response >Thread-18::DEBUG::2014-07-08 16:50:26,497::__init__::225::IOProcess::(_processLogs) (273672) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:26,502::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:50:26,508::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:50:26,536::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-7087::DEBUG::2014-07-08 16:50:26,540::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:50:26,544::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:50:26,553::__init__::225::IOProcess::(_processLogs) Marshaling message... >Dummy-6860::DEBUG::2014-07-08 16:50:26,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:50:26,725::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 16:50:26,734::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:50:26,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 16:50:26,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1b4d84e-19b4-420d-9674-1bfe7aaa4838`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:50:26,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 16:50:26,757::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:50:26,759::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:26,767::__init__::225::IOProcess::(_processLogs) (273673) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:26,777::__init__::225::IOProcess::(_processLogs) (273673) Got request for method 'access' >Thread-7082::INFO::2014-07-08 16:50:26,783::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:50:26,790::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1b4d84e-19b4-420d-9674-1bfe7aaa4838`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:50:26,789::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|(273673) Building response >Thread-7082::DEBUG::2014-07-08 16:50:26,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1b4d84e-19b4-420d-9674-1bfe7aaa4838`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:50:26,800::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:50:26,800::__init__::225::IOProcess::(_processLogs) (273673) Queuing response >Thread-7082::DEBUG::2014-07-08 16:50:26,805::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:50:26,810::task::993::Storage.TaskManager.Task::(_decref) Task=`a1b4d84e-19b4-420d-9674-1bfe7aaa4838`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:50:26,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:26,817::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:50:26,834::__init__::225::IOProcess::(_processLogs) (273663) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:26,837::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:50:26,840::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:26,846::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:50:26,851::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:50:26,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:26,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:50:26,861::task::595::Storage.TaskManager.Task::(_updateState) Task=`8820eb88-aae8-4c81-969b-8e352980145a`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:50:26,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::INFO::2014-07-08 16:50:26,867::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:50:26,872::__init__::225::IOProcess::(_processLogs) (273674) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:26,878::__init__::225::IOProcess::(_processLogs) (273674) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:50:26,882::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4bc33410-0499-4a94-89e5-9bd98adaa440`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:50:26,885::__init__::225::IOProcess::(_processLogs) (273674) Building response >Thread-7083::DEBUG::2014-07-08 16:50:26,885::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:50:26,957::__init__::225::IOProcess::(_processLogs) (273674) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:50:26,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.159941 s, 6.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:50:26,963::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:50:26,962::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:50:26,967::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4bc33410-0499-4a94-89e5-9bd98adaa440`::Granted request >Thread-18::DEBUG::2014-07-08 16:50:26,968::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:50:26,978::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8820eb88-aae8-4c81-969b-8e352980145a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:50:26,982::task::993::Storage.TaskManager.Task::(_decref) Task=`8820eb88-aae8-4c81-969b-8e352980145a`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:50:27,037::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:50:27,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`8820eb88-aae8-4c81-969b-8e352980145a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:50:27,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`8820eb88-aae8-4c81-969b-8e352980145a`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:50:27,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:50:27,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:50:27,058::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:50:27,062::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:50:27,065::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:50:27,067::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:50:27,071::task::993::Storage.TaskManager.Task::(_decref) Task=`8820eb88-aae8-4c81-969b-8e352980145a`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:27,896::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:27,898::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:27,899::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 16:50:27,986::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:50:27,986::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:50:29,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:29,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171115 s, 59.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:50:31,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:31,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171163 s, 59.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:32,935::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:32,942::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:32,943::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:33,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:33,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177624 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:50:36,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:36,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182868 s, 56.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:50:36,983::__init__::225::IOProcess::(_processLogs) (273674) Building responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:36,984::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:36,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:36,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:36,985::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:36,985::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:36,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:36,986::__init__::225::IOProcess::(_processLogs) (273675) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:50:36,986::__init__::225::IOProcess::(_processLogs) (273675) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:50:36,986::__init__::225::IOProcess::(_processLogs) (273675) Building response >Thread-18::DEBUG::2014-07-08 16:50:36,986::__init__::225::IOProcess::(_processLogs) (273675) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:36,986::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:36,987::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:50:36,988::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:50:37,141::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:50:37,147::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0072214 s, 64.0 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:50:37,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c7954d2-67bb-4aa3-85fb-6f5d1dcec037`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:50:37,151::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:50:37,152::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:37,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:37,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:37,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:37,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:37,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:37,156::__init__::225::IOProcess::(_processLogs) (273676) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:50:37,156::__init__::225::IOProcess::(_processLogs) (273676) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:50:37,156::__init__::225::IOProcess::(_processLogs) (273676) Building response >Thread-18::DEBUG::2014-07-08 16:50:37,156::__init__::225::IOProcess::(_processLogs) (273676) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:37,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:37,157::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:50:37,159::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:37,159::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:50:37,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:37,160::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:37,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:37,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:37,161::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:37,161::__init__::225::IOProcess::(_processLogs) (273677) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:37,162::__init__::225::IOProcess::(_processLogs) (273677) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:37,167::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(273677) Building response >Thread-18::DEBUG::2014-07-08 16:50:37,168::__init__::225::IOProcess::(_processLogs) (273677) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:37,168::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:50:37,168::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:50:37,169::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:37,170::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:50:37,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:37,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:37,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:37,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:37,171::__init__::225::IOProcess::(_processLogs) (273678) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:37,171::__init__::225::IOProcess::(_processLogs) (273678) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:37,172::__init__::225::IOProcess::(_processLogs) (273678) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:37,172::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:50:37,173::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:50:37,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:37,174::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:37,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:37,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 16:50:37,175::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:50:37,176::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 16:50:37,177::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c7954d2-67bb-4aa3-85fb-6f5d1dcec037`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:50:37,177::__init__::225::IOProcess::(_processLogs) (273679) Finding callback 'access'... >Thread-7082::DEBUG::2014-07-08 16:50:37,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c7954d2-67bb-4aa3-85fb-6f5d1dcec037`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:50:37,179::__init__::225::IOProcess::(_processLogs) (273679) Got request for method 'access' >Thread-7082::DEBUG::2014-07-08 16:50:37,180::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:50:37,181::__init__::225::IOProcess::(_processLogs) (273679) Building response >Thread-7082::DEBUG::2014-07-08 16:50:37,181::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:50:37,182::__init__::225::IOProcess::(_processLogs) (273679) Queuing response >Thread-7082::DEBUG::2014-07-08 16:50:37,183::task::993::Storage.TaskManager.Task::(_decref) Task=`4c7954d2-67bb-4aa3-85fb-6f5d1dcec037`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:50:37,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:37,185::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:50:37,201::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:50:37,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`19b061a9-2885-4fc9-8257-003338374ba9`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:50:37,203::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:50:37,203::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d9625ac2-09ad-44c8-aed6-4ff8ed7d04b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:50:37,204::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:50:37,204::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:50:37,204::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d9625ac2-09ad-44c8-aed6-4ff8ed7d04b9`::Granted request >Thread-7083::DEBUG::2014-07-08 16:50:37,205::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`19b061a9-2885-4fc9-8257-003338374ba9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:50:37,205::task::993::Storage.TaskManager.Task::(_decref) Task=`19b061a9-2885-4fc9-8257-003338374ba9`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:50:37,226::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:50:37,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`19b061a9-2885-4fc9-8257-003338374ba9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:50:37,229::task::595::Storage.TaskManager.Task::(_updateState) Task=`19b061a9-2885-4fc9-8257-003338374ba9`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:50:37,231::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:50:37,232::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:50:37,234::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:50:37,236::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:50:37,237::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:50:37,238::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:50:37,241::task::993::Storage.TaskManager.Task::(_decref) Task=`19b061a9-2885-4fc9-8257-003338374ba9`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:37,950::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:37,951::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:37,953::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:38,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:38,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0168204 s, 60.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:50:40,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:40,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0168922 s, 60.6 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:50:42,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`b44fee7e-1688-4f4e-beaf-0d4367db17bb`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:50:42,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:50:42,012::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0072214', 'lastCheck': '4.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:50:42,012::task::1191::Storage.TaskManager.Task::(prepare) Task=`b44fee7e-1688-4f4e-beaf-0d4367db17bb`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0072214', 'lastCheck': '4.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:50:42,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`b44fee7e-1688-4f4e-beaf-0d4367db17bb`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:50:42,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:50:42,013::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:50:42,013::task::993::Storage.TaskManager.Task::(_decref) Task=`b44fee7e-1688-4f4e-beaf-0d4367db17bb`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:50:42,069::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:42,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:42,985::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:42,995::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:43,007::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:43,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0547994 s, 18.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:50:43,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`154c7bf7-f27d-4fdd-9ba4-3f7fd61b5538`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:50:43,143::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:50:43,147::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:50:43,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:43,147::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:43,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:43,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:43,148::__init__::225::IOProcess::(_processLogs) (273680) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:50:43,149::__init__::225::IOProcess::(_processLogs) (273680) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:50:43,149::__init__::225::IOProcess::(_processLogs) (273680) Building response >Thread-18::DEBUG::2014-07-08 16:50:43,149::__init__::225::IOProcess::(_processLogs) (273680) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:43,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:43,150::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:50:43,151::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:50:43,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:43,152::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:43,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:43,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:43,153::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:43,153::__init__::225::IOProcess::(_processLogs) (273681) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:50:43,153::__init__::225::IOProcess::(_processLogs) (273681) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:50:43,153::__init__::225::IOProcess::(_processLogs) (273681) Building response >Thread-18::DEBUG::2014-07-08 16:50:43,154::__init__::225::IOProcess::(_processLogs) (273681) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:43,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:43,154::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:50:43,155::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:50:43,156::task::1191::Storage.TaskManager.Task::(prepare) Task=`154c7bf7-f27d-4fdd-9ba4-3f7fd61b5538`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:50:43,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`154c7bf7-f27d-4fdd-9ba4-3f7fd61b5538`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:50:43,156::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:50:43,157::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:50:43,157::task::993::Storage.TaskManager.Task::(_decref) Task=`154c7bf7-f27d-4fdd-9ba4-3f7fd61b5538`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:50:43,239::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:50:43,240::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >VM Channels Listener::DEBUG::2014-07-08 16:50:43,542::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:50:45,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:45,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195486 s, 52.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:50:47,190::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:47,191::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:47,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:47,191::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:47,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:47,192::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:47,192::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:47,193::__init__::225::IOProcess::(_processLogs) (273682) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:50:47,193::__init__::225::IOProcess::(_processLogs) (273682) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:50:47,193::__init__::225::IOProcess::(_processLogs) (273682) Building response >Thread-18::DEBUG::2014-07-08 16:50:47,193::__init__::225::IOProcess::(_processLogs) (273682) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:47,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:47,194::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:50:47,196::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:50:47,353::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000491671 s, 940 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:50:47,358::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:50:47,362::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:47,365::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:50:47,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:47,371::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 16:50:47,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`62aea898-c5a4-4fc7-94d1-ec085c1fe730`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:50:47,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:47,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 16:50:47,377::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:50:47,379::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:47,382::__init__::225::IOProcess::(_processLogs) (273683) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:50:47,384::__init__::225::IOProcess::(_processLogs) (273683) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:50:47,386::__init__::225::IOProcess::(_processLogs) DEBUG|(273683) Building response >Thread-7082::INFO::2014-07-08 16:50:51,132::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 16:50:51,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:50:47,387::__init__::225::IOProcess::(_processLogs) (273683) Queuing response >Thread-7082::DEBUG::2014-07-08 16:50:51,160::task::1191::Storage.TaskManager.Task::(prepare) Task=`62aea898-c5a4-4fc7-94d1-ec085c1fe730`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:51,474::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:50:51,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`62aea898-c5a4-4fc7-94d1-ec085c1fe730`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:50:51,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 16:50:51,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:50:51,505::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 16:50:51,513::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:50:51,529::task::993::Storage.TaskManager.Task::(_decref) Task=`62aea898-c5a4-4fc7-94d1-ec085c1fe730`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:51,550::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:50:51,676::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:51,697::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7083::DEBUG::2014-07-08 16:50:51,701::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:50:51,696::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 16:50:51,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5c3d6b5-e583-432f-b570-f5e597b847e3`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:50:51,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 16:50:51,728::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:50:51,736::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:51,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:50:51,757::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e22620b5-7048-49d2-83e8-fe5f83a68945`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:50:51,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:50:51,764::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:50:51,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:50:51,779::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:50:51,780::__init__::225::IOProcess::(_processLogs) (273684) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:50:51,788::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e22620b5-7048-49d2-83e8-fe5f83a68945`::Granted request >Thread-18::DEBUG::2014-07-08 16:50:51,791::__init__::225::IOProcess::(_processLogs) (273684) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:51,801::__init__::225::IOProcess::(_processLogs) (273684) Building response >Thread-7083::DEBUG::2014-07-08 16:50:51,811::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a5c3d6b5-e583-432f-b570-f5e597b847e3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:50:51,812::__init__::225::IOProcess::(_processLogs) (273684) Queuing response >Thread-7083::DEBUG::2014-07-08 16:50:51,818::task::993::Storage.TaskManager.Task::(_decref) Task=`a5c3d6b5-e583-432f-b570-f5e597b847e3`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:50:51,821::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:51,831::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:50:51,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.450659 s, 2.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:50:51,932::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:50:51,941::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:50:51,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:50:51,959::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:50:51,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:50:51,976::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:50:51,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:50:51,992::__init__::225::IOProcess::(_processLogs) (273685) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:51,997::__init__::225::IOProcess::(_processLogs) (273685) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:52,003::__init__::225::IOProcess::(_processLogs) (273685) Building response >Thread-18::DEBUG::2014-07-08 16:50:52,007::__init__::225::IOProcess::(_processLogs) (273685) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:52,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:52,009::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:50:52,014::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7083::INFO::2014-07-08 16:50:52,018::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:50:52,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5c3d6b5-e583-432f-b570-f5e597b847e3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:50:52,021::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:50:52,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5c3d6b5-e583-432f-b570-f5e597b847e3`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:50:52,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:50:52,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:50:52,032::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:50:52,035::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:50:52,038::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:50:52,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:50:52,043::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:50:52,046::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:50:52,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:50:52,049::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:50:52,053::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:50:52,057::task::993::Storage.TaskManager.Task::(_decref) Task=`a5c3d6b5-e583-432f-b570-f5e597b847e3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:50:52,058::__init__::225::IOProcess::(_processLogs) (273686) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:50:52,063::__init__::225::IOProcess::(_processLogs) (273686) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:50:52,068::__init__::225::IOProcess::(_processLogs) (273686) Building response >Thread-18::DEBUG::2014-07-08 16:50:52,072::__init__::225::IOProcess::(_processLogs) (273686) Queuing response >Thread-18::DEBUG::2014-07-08 16:50:52,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:50:52,079::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:50:54,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:54,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172009 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:50:56,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:56,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174012 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:56,739::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:56,745::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:50:56,754::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:50:58,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:50:59,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174342 s, 58.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:51:00,177::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:51:00,178::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7082::DEBUG::2014-07-08 16:51:00,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`76403ab6-d355-4b44-9c2d-080855b0bba3`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:51:00,599::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:51:00,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491671', 'lastCheck': '8.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:51:00,600::task::1191::Storage.TaskManager.Task::(prepare) Task=`76403ab6-d355-4b44-9c2d-080855b0bba3`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491671', 'lastCheck': '8.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:51:00,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`76403ab6-d355-4b44-9c2d-080855b0bba3`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:51:00,600::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:51:00,600::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:51:00,601::task::993::Storage.TaskManager.Task::(_decref) Task=`76403ab6-d355-4b44-9c2d-080855b0bba3`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:51:00,653::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:01,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:01,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178317 s, 57.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:01,848::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:01,850::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:01,851::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:51:02,089::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:02,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:02,092::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:02,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:02,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:02,101::__init__::225::IOProcess::(_processLogs) (273687) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:51:02,104::__init__::225::IOProcess::(_processLogs) (273687) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 16:51:02,104::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:51:02,111::__init__::225::IOProcess::(_processLogs) (273687) Building response >Thread-18::DEBUG::2014-07-08 16:51:02,117::__init__::225::IOProcess::(_processLogs) (273687) Queuing response >Thread-7082::DEBUG::2014-07-08 16:51:02,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`458631b3-e94f-4849-a36e-38d550a2af43`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:51:02,202::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::INFO::2014-07-08 16:51:02,205::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:51:02,206::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:51:02,210::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::INFO::2014-07-08 16:51:02,450::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:51:02,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000533853 s, 865 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:51:02,457::task::1191::Storage.TaskManager.Task::(prepare) Task=`458631b3-e94f-4849-a36e-38d550a2af43`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:51:02,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`458631b3-e94f-4849-a36e-38d550a2af43`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:51:02,471::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:02,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 16:51:02,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:51:02,478::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:02,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 16:51:02,483::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:51:02,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:02,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 16:51:02,491::task::993::Storage.TaskManager.Task::(_decref) Task=`458631b3-e94f-4849-a36e-38d550a2af43`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:51:02,492::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:51:02,498::__init__::225::IOProcess::(_processLogs) (273688) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:51:02,502::__init__::225::IOProcess::(_processLogs) (273688) Building response >Thread-18::DEBUG::2014-07-08 16:51:02,504::__init__::225::IOProcess::(_processLogs) (273688) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:02,506::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:02,507::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:51:02,519::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:51:02,520::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:02,524::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 16:51:02,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b2b00fd-2c87-4626-9139-ba9b82a4f171`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:51:02,526::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:51:02,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:02,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:02,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:51:02,532::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5a36305a-4c50-444f-8800-d9340ea0a77a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:51:02,534::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:51:02,534::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:51:02,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:51:02,536::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:51:02,539::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5a36305a-4c50-444f-8800-d9340ea0a77a`::Granted request >Thread-18::DEBUG::2014-07-08 16:51:02,540::__init__::225::IOProcess::(_processLogs) (273689) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:02,545::__init__::225::IOProcess::(_processLogs) (273689) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:51:02,546::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2b2b00fd-2c87-4626-9139-ba9b82a4f171`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:51:02,548::task::993::Storage.TaskManager.Task::(_decref) Task=`2b2b00fd-2c87-4626-9139-ba9b82a4f171`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:51:02,548::__init__::225::IOProcess::(_processLogs) (273689) Building response >Thread-18::DEBUG::2014-07-08 16:51:02,551::__init__::225::IOProcess::(_processLogs) (273689) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:02,552::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:02,554::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:51:02,560::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:02,564::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:51:02,570::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:02,573::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:02,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:02,583::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:02,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:02,588::__init__::225::IOProcess::(_processLogs) (273690) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:02,590::__init__::225::IOProcess::(_processLogs) (273690) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:02,597::__init__::225::IOProcess::(_processLogs) (273690) Building response >Thread-18::DEBUG::2014-07-08 16:51:02,599::__init__::225::IOProcess::(_processLogs) (273690) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:02,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::INFO::2014-07-08 16:51:02,605::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:51:02,605::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:51:02,608::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b2b00fd-2c87-4626-9139-ba9b82a4f171`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:51:02,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b2b00fd-2c87-4626-9139-ba9b82a4f171`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:51:02,614::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:51:02,618::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:51:02,619::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:02,622::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:51:02,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:51:02,625::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:51:02,628::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:02,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:51:02,631::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:51:02,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:51:02,634::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:51:02,635::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:51:02,637::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:51:02,638::__init__::225::IOProcess::(_processLogs) (273691) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:02,642::__init__::225::IOProcess::(_processLogs) (273691) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:02,644::__init__::225::IOProcess::(_processLogs) (273691) Building response >Thread-7083::DEBUG::2014-07-08 16:51:02,645::task::993::Storage.TaskManager.Task::(_decref) Task=`2b2b00fd-2c87-4626-9139-ba9b82a4f171`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:51:02,647::__init__::225::IOProcess::(_processLogs) (273691) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:02,650::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:51:02,652::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:51:03,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:03,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175903 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:51:05,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:05,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172266 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:06,853::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:06,855::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:06,856::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:07,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:08,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173652 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:51:10,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:10,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174037 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:11,863::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:11,865::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:11,866::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:12,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:51:12,664::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:12,666::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:12,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:12,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-6860::DEBUG::2014-07-08 16:51:12,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0227506 s, 45.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:51:12,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 16:51:12,743::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:51:12,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:12,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 16:51:12,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`f199858c-b0c9-4adb-82e6-9c85fb7094d9`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:51:12,759::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|(273692) Finding callback 'statvfs'... >Thread-7082::INFO::2014-07-08 16:51:12,761::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:51:12,764::__init__::225::IOProcess::(_processLogs) (273692) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:51:12,769::__init__::225::IOProcess::(_processLogs) (273692) Building response >Thread-18::DEBUG::2014-07-08 16:51:12,771::__init__::225::IOProcess::(_processLogs) (273692) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:12,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:12,776::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::INFO::2014-07-08 16:51:12,783::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:51:12,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`f199858c-b0c9-4adb-82e6-9c85fb7094d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:51:12,793::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:51:12,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`f199858c-b0c9-4adb-82e6-9c85fb7094d9`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:51:12,959::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:51:13,059::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-08 16:51:13,061::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00053106 s, 870 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:51:13,074::task::993::Storage.TaskManager.Task::(_decref) Task=`f199858c-b0c9-4adb-82e6-9c85fb7094d9`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:51:13,091::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:13,096::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:13,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:13,104::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:13,108::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:13,111::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:13,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:13,120::__init__::225::IOProcess::(_processLogs) (273693) Finding callback 'statvfs'... >Thread-7083::DEBUG::2014-07-08 16:51:13,129::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:51:13,128::__init__::225::IOProcess::(_processLogs) (273693) Got request for method 'statvfs' >Thread-7083::DEBUG::2014-07-08 16:51:13,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe9253a1-a931-4b8b-94d2-e2644a426df6`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:51:13,140::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:51:13,141::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|(273693) Building response >Thread-18::DEBUG::2014-07-08 16:51:13,234::__init__::225::IOProcess::(_processLogs) (273693) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:13,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:51:13,245::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6e561c85-8da4-4601-a2fc-8c720073486d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:51:13,250::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:51:13,250::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:51:13,267::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:51:13,274::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6e561c85-8da4-4601-a2fc-8c720073486d`::Granted request >Thread-18::DEBUG::2014-07-08 16:51:13,287::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:13,290::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:51:13,292::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:13,296::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:51:13,296::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fe9253a1-a931-4b8b-94d2-e2644a426df6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:51:13,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:13,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:51:13,306::task::993::Storage.TaskManager.Task::(_decref) Task=`fe9253a1-a931-4b8b-94d2-e2644a426df6`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:51:13,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:13,314::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|(273694) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:13,318::__init__::225::IOProcess::(_processLogs) (273694) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:13,327::__init__::225::IOProcess::(_processLogs) (273694) Building response >Thread-18::DEBUG::2014-07-08 16:51:13,331::__init__::225::IOProcess::(_processLogs) (273694) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:13,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:13,338::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:51:13,351::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:13,356::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:51:13,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:13,367::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:13,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:13,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:13,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:13,388::__init__::225::IOProcess::(_processLogs) (273695) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:13,394::__init__::225::IOProcess::(_processLogs) (273695) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:13,400::__init__::225::IOProcess::(_processLogs) (273695) Building response >Thread-18::DEBUG::2014-07-08 16:51:13,402::__init__::225::IOProcess::(_processLogs) (273695) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:13,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:13,404::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:51:13,418::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:51:13,423::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe9253a1-a931-4b8b-94d2-e2644a426df6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:51:13,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe9253a1-a931-4b8b-94d2-e2644a426df6`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:51:13,433::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:51:13,432::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:51:13,436::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:51:13,439::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:51:13,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:51:13,444::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:51:13,448::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:51:13,453::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:51:13,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:51:13,456::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:51:13,459::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:51:13,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:51:13,467::task::993::Storage.TaskManager.Task::(_decref) Task=`fe9253a1-a931-4b8b-94d2-e2644a426df6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:51:13,467::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:13,475::__init__::225::IOProcess::(_processLogs) (273696) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:13,480::__init__::225::IOProcess::(_processLogs) (273696) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:13,485::__init__::225::IOProcess::(_processLogs) (273696) Building response >Thread-18::DEBUG::2014-07-08 16:51:13,490::__init__::225::IOProcess::(_processLogs) (273696) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:13,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:13,496::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >VM Channels Listener::DEBUG::2014-07-08 16:51:13,644::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7086::DEBUG::2014-07-08 16:51:15,329::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:51:15,330::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:51:15,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:15,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172599 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:51:16,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f70701-52c3-4f6d-bf1e-b2b33c9d2be1`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:51:16,097::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:51:16,097::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053106', 'lastCheck': '2.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:51:16,097::task::1191::Storage.TaskManager.Task::(prepare) Task=`58f70701-52c3-4f6d-bf1e-b2b33c9d2be1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053106', 'lastCheck': '2.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:51:16,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f70701-52c3-4f6d-bf1e-b2b33c9d2be1`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:51:16,098::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:51:16,098::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:51:16,098::task::993::Storage.TaskManager.Task::(_decref) Task=`58f70701-52c3-4f6d-bf1e-b2b33c9d2be1`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:51:16,177::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:16,873::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:16,874::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:16,875::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:17,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:18,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174157 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:51:20,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:20,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174926 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:21,882::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:21,884::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:21,885::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:22,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:22,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351251 s, 29.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:51:23,504::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:51:23,508::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 16:51:23,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb22645c-eb6d-40a1-94b0-7981742db0fd`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:51:23,510::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 16:51:23,511::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:51:23,512::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:23,513::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:23,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:23,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:23,514::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:23,514::__init__::225::IOProcess::(_processLogs) (273697) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:51:23,517::__init__::225::IOProcess::(_processLogs) (273697) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:51:23,518::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|(273697) Building response >Thread-18::DEBUG::2014-07-08 16:51:23,518::__init__::225::IOProcess::(_processLogs) (273697) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:23,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:23,518::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:51:23,520::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::INFO::2014-07-08 16:51:23,671::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:51:23,681::task::1191::Storage.TaskManager.Task::(prepare) Task=`cb22645c-eb6d-40a1-94b0-7981742db0fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:51:23,683::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000984738 s, 469 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:51:23,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb22645c-eb6d-40a1-94b0-7981742db0fd`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:51:23,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:51:23,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:51:23,796::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 16:51:23,799::task::993::Storage.TaskManager.Task::(_decref) Task=`cb22645c-eb6d-40a1-94b0-7981742db0fd`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:51:23,800::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:23,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:23,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:23,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:23,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:23,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:23,817::__init__::225::IOProcess::(_processLogs) (273698) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:51:23,818::__init__::225::IOProcess::(_processLogs) (273698) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:51:23,819::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|(273698) Building response >Thread-18::DEBUG::2014-07-08 16:51:23,821::__init__::225::IOProcess::(_processLogs) (273698) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:23,821::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:51:23,825::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:51:23,825::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:51:23,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`5aa8c49a-c75d-45ee-ad6e-132a6d0a7a19`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:51:23,831::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:51:23,838::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f0f1ce38-9a95-4f75-8f6c-0797137a5e3d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:51:23,842::__init__::225::IOProcess::(_processLogs) (273688) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:51:23,842::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:51:23,847::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:51:23,849::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f0f1ce38-9a95-4f75-8f6c-0797137a5e3d`::Granted request >Thread-18::DEBUG::2014-07-08 16:51:23,848::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 16:51:23,853::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5aa8c49a-c75d-45ee-ad6e-132a6d0a7a19`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:51:23,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:51:23,857::task::993::Storage.TaskManager.Task::(_decref) Task=`5aa8c49a-c75d-45ee-ad6e-132a6d0a7a19`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:51:23,950::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:23,954::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:23,957::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:23,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:23,964::__init__::225::IOProcess::(_processLogs) (273699) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:23,970::__init__::225::IOProcess::(_processLogs) (273699) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:23,980::__init__::225::IOProcess::(_processLogs) (273699) Building response >Thread-18::DEBUG::2014-07-08 16:51:23,987::__init__::225::IOProcess::(_processLogs) (273699) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:23,992::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:23,996::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:51:24,013::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:24,014::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:51:24,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:24,017::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:24,017::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:24,018::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:24,022::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:24,024::__init__::225::IOProcess::(_processLogs) (273700) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:24,025::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273700) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:24,026::__init__::225::IOProcess::(_processLogs) (273700) Building response >Thread-18::DEBUG::2014-07-08 16:51:24,028::__init__::225::IOProcess::(_processLogs) (273700) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:24,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:24,030::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:51:24,037::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:51:24,041::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:51:24,043::task::1191::Storage.TaskManager.Task::(prepare) Task=`5aa8c49a-c75d-45ee-ad6e-132a6d0a7a19`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:51:24,046::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:51:24,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`5aa8c49a-c75d-45ee-ad6e-132a6d0a7a19`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:51:24,050::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:51:24,050::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:51:24,052::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:51:24,054::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:51:24,055::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:51:24,057::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:51:24,061::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:51:24,060::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:51:24,062::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:51:24,064::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:51:24,064::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:51:24,068::task::993::Storage.TaskManager.Task::(_decref) Task=`5aa8c49a-c75d-45ee-ad6e-132a6d0a7a19`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:51:24,069::__init__::225::IOProcess::(_processLogs) (273701) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:24,074::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273701) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:24,076::__init__::225::IOProcess::(_processLogs) (273701) Building response >Thread-18::DEBUG::2014-07-08 16:51:24,079::__init__::225::IOProcess::(_processLogs) (273701) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:24,082::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:24,085::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:51:24,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:24,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171923 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:26,892::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:26,894::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:26,895::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:26,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:27,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017387 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:51:29,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:29,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175638 s, 58.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:51:30,484::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:51:30,484::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7082::DEBUG::2014-07-08 16:51:31,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`17225b3b-39fd-4a15-a7cb-f83920aa401e`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:51:31,400::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:51:31,400::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000984738', 'lastCheck': '7.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:51:31,401::task::1191::Storage.TaskManager.Task::(prepare) Task=`17225b3b-39fd-4a15-a7cb-f83920aa401e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000984738', 'lastCheck': '7.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:51:31,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`17225b3b-39fd-4a15-a7cb-f83920aa401e`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:51:31,401::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:51:31,401::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:51:31,402::task::993::Storage.TaskManager.Task::(_decref) Task=`17225b3b-39fd-4a15-a7cb-f83920aa401e`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:51:31,445::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:31,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:31,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171512 s, 59.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:31,902::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:31,904::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:31,905::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:33,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:34,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017587 s, 58.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:51:34,090::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:34,091::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:34,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:34,091::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:34,092::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:34,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:34,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:34,092::__init__::225::IOProcess::(_processLogs) (273702) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:51:34,093::__init__::225::IOProcess::(_processLogs) (273702) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:51:34,093::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273702) Building response >Thread-18::DEBUG::2014-07-08 16:51:34,093::__init__::225::IOProcess::(_processLogs) (273702) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:34,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:34,094::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:51:34,096::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:51:34,255::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:51:34,257::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00058721 s, 787 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:51:34,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`6780ebd3-23ad-466e-a42e-9d7947c33139`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:51:34,267::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-7082::INFO::2014-07-08 16:51:34,270::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:51:34,271::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:34,274::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:34,276::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:34,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:34,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:34,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:34,285::__init__::225::IOProcess::(_processLogs) (273703) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:51:34,287::__init__::225::IOProcess::(_processLogs) (273703) Got request for method 'statvfs' >Thread-7082::INFO::2014-07-08 16:51:34,289::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:51:34,290::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273703) Building response >Thread-7082::DEBUG::2014-07-08 16:51:34,292::task::1191::Storage.TaskManager.Task::(prepare) Task=`6780ebd3-23ad-466e-a42e-9d7947c33139`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:51:34,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`6780ebd3-23ad-466e-a42e-9d7947c33139`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:51:34,294::__init__::225::IOProcess::(_processLogs) (273703) Queuing response >Thread-7082::DEBUG::2014-07-08 16:51:34,296::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:51:34,298::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:51:34,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:34,301::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 16:51:34,300::task::993::Storage.TaskManager.Task::(_decref) Task=`6780ebd3-23ad-466e-a42e-9d7947c33139`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:51:34,316::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:34,318::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:51:34,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:34,320::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:34,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:34,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:51:34,328::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:51:34,330::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:34,333::__init__::225::IOProcess::(_processLogs) (273704) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:51:34,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`134445f5-0bb1-4728-975b-5a0a482cef25`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:51:34,336::__init__::225::IOProcess::(_processLogs) (273704) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:34,339::__init__::225::IOProcess::(_processLogs) (273704) Building response >Thread-7083::INFO::2014-07-08 16:51:34,339::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:51:34,343::__init__::225::IOProcess::(_processLogs) (273704) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:34,347::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:34,351::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:51:34,351::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0bfb6c63-b34d-4411-ba03-20c6116e8034`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:51:34,356::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:51:34,362::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:51:34,366::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0bfb6c63-b34d-4411-ba03-20c6116e8034`::Granted request >Thread-18::DEBUG::2014-07-08 16:51:34,365::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:51:34,371::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:51:34,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:51:34,376::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`134445f5-0bb1-4728-975b-5a0a482cef25`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:51:34,379::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:51:34,380::task::993::Storage.TaskManager.Task::(_decref) Task=`134445f5-0bb1-4728-975b-5a0a482cef25`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:51:34,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:34,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:34,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:34,399::__init__::225::IOProcess::(_processLogs) (273705) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:34,403::__init__::225::IOProcess::(_processLogs) (273705) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:34,410::__init__::225::IOProcess::(_processLogs) (273705) Building response >Thread-18::DEBUG::2014-07-08 16:51:34,417::__init__::225::IOProcess::(_processLogs) (273705) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:34,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:34,430::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:51:34,445::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:51:34,448::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:34,451::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:34,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::INFO::2014-07-08 16:51:34,459::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:51:34,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:51:34,468::task::1191::Storage.TaskManager.Task::(prepare) Task=`134445f5-0bb1-4728-975b-5a0a482cef25`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:51:34,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:34,565::__init__::225::IOProcess::(_processLogs) (273706) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:51:34,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`134445f5-0bb1-4728-975b-5a0a482cef25`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:51:34,573::__init__::225::IOProcess::(_processLogs) (273706) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:51:34,575::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:51:34,578::__init__::225::IOProcess::(_processLogs) (273706) Building response >Thread-7083::DEBUG::2014-07-08 16:51:34,586::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:51:34,590::__init__::225::IOProcess::(_processLogs) (273706) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:34,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:34,607::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:51:34,606::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:51:34,621::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:51:34,627::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:51:34,629::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:51:34,633::task::993::Storage.TaskManager.Task::(_decref) Task=`134445f5-0bb1-4728-975b-5a0a482cef25`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:51:36,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:36,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0203205 s, 50.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:36,912::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:36,914::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:36,915::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:38,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:38,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173266 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:51:40,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:40,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174965 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:41,922::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:41,924::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:41,925::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:42,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:43,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03664 s, 27.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:51:44,034::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-18::DEBUG::2014-07-08 16:51:44,623::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:44,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:44,624::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:44,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:44,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:44,625::__init__::225::IOProcess::(_processLogs) (273707) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:51:44,625::__init__::225::IOProcess::(_processLogs) (273707) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:51:44,625::__init__::225::IOProcess::(_processLogs) (273707) Building response >Thread-18::DEBUG::2014-07-08 16:51:44,626::__init__::225::IOProcess::(_processLogs) (273707) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:44,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:44,626::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:51:44,628::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:51:44,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000500889 s, 922 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:51:44,777::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:44,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:44,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 16:51:44,782::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:51:44,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:44,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:44,786::__init__::225::IOProcess::(_processLogs) (273708) Finding callback 'statvfs'... >Thread-7082::DEBUG::2014-07-08 16:51:44,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce329af0-8185-4aec-9ad7-a42b124b49e8`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:51:44,788::__init__::225::IOProcess::(_processLogs) (273708) Got request for method 'statvfs' >Thread-7082::INFO::2014-07-08 16:51:44,788::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:51:44,789::__init__::225::IOProcess::(_processLogs) (273708) Building response >Thread-18::DEBUG::2014-07-08 16:51:44,791::__init__::225::IOProcess::(_processLogs) (273708) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:44,791::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:44,791::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:51:44,794::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:51:44,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:44,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:44,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:44,795::__init__::225::IOProcess::(_processLogs) (273709) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:44,796::__init__::225::IOProcess::(_processLogs) (273709) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:44,796::__init__::225::IOProcess::(_processLogs) (273709) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:44,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:44,797::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:51:44,801::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:51:44,802::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:44,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:44,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:44,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:44,805::__init__::225::IOProcess::(_processLogs) (273710) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:44,805::__init__::225::IOProcess::(_processLogs) (273710) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:44,806::__init__::225::IOProcess::(_processLogs) (273710) Queuing response >Thread-7082::INFO::2014-07-08 16:51:44,806::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:51:44,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 16:51:44,808::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce329af0-8185-4aec-9ad7-a42b124b49e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:51:44,809::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 16:51:44,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce329af0-8185-4aec-9ad7-a42b124b49e8`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:51:44,811::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:51:44,813::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:51:44,815::task::993::Storage.TaskManager.Task::(_decref) Task=`ce329af0-8185-4aec-9ad7-a42b124b49e8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:51:44,815::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:51:44,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:44,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:44,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:44,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:44,820::__init__::225::IOProcess::(_processLogs) (273711) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:44,820::__init__::225::IOProcess::(_processLogs) (273711) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:44,821::__init__::225::IOProcess::(_processLogs) (273711) Building response >Thread-18::DEBUG::2014-07-08 16:51:44,821::__init__::225::IOProcess::(_processLogs) (273711) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:44,821::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:44,821::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:51:44,830::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:51:44,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d57788d-12de-49f5-98ed-9c8c36f663bf`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:51:44,832::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:51:44,833::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`26b47481-45d5-4d7b-8fd3-211c30370e80`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:51:44,833::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:51:44,833::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:51:44,834::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`26b47481-45d5-4d7b-8fd3-211c30370e80`::Granted request >Thread-7083::DEBUG::2014-07-08 16:51:44,834::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9d57788d-12de-49f5-98ed-9c8c36f663bf`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:51:44,835::task::993::Storage.TaskManager.Task::(_decref) Task=`9d57788d-12de-49f5-98ed-9c8c36f663bf`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:51:44,856::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:51:44,857::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d57788d-12de-49f5-98ed-9c8c36f663bf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:51:44,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d57788d-12de-49f5-98ed-9c8c36f663bf`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:51:44,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:51:44,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:51:44,858::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:51:44,858::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:51:44,859::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:51:44,859::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:51:44,859::task::993::Storage.TaskManager.Task::(_decref) Task=`9d57788d-12de-49f5-98ed-9c8c36f663bf`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:51:45,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:45,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.134162 s, 7.6 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:51:45,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d0fb377-d105-484a-8687-20b15524f514`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:51:45,622::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:51:45,639::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:51:45,644::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:45,647::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:45,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:45,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:45,656::__init__::225::IOProcess::(_processLogs) (273712) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:51:45,658::__init__::225::IOProcess::(_processLogs) (273712) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:51:45,660::__init__::225::IOProcess::(_processLogs) (273712) Building response >Thread-18::DEBUG::2014-07-08 16:51:45,663::__init__::225::IOProcess::(_processLogs) (273712) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:45,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:45,666::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:51:45,682::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:51:45,686::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:45,692::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:45,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:45,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:45,701::__init__::225::IOProcess::(_processLogs) (273713) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:51:45,704::__init__::225::IOProcess::(_processLogs) (273713) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:51:45,706::__init__::225::IOProcess::(_processLogs) (273713) Building response >Thread-18::DEBUG::2014-07-08 16:51:45,709::__init__::225::IOProcess::(_processLogs) (273713) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:45,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:45,713::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:51:45,721::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:51:45,723::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d0fb377-d105-484a-8687-20b15524f514`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:51:45,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d0fb377-d105-484a-8687-20b15524f514`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:51:45,727::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:51:45,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:51:45,731::task::993::Storage.TaskManager.Task::(_decref) Task=`7d0fb377-d105-484a-8687-20b15524f514`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:51:45,818::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:51:45,818::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7082::DEBUG::2014-07-08 16:51:46,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`d20d74b5-2f7e-4268-9be2-420ab219b40c`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:51:46,818::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:51:46,818::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500889', 'lastCheck': '2.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:51:46,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`d20d74b5-2f7e-4268-9be2-420ab219b40c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500889', 'lastCheck': '2.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:51:46,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`d20d74b5-2f7e-4268-9be2-420ab219b40c`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:51:46,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:51:46,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:51:46,819::task::993::Storage.TaskManager.Task::(_decref) Task=`d20d74b5-2f7e-4268-9be2-420ab219b40c`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:51:46,925::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:46,931::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:46,932::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:46,934::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:47,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:47,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172694 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:51:50,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:50,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174942 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:51,937::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:51,939::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:51,940::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:52,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:52,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175389 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:51:54,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:54,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172174 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:51:54,825::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:54,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:54,825::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:54,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:54,826::__init__::225::IOProcess::(_processLogs) (273714) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:51:54,827::__init__::225::IOProcess::(_processLogs) (273714) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:51:54,827::__init__::225::IOProcess::(_processLogs) (273714) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:54,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:54,828::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:51:54,829::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:51:54,976::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:51:54,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c0391da-39c8-4ab3-8363-231739830ce2`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:51:54,978::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 16:51:54,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00429737 s, 108 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:51:54,982::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:51:54,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:54,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:54,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:54,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:54,983::__init__::225::IOProcess::(_processLogs) (273715) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:51:54,984::__init__::225::IOProcess::(_processLogs) (273715) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:51:54,984::__init__::225::IOProcess::(_processLogs) (273715) Building response >Thread-18::DEBUG::2014-07-08 16:51:54,984::__init__::225::IOProcess::(_processLogs) (273715) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:54,984::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:51:54,993::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:51:54,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:54,994::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::INFO::2014-07-08 16:51:54,995::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:51:54,995::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 16:51:54,997::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c0391da-39c8-4ab3-8363-231739830ce2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:51:54,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 16:51:54,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c0391da-39c8-4ab3-8363-231739830ce2`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:51:54,999::__init__::225::IOProcess::(_processLogs) (273716) Finding callback 'access'... >Thread-7082::DEBUG::2014-07-08 16:51:55,000::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:51:55,000::__init__::225::IOProcess::(_processLogs) (273716) Got request for method 'access' >Thread-7082::DEBUG::2014-07-08 16:51:55,001::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:51:55,002::__init__::225::IOProcess::(_processLogs) (273716) Building response >Thread-7082::DEBUG::2014-07-08 16:51:55,003::task::993::Storage.TaskManager.Task::(_decref) Task=`8c0391da-39c8-4ab3-8363-231739830ce2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:51:55,003::__init__::225::IOProcess::(_processLogs) (273716) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:55,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:55,007::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:51:55,009::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:51:55,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:51:55,009::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:55,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:55,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:55,010::__init__::225::IOProcess::(_processLogs) (273717) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:55,010::__init__::225::IOProcess::(_processLogs) (273717) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:55,011::__init__::225::IOProcess::(_processLogs) (273717) Building response >Thread-18::DEBUG::2014-07-08 16:51:55,011::__init__::225::IOProcess::(_processLogs) (273717) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:55,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:55,011::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:51:55,012::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:51:55,013::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:51:55,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:51:55,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:51:55,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:51:55,013::__init__::225::IOProcess::(_processLogs) (273718) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:51:55,014::__init__::225::IOProcess::(_processLogs) (273718) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:51:55,014::__init__::225::IOProcess::(_processLogs) (273718) Building response >Thread-18::DEBUG::2014-07-08 16:51:55,014::__init__::225::IOProcess::(_processLogs) (273718) Queuing response >Thread-18::DEBUG::2014-07-08 16:51:55,014::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:51:55,015::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:51:55,019::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:51:55,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`a99e7da3-9034-4830-9f02-7f54aacb4af6`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:51:55,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:51:55,021::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b9c49a55-e795-456b-b0ce-b3bf7ec50df0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:51:55,022::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:51:55,022::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:51:55,022::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b9c49a55-e795-456b-b0ce-b3bf7ec50df0`::Granted request >Thread-7083::DEBUG::2014-07-08 16:51:55,030::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a99e7da3-9034-4830-9f02-7f54aacb4af6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:51:55,030::task::993::Storage.TaskManager.Task::(_decref) Task=`a99e7da3-9034-4830-9f02-7f54aacb4af6`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:51:55,049::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:51:55,050::task::1191::Storage.TaskManager.Task::(prepare) Task=`a99e7da3-9034-4830-9f02-7f54aacb4af6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:51:55,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`a99e7da3-9034-4830-9f02-7f54aacb4af6`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:51:55,050::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:51:55,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:51:55,051::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:51:55,051::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:51:55,052::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:51:55,052::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:51:55,052::task::993::Storage.TaskManager.Task::(_decref) Task=`a99e7da3-9034-4830-9f02-7f54aacb4af6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:51:56,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:56,966::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:56,968::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:51:56,969::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:51:57,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174532 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:51:59,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:51:59,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265088 s, 38.6 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:52:00,941::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:52:00,941::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:52:01,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:01,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895493 s, 11.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:01,977::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:01,979::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:01,980::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:52:02,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cc619cb-8896-49ce-89f2-f6d65e37bfd2`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:52:02,383::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:52:02,383::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00429737', 'lastCheck': '7.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:52:02,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`9cc619cb-8896-49ce-89f2-f6d65e37bfd2`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00429737', 'lastCheck': '7.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:52:02,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cc619cb-8896-49ce-89f2-f6d65e37bfd2`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:52:02,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:52:02,384::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:52:02,385::task::993::Storage.TaskManager.Task::(_decref) Task=`9cc619cb-8896-49ce-89f2-f6d65e37bfd2`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:52:02,445::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:03,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:04,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017756 s, 57.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:52:05,020::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:52:05,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:05,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:05,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:05,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:05,026::__init__::225::IOProcess::(_processLogs) (273719) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:05,028::__init__::225::IOProcess::(_processLogs) (273719) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:05,029::__init__::225::IOProcess::(_processLogs) (273719) Building response >Thread-18::DEBUG::2014-07-08 16:52:05,030::__init__::225::IOProcess::(_processLogs) (273719) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:05,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:05,032::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:52:05,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:52:05,190::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:52:05,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ed27ca2-951a-48db-960f-28c31485211f`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:52:05,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 16:52:05,211::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0174169 s, 26.5 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:52:05,214::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:52:05,223::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:05,224::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:05,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:05,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:05,225::__init__::225::IOProcess::(_processLogs) (273720) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:05,225::__init__::225::IOProcess::(_processLogs) (273720) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:05,226::__init__::225::IOProcess::(_processLogs) (273720) Building response >Thread-18::DEBUG::2014-07-08 16:52:05,226::__init__::225::IOProcess::(_processLogs) (273720) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:05,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:05,227::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::INFO::2014-07-08 16:52:05,230::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:52:05,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ed27ca2-951a-48db-960f-28c31485211f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:52:05,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ed27ca2-951a-48db-960f-28c31485211f`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:52:05,239::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7082::DEBUG::2014-07-08 16:52:05,241::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:52:05,243::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:52:05,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 16:52:05,246::task::993::Storage.TaskManager.Task::(_decref) Task=`2ed27ca2-951a-48db-960f-28c31485211f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:52:05,246::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:05,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:05,253::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:05,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:05,257::__init__::225::IOProcess::(_processLogs) (273721) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:05,259::__init__::225::IOProcess::(_processLogs) (273721) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:05,260::__init__::225::IOProcess::(_processLogs) (273721) Building response >Thread-18::DEBUG::2014-07-08 16:52:05,262::__init__::225::IOProcess::(_processLogs) (273721) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:05,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:05,264::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:52:05,269::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:52:05,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:05,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:05,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:05,277::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:52:05,278::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:52:05,280::__init__::225::IOProcess::(_processLogs) (273722) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:05,283::__init__::225::IOProcess::(_processLogs) (273722) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:52:05,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf8ad169-f25e-4375-8c07-bbe11de7815e`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:52:05,286::__init__::225::IOProcess::(_processLogs) (273722) Building response >Thread-7083::INFO::2014-07-08 16:52:05,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:52:05,289::__init__::225::IOProcess::(_processLogs) (273722) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:05,293::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:05,296::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:52:05,296::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6a4d7d9d-2cb0-48fe-a984-438196f152c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:52:05,300::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:52:05,305::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:52:05,307::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:52:05,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:52:05,310::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6a4d7d9d-2cb0-48fe-a984-438196f152c8`::Granted request >Thread-18::DEBUG::2014-07-08 16:52:05,312::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:05,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:52:05,318::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bf8ad169-f25e-4375-8c07-bbe11de7815e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:52:05,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:52:05,320::task::993::Storage.TaskManager.Task::(_decref) Task=`bf8ad169-f25e-4375-8c07-bbe11de7815e`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:52:05,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:05,329::__init__::225::IOProcess::(_processLogs) (273723) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:05,333::__init__::225::IOProcess::(_processLogs) (273723) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:05,337::__init__::225::IOProcess::(_processLogs) (273723) Building response >Thread-18::DEBUG::2014-07-08 16:52:05,341::__init__::225::IOProcess::(_processLogs) (273723) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:05,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:05,349::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:52:05,376::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:52:05,378::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf8ad169-f25e-4375-8c07-bbe11de7815e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:52:05,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf8ad169-f25e-4375-8c07-bbe11de7815e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:52:05,380::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:52:05,381::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:52:05,383::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:52:05,385::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:52:05,386::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:52:05,387::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:52:05,389::task::993::Storage.TaskManager.Task::(_decref) Task=`bf8ad169-f25e-4375-8c07-bbe11de7815e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:52:06,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:06,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017178 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:06,990::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:06,993::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:06,994::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:08,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:08,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175275 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:52:10,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:10,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171794 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:12,002::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:12,003::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:12,004::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:12,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:13,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174596 s, 58.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:52:14,249::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:52:15,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:52:15,397::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Dummy-6860::DEBUG::2014-07-08 16:52:15,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182102 s, 56.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:52:15,420::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:52:15,428::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 16:52:15,429::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:52:15,432::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 16:52:15,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`65a2203b-b6b5-477b-842d-0b460378830a`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:52:15,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 16:52:15,440::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:52:15,442::__init__::225::IOProcess::(_processLogs) (273724) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:52:15,443::__init__::225::IOProcess::(_processLogs) (273724) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:52:15,444::__init__::225::IOProcess::(_processLogs) (273724) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,445::__init__::225::IOProcess::(_processLogs) (273724) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,446::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,447::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:52:15,451::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:52:15,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:15,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:15,456::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,457::__init__::225::IOProcess::(_processLogs) (273725) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:52:15,458::__init__::225::IOProcess::(_processLogs) (273725) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:52:15,459::__init__::225::IOProcess::(_processLogs) (273725) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,460::__init__::225::IOProcess::(_processLogs) (273725) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,461::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,462::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:52:15,465::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:52:15,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:15,468::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,469::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:15,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:15,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,472::__init__::225::IOProcess::(_processLogs) (273726) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:52:15,473::__init__::225::IOProcess::(_processLogs) (273726) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:52:15,474::__init__::225::IOProcess::(_processLogs) (273726) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,475::__init__::225::IOProcess::(_processLogs) (273726) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,476::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,477::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:52:15,480::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:15,484::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:52:15,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:15,491::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:15,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:15,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,503::__init__::225::IOProcess::(_processLogs) (273727) Finding callback 'glob'... >Thread-37::DEBUG::2014-07-08 16:52:15,505::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:52:15,506::__init__::225::IOProcess::(_processLogs) (273727) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:52:15,508::__init__::225::IOProcess::(_processLogs) (273727) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,510::__init__::225::IOProcess::(_processLogs) (273727) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,512::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:52:15,519::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:15,523::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:52:15,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:15,530::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:15,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:15,539::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,542::__init__::225::IOProcess::(_processLogs) (273728) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:52:15,546::__init__::225::IOProcess::(_processLogs) (273728) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:52:15,550::__init__::225::IOProcess::(_processLogs) (273728) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,553::__init__::225::IOProcess::(_processLogs) (273728) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,555::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,559::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:52:15,566::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:52:15,576::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:15,580::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:52:15,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:15,587::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:15,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:15,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,597::__init__::225::IOProcess::(_processLogs) (273729) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:52:15,598::__init__::225::IOProcess::(_processLogs) (273729) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:52:15,600::__init__::225::IOProcess::(_processLogs) DEBUG|(273729) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,601::__init__::225::IOProcess::(_processLogs) (273729) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,603::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:52:15,606::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:52:15,609::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:15,609::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:52:15,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:15,610::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,610::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:15,611::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:15,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,611::__init__::225::IOProcess::(_processLogs) (273730) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:15,612::__init__::225::IOProcess::(_processLogs) (273730) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:15,612::__init__::225::IOProcess::(_processLogs) (273730) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,613::__init__::225::IOProcess::(_processLogs) (273730) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,613::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:52:15,615::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:15,616::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 16:52:15,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:15,616::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:15,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:15,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,618::__init__::225::IOProcess::(_processLogs) (273731) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:52:15,618::__init__::225::IOProcess::(_processLogs) (273731) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:52:15,619::__init__::225::IOProcess::(_processLogs) (273731) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,619::__init__::225::IOProcess::(_processLogs) (273731) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,620::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:52:15,621::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:52:15,622::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:52:15,622::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:52:15,625::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:15,627::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 16:52:15,637::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:52:15,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 16:52:15,639::task::1191::Storage.TaskManager.Task::(prepare) Task=`65a2203b-b6b5-477b-842d-0b460378830a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:52:15,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`65a2203b-b6b5-477b-842d-0b460378830a`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:52:15,641::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 16:52:15,642::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:52:15,644::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:52:15,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 16:52:15,646::task::993::Storage.TaskManager.Task::(_decref) Task=`65a2203b-b6b5-477b-842d-0b460378830a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:52:15,648::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:15,652::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,654::__init__::225::IOProcess::(_processLogs) (273732) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:15,655::__init__::225::IOProcess::(_processLogs) (273732) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:15,656::__init__::225::IOProcess::(_processLogs) (273732) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,657::__init__::225::IOProcess::(_processLogs) (273732) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,658::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,659::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:52:15,667::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:52:15,668::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::DEBUG::2014-07-08 16:52:15,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc26530e-7558-4dde-94ab-a2197ba6e7d7`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:52:15,823::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 16:52:15,823::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000557598 s, 829 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:52:15,832::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:52:15,833::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d2c39bd8-8e6d-4652-99b1-a3e3cc172ec7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:52:15,835::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:52:15,835::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7083::DEBUG::2014-07-08 16:52:15,839::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:52:15,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:52:15,841::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d2c39bd8-8e6d-4652-99b1-a3e3cc172ec7`::Granted request >Thread-18::DEBUG::2014-07-08 16:52:15,843::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:52:15,848::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cc26530e-7558-4dde-94ab-a2197ba6e7d7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:52:15,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:52:15,850::task::993::Storage.TaskManager.Task::(_decref) Task=`cc26530e-7558-4dde-94ab-a2197ba6e7d7`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:52:15,853::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,856::__init__::225::IOProcess::(_processLogs) (273733) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:15,859::__init__::225::IOProcess::(_processLogs) (273733) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:15,862::__init__::225::IOProcess::(_processLogs) (273733) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,864::__init__::225::IOProcess::(_processLogs) (273733) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,866::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,868::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:52:15,884::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:15,888::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:52:15,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:15,898::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::INFO::2014-07-08 16:52:15,907::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:52:15,909::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:15,914::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:52:15,917::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc26530e-7558-4dde-94ab-a2197ba6e7d7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:52:15,918::__init__::225::IOProcess::(_processLogs) (273734) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:15,924::__init__::225::IOProcess::(_processLogs) (273734) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:52:15,924::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc26530e-7558-4dde-94ab-a2197ba6e7d7`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:52:15,930::__init__::225::IOProcess::(_processLogs) DEBUG|(273734) Building response >Thread-7083::DEBUG::2014-07-08 16:52:15,932::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:52:15,935::__init__::225::IOProcess::(_processLogs) (273734) Queuing response >Thread-7083::DEBUG::2014-07-08 16:52:15,937::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:52:15,939::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:52:15,943::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:52:15,943::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:52:15,947::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:52:15,952::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:52:15,955::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:52:15,956::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:15,963::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::DEBUG::2014-07-08 16:52:15,965::task::993::Storage.TaskManager.Task::(_decref) Task=`cc26530e-7558-4dde-94ab-a2197ba6e7d7`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:52:15,968::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:15,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:15,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:15,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:15,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:15,990::__init__::225::IOProcess::(_processLogs) (273735) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:15,993::__init__::225::IOProcess::(_processLogs) (273735) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:15,995::__init__::225::IOProcess::(_processLogs) (273735) Building response >Thread-18::DEBUG::2014-07-08 16:52:15,996::__init__::225::IOProcess::(_processLogs) (273735) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:15,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:15,999::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:52:16,006::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:16,008::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:52:16,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:16,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:16,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:16,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:16,016::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:16,016::__init__::225::IOProcess::(_processLogs) (273736) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:16,018::__init__::225::IOProcess::(_processLogs) (273736) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:16,019::__init__::225::IOProcess::(_processLogs) (273736) Building response >Thread-7086::DEBUG::2014-07-08 16:52:16,020::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 16:52:16,021::__init__::225::IOProcess::(_processLogs) (273736) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:16,024::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:16,032::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::ERROR::2014-07-08 16:52:16,024::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:17,011::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:17,013::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:17,014::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:52:17,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a8768b0-f522-49ec-82d6-004a7225508a`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:52:17,712::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:52:17,719::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557598', 'lastCheck': '1.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:52:17,721::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a8768b0-f522-49ec-82d6-004a7225508a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557598', 'lastCheck': '1.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:52:17,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a8768b0-f522-49ec-82d6-004a7225508a`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:52:17,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:52:17,725::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:52:17,727::task::993::Storage.TaskManager.Task::(_decref) Task=`2a8768b0-f522-49ec-82d6-004a7225508a`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:52:17,871::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:17,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:18,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171598 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:52:20,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:20,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178102 s, 57.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:22,018::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:22,020::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:22,021::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:22,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:22,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175378 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:52:24,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:25,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173557 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:52:26,004::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:52:26,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`341b4fbb-2dbc-43c8-bc3a-507435e5f6a4`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:52:26,006::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:52:26,021::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:52:26,021::task::1191::Storage.TaskManager.Task::(prepare) Task=`341b4fbb-2dbc-43c8-bc3a-507435e5f6a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:52:26,021::task::595::Storage.TaskManager.Task::(_updateState) Task=`341b4fbb-2dbc-43c8-bc3a-507435e5f6a4`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:52:26,022::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:52:26,022::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:52:26,022::task::993::Storage.TaskManager.Task::(_decref) Task=`341b4fbb-2dbc-43c8-bc3a-507435e5f6a4`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:52:26,036::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:52:26,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`894e6155-0aad-4fa3-bf15-730aaacb5c2a`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:52:26,037::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:52:26,038::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d6234cde-df5c-4b7b-bafb-255ae64079f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:52:26,038::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:52:26,041::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:52:26,042::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:52:26,043::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d6234cde-df5c-4b7b-bafb-255ae64079f4`::Granted request >Thread-18::DEBUG::2014-07-08 16:52:26,044::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:52:26,046::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:52:26,047::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`894e6155-0aad-4fa3-bf15-730aaacb5c2a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:52:26,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:52:26,048::task::993::Storage.TaskManager.Task::(_decref) Task=`894e6155-0aad-4fa3-bf15-730aaacb5c2a`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:52:26,050::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:26,051::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:26,053::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:26,054::__init__::225::IOProcess::(_processLogs) (273737) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:26,056::__init__::225::IOProcess::(_processLogs) (273737) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:26,057::__init__::225::IOProcess::(_processLogs) (273737) Building response >Thread-18::DEBUG::2014-07-08 16:52:26,059::__init__::225::IOProcess::(_processLogs) (273737) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:26,060::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:26,062::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:52:26,068::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:52:26,225::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000486083 s, 950 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:52:26,238::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:26,240::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:52:26,242::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:26,244::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:26,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:26,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::INFO::2014-07-08 16:52:26,250::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:52:26,253::task::1191::Storage.TaskManager.Task::(prepare) Task=`894e6155-0aad-4fa3-bf15-730aaacb5c2a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:52:26,253::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:26,256::__init__::225::IOProcess::(_processLogs) (273738) Finding callback 'statvfs'... >Thread-7083::DEBUG::2014-07-08 16:52:26,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`894e6155-0aad-4fa3-bf15-730aaacb5c2a`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:52:26,257::__init__::225::IOProcess::(_processLogs) (273738) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:26,259::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273738) Building response >Thread-18::DEBUG::2014-07-08 16:52:26,261::__init__::225::IOProcess::(_processLogs) (273738) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:26,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:52:26,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:52:26,264::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:52:26,267::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:52:26,273::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:52:26,276::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:52:26,277::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:52:26,279::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:52:26,283::task::993::Storage.TaskManager.Task::(_decref) Task=`894e6155-0aad-4fa3-bf15-730aaacb5c2a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:52:26,284::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:26,289::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:52:26,292::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:26,296::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:26,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:26,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:26,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:26,302::__init__::225::IOProcess::(_processLogs) (273739) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:26,304::__init__::225::IOProcess::(_processLogs) (273739) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:26,305::__init__::225::IOProcess::(_processLogs) (273739) Building response >Thread-18::DEBUG::2014-07-08 16:52:26,307::__init__::225::IOProcess::(_processLogs) (273739) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:26,308::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:26,310::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:52:26,316::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:26,317::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:52:26,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:26,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:26,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:26,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:26,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:26,326::__init__::225::IOProcess::(_processLogs) (273740) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:26,328::__init__::225::IOProcess::(_processLogs) (273740) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:26,329::__init__::225::IOProcess::(_processLogs) (273740) Building response >Thread-18::DEBUG::2014-07-08 16:52:26,331::__init__::225::IOProcess::(_processLogs) (273740) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:26,333::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:52:26,334::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:52:26,339::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:26,341::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:52:26,342::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:26,348::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:26,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:26,350::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:26,351::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:26,353::__init__::225::IOProcess::(_processLogs) (273741) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:26,354::__init__::225::IOProcess::(_processLogs) (273741) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:26,356::__init__::225::IOProcess::(_processLogs) (273741) Building response >Thread-18::DEBUG::2014-07-08 16:52:26,357::__init__::225::IOProcess::(_processLogs) (273741) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:26,358::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:26,360::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:27,028::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:27,029::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:27,030::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:27,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:27,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175694 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:52:29,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:29,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175124 s, 58.5 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:52:31,251::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:52:31,252::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:52:31,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:31,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175219 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:32,033::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:32,034::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:32,036::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:52:33,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`7bd2c324-0e8c-4f6b-8fd6-39905b9c9cc9`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:52:33,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:52:33,028::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486083', 'lastCheck': '6.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:52:33,028::task::1191::Storage.TaskManager.Task::(prepare) Task=`7bd2c324-0e8c-4f6b-8fd6-39905b9c9cc9`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486083', 'lastCheck': '6.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:52:33,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`7bd2c324-0e8c-4f6b-8fd6-39905b9c9cc9`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:52:33,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:52:33,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:52:33,029::task::993::Storage.TaskManager.Task::(_decref) Task=`7bd2c324-0e8c-4f6b-8fd6-39905b9c9cc9`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:52:33,096::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:33,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:34,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401203 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:52:36,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:52:36,353::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 16:52:36,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`16778a2f-f0ff-4ae6-8f71-1ac257b2ef42`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:52:36,369::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:52:36,375::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:36,376::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:52:36,377::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:36,377::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:36,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:36,378::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:36,378::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:36,378::__init__::225::IOProcess::(_processLogs) (273742) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:36,378::__init__::225::IOProcess::(_processLogs) (273742) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:36,379::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273742) Building response >Thread-18::DEBUG::2014-07-08 16:52:36,379::__init__::225::IOProcess::(_processLogs) (273742) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:36,379::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:36,379::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:52:36,383::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::INFO::2014-07-08 16:52:36,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:52:36,552::task::1191::Storage.TaskManager.Task::(prepare) Task=`16778a2f-f0ff-4ae6-8f71-1ac257b2ef42`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:52:36,557::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000540558 s, 855 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:52:36,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`16778a2f-f0ff-4ae6-8f71-1ac257b2ef42`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:52:36,567::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:52:36,569::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7087::DEBUG::2014-07-08 16:52:36,573::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:52:36,576::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 16:52:36,581::task::993::Storage.TaskManager.Task::(_decref) Task=`16778a2f-f0ff-4ae6-8f71-1ac257b2ef42`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:52:36,582::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:36,589::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:36,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:36,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:36,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:36,606::__init__::225::IOProcess::(_processLogs) (273743) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:36,612::__init__::225::IOProcess::(_processLogs) (273743) Got request for method 'statvfs' >Thread-7083::DEBUG::2014-07-08 16:52:36,616::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:52:36,620::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273743) Building response >Thread-18::DEBUG::2014-07-08 16:52:36,626::__init__::225::IOProcess::(_processLogs) (273743) Queuing response >Thread-7083::DEBUG::2014-07-08 16:52:36,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f4dca35-4ab4-4e3b-ac0d-6b71fe6673cc`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:52:36,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:36,634::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::INFO::2014-07-08 16:52:36,635::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Dummy-6860::DEBUG::2014-07-08 16:52:36,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.282599 s, 3.6 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 16:52:36,719::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6dd58148-12b5-427e-9db3-c8237f4f49b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:52:36,725::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:52:36,727::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:52:36,731::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:52:36,733::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 16:52:36,736::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6dd58148-12b5-427e-9db3-c8237f4f49b7`::Granted request >Thread-18::DEBUG::2014-07-08 16:52:36,739::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:36,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:52:36,749::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2f4dca35-4ab4-4e3b-ac0d-6b71fe6673cc`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:52:36,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:52:36,755::task::993::Storage.TaskManager.Task::(_decref) Task=`2f4dca35-4ab4-4e3b-ac0d-6b71fe6673cc`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:52:36,756::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:36,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:36,769::__init__::225::IOProcess::(_processLogs) (273744) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:36,774::__init__::225::IOProcess::(_processLogs) (273744) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:36,778::__init__::225::IOProcess::(_processLogs) (273744) Building response >Thread-18::DEBUG::2014-07-08 16:52:36,783::__init__::225::IOProcess::(_processLogs) (273744) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:36,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:36,793::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:52:36,814::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:36,819::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:52:36,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:36,828::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:36,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:36,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:36,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:36,837::__init__::225::IOProcess::(_processLogs) (273745) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:36,838::__init__::225::IOProcess::(_processLogs) (273745) Got request for method 'access' >Thread-7083::INFO::2014-07-08 16:52:36,844::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:52:36,846::__init__::225::IOProcess::(_processLogs) (273745) Building response >Thread-7083::DEBUG::2014-07-08 16:52:36,849::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f4dca35-4ab4-4e3b-ac0d-6b71fe6673cc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:52:36,852::__init__::225::IOProcess::(_processLogs) (273745) Queuing response >Thread-7083::DEBUG::2014-07-08 16:52:36,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f4dca35-4ab4-4e3b-ac0d-6b71fe6673cc`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:52:36,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:52:36,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:52:36,864::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:52:36,864::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:52:36,873::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:52:36,880::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:52:36,882::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:52:36,885::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:52:36,888::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:52:36,889::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:52:36,894::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:36,899::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:52:36,899::task::993::Storage.TaskManager.Task::(_decref) Task=`2f4dca35-4ab4-4e3b-ac0d-6b71fe6673cc`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:52:36,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:36,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:36,917::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:36,921::__init__::225::IOProcess::(_processLogs) (273746) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:36,926::__init__::225::IOProcess::(_processLogs) (273746) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:36,929::__init__::225::IOProcess::(_processLogs) (273746) Building response >Thread-18::DEBUG::2014-07-08 16:52:36,933::__init__::225::IOProcess::(_processLogs) (273746) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:36,936::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:36,939::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:37,044::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:37,052::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:37,058::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:39,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:39,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101635 s, 10.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:52:41,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:41,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172367 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:42,070::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:42,071::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:42,072::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:43,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:44,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172272 s, 59.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:52:44,572::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:52:46,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:46,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387101 s, 26.5 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:52:46,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f00db20-4a21-42db-99c6-047658e58dff`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:52:46,399::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:52:46,413::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:46,415::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:52:46,416::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:46,417::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:46,418::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:46,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:46,420::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:46,421::__init__::225::IOProcess::(_processLogs) (273747) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:52:46,422::__init__::225::IOProcess::(_processLogs) (273747) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:52:46,423::__init__::225::IOProcess::(_processLogs) (273747) Building response >Thread-18::DEBUG::2014-07-08 16:52:46,424::__init__::225::IOProcess::(_processLogs) (273747) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:46,425::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:46,426::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:52:46,432::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:46,433::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:52:46,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:46,434::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:46,434::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:46,434::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:46,435::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:46,435::__init__::225::IOProcess::(_processLogs) (273748) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:52:46,436::__init__::225::IOProcess::(_processLogs) (273748) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:52:46,436::__init__::225::IOProcess::(_processLogs) (273748) Building response >Thread-18::DEBUG::2014-07-08 16:52:46,436::__init__::225::IOProcess::(_processLogs) (273748) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:46,437::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:46,437::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:52:46,440::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:52:46,442::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f00db20-4a21-42db-99c6-047658e58dff`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:52:46,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f00db20-4a21-42db-99c6-047658e58dff`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:52:46,444::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:52:46,444::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:52:46,445::task::993::Storage.TaskManager.Task::(_decref) Task=`7f00db20-4a21-42db-99c6-047658e58dff`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:52:46,531::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:52:46,532::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 16:52:46,947::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:46,948::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:52:46,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:46,948::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:46,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:46,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:46,949::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:46,949::__init__::225::IOProcess::(_processLogs) (273749) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:46,949::__init__::225::IOProcess::(_processLogs) (273749) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:46,950::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273749) Building response >Thread-18::DEBUG::2014-07-08 16:52:46,950::__init__::225::IOProcess::(_processLogs) (273749) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:46,950::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:46,950::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:52:46,952::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:52:47,109::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:47,110::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:52:47,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`251c78b0-f393-4c72-9740-8c9f6e938342`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:52:47,116::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 16:52:47,118::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000767396 s, 602 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:52:47,122::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:47,125::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::INFO::2014-07-08 16:52:47,133::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:47,135::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:52:47,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::DEBUG::2014-07-08 16:52:47,140::task::1191::Storage.TaskManager.Task::(prepare) Task=`251c78b0-f393-4c72-9740-8c9f6e938342`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:52:47,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::DEBUG::2014-07-08 16:52:47,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`251c78b0-f393-4c72-9740-8c9f6e938342`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:52:47,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:52:47,148::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-7087::DEBUG::2014-07-08 16:52:47,152::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:52:47,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7087::DEBUG::2014-07-08 16:52:47,159::task::993::Storage.TaskManager.Task::(_decref) Task=`251c78b0-f393-4c72-9740-8c9f6e938342`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:47,159::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:52:47,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:47,171::__init__::225::IOProcess::(_processLogs) (273750) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:47,175::__init__::225::IOProcess::(_processLogs) (273750) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:47,177::__init__::225::IOProcess::(_processLogs) (273750) Building response >Thread-18::DEBUG::2014-07-08 16:52:47,178::__init__::225::IOProcess::(_processLogs) (273750) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:47,179::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:47,181::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:52:47,190::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:47,192::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:52:47,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:47,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:47,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:52:47,198::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:52:47,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:52:47,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`21e196d1-4333-4563-a5f5-cb51cfa11e71`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:52:47,203::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:52:47,204::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:52:47,207::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d8329da9-3c25-4216-8471-74ad815059e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:52:47,208::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:52:47,210::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:52:47,208::__init__::225::IOProcess::(_processLogs) (273751) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:52:47,212::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d8329da9-3c25-4216-8471-74ad815059e7`::Granted request >Thread-7083::DEBUG::2014-07-08 16:52:47,216::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`21e196d1-4333-4563-a5f5-cb51cfa11e71`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:52:47,215::__init__::225::IOProcess::(_processLogs) (273751) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:52:47,217::task::993::Storage.TaskManager.Task::(_decref) Task=`21e196d1-4333-4563-a5f5-cb51cfa11e71`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:52:47,221::__init__::225::IOProcess::(_processLogs) (273751) Building response >Thread-18::DEBUG::2014-07-08 16:52:47,224::__init__::225::IOProcess::(_processLogs) (273751) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:47,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:47,231::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:52:47,244::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:47,247::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:52:47,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:47,254::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:47,256::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:47,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:47,258::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:47,259::__init__::225::IOProcess::(_processLogs) (273752) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:47,260::__init__::225::IOProcess::(_processLogs) (273752) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:47,262::__init__::225::IOProcess::(_processLogs) (273752) Building response >Thread-18::DEBUG::2014-07-08 16:52:47,263::__init__::225::IOProcess::(_processLogs) (273752) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:47,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:47,266::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:52:47,269::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:52:47,273::task::1191::Storage.TaskManager.Task::(prepare) Task=`21e196d1-4333-4563-a5f5-cb51cfa11e71`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:52:47,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`21e196d1-4333-4563-a5f5-cb51cfa11e71`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:52:47,276::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:52:47,278::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:52:47,278::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:52:47,281::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:52:47,282::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:52:47,284::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:52:47,286::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:52:47,286::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:52:47,288::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:52:47,290::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:52:47,293::task::993::Storage.TaskManager.Task::(_decref) Task=`21e196d1-4333-4563-a5f5-cb51cfa11e71`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:52:47,295::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:47,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:47,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:47,306::__init__::225::IOProcess::(_processLogs) (273753) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:47,308::__init__::225::IOProcess::(_processLogs) (273753) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:47,309::__init__::225::IOProcess::(_processLogs) (273753) Building response >Thread-18::DEBUG::2014-07-08 16:52:47,311::__init__::225::IOProcess::(_processLogs) (273753) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:47,313::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:52:47,315::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:52:48,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:52:48,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ca82f98-bcf0-4461-822b-a9db4fb62c98`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:52:48,648::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:52:48,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000767396', 'lastCheck': '1.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:52:48,652::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ca82f98-bcf0-4461-822b-a9db4fb62c98`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000767396', 'lastCheck': '1.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:52:48,653::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ca82f98-bcf0-4461-822b-a9db4fb62c98`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:52:48,654::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:52:48,655::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:52:48,656::task::993::Storage.TaskManager.Task::(_decref) Task=`9ca82f98-bcf0-4461-822b-a9db4fb62c98`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:52:48,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499601 s, 20.5 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:52:48,802::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:50,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:51,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173543 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:52,180::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:52,181::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:52,182::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:52:53,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:53,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174867 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:52:55,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:52:55,366::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [69045307] >Thread-7087::DEBUG::2014-07-08 16:52:55,369::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call setupNetworks with ({'net5': {'nic': 'eth3', 'vlan': '5', 'ipaddr': '1.1.1.1', 'mtu': '1500', 'netmask': '255.255.255.0', 'STP': 'no', 'bridged': 'true'}}, {}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [69045307] >Thread-7082::DEBUG::2014-07-08 16:52:55,620::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-6860::DEBUG::2014-07-08 16:52:55,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107332 s, 9.5 MB/s\n'; <rc> = 0 >Thread-7087::ERROR::2014-07-08 16:52:55,893::API::1448::vds::(_rollback) bridge net5 has interfaces set(['vnet1']) connected >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1446, in _rollback > yield rollbackCtx > File "/usr/share/vdsm/API.py", line 1334, in setupNetworks > supervdsm.getProxy().setupNetworks(networks, bondings, options) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in setupNetworks > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >ConfigNetworkError: (28, "bridge net5 has interfaces set(['vnet1']) connected") >Thread-7087::DEBUG::2014-07-08 16:52:55,913::BindingXMLRPC::1114::vds::(wrapper) return setupNetworks with {'status': {'message': "bridge net5 has interfaces set(['vnet1']) connected", 'code': 28}} >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:57,188::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:57,190::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:52:57,192::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:52:57,320::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:57,321::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:52:57,321::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:57,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:57,321::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:57,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:57,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:57,322::__init__::225::IOProcess::(_processLogs) (273754) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:52:57,322::__init__::225::IOProcess::(_processLogs) (273754) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:52:57,323::__init__::225::IOProcess::(_processLogs) (273754) Building response >Thread-18::DEBUG::2014-07-08 16:52:57,323::__init__::225::IOProcess::(_processLogs) (273754) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:57,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:57,323::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:52:57,325::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:52:57,476::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:52:57,483::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000797287 s, 579 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:52:57,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`9021c06b-be54-4a58-95da-facd62e38230`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:52:57,494::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7087::INFO::2014-07-08 16:52:57,495::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:52:57,497::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:52:57,499::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:57,500::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:57,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:57,501::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:57,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::INFO::2014-07-08 16:52:57,517::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:52:57,519::__init__::225::IOProcess::(_processLogs) (273755) Finding callback 'statvfs'... >Thread-7087::DEBUG::2014-07-08 16:52:57,521::task::1191::Storage.TaskManager.Task::(prepare) Task=`9021c06b-be54-4a58-95da-facd62e38230`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:52:57,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`9021c06b-be54-4a58-95da-facd62e38230`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:52:57,523::__init__::225::IOProcess::(_processLogs) (273755) Got request for method 'statvfs' >Thread-7087::DEBUG::2014-07-08 16:52:57,526::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:52:57,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:52:57,529::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273755) Building response >Thread-7087::DEBUG::2014-07-08 16:52:57,531::task::993::Storage.TaskManager.Task::(_decref) Task=`9021c06b-be54-4a58-95da-facd62e38230`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:52:57,533::__init__::225::IOProcess::(_processLogs) (273755) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:57,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:57,539::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:52:57,550::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:57,551::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:52:57,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:57,556::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:57,558::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:57,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:57,563::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:52:57,561::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:52:57,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`07965091-96e0-4f7d-b399-63fbb6dc7f8e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:52:57,570::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:52:57,568::__init__::225::IOProcess::(_processLogs) (273756) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:52:57,574::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b51afbc3-e037-4650-a223-d70410b71ab9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:52:57,576::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:52:57,577::__init__::225::IOProcess::(_processLogs) (273756) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:52:57,579::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:52:57,582::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b51afbc3-e037-4650-a223-d70410b71ab9`::Granted request >Thread-18::DEBUG::2014-07-08 16:52:57,584::__init__::225::IOProcess::(_processLogs) (273756) Building response >Thread-7083::DEBUG::2014-07-08 16:52:57,586::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`07965091-96e0-4f7d-b399-63fbb6dc7f8e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:52:57,588::task::993::Storage.TaskManager.Task::(_decref) Task=`07965091-96e0-4f7d-b399-63fbb6dc7f8e`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:52:57,591::__init__::225::IOProcess::(_processLogs) (273756) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:57,597::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:57,606::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:52:57,625::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:57,627::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:52:57,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:57,638::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-7083::INFO::2014-07-08 16:52:57,645::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:52:57,649::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:52:57,650::task::1191::Storage.TaskManager.Task::(prepare) Task=`07965091-96e0-4f7d-b399-63fbb6dc7f8e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:52:57,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`07965091-96e0-4f7d-b399-63fbb6dc7f8e`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:52:57,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:52:57,654::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:52:57,656::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:52:57,656::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:52:57,660::__init__::225::IOProcess::(_processLogs) (273757) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:52:57,662::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:52:57,663::__init__::225::IOProcess::(_processLogs) (273757) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:52:57,665::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:52:57,667::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:52:57,666::__init__::225::IOProcess::(_processLogs) (273757) Building response >Thread-7083::DEBUG::2014-07-08 16:52:57,669::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:52:57,670::__init__::225::IOProcess::(_processLogs) (273757) Queuing response >Thread-7083::DEBUG::2014-07-08 16:52:57,675::task::993::Storage.TaskManager.Task::(_decref) Task=`07965091-96e0-4f7d-b399-63fbb6dc7f8e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:52:57,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:57,678::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:52:57,688::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:52:57,690::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:52:57,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:52:57,694::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:52:57,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:52:57,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:52:57,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:52:57,699::__init__::225::IOProcess::(_processLogs) (273758) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:52:57,700::__init__::225::IOProcess::(_processLogs) (273758) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:52:57,702::__init__::225::IOProcess::(_processLogs) (273758) Building response >Thread-18::DEBUG::2014-07-08 16:52:57,703::__init__::225::IOProcess::(_processLogs) (273758) Queuing response >Thread-18::DEBUG::2014-07-08 16:52:57,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:52:57,706::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:52:57,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:52:58,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483541 s, 21.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:53:00,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:00,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017375 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:53:01,671::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:53:01,672::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:02,199::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:02,200::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:02,202::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:02,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:02,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180583 s, 56.7 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:53:04,102::task::595::Storage.TaskManager.Task::(_updateState) Task=`4360dbce-ce8d-4fed-b63d-656b27b40c20`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:53:04,102::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:53:04,103::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797287', 'lastCheck': '6.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:53:04,103::task::1191::Storage.TaskManager.Task::(prepare) Task=`4360dbce-ce8d-4fed-b63d-656b27b40c20`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797287', 'lastCheck': '6.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:53:04,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`4360dbce-ce8d-4fed-b63d-656b27b40c20`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:53:04,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:53:04,104::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:53:04,104::task::993::Storage.TaskManager.Task::(_decref) Task=`4360dbce-ce8d-4fed-b63d-656b27b40c20`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:53:04,179::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:04,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:04,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0794466 s, 12.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:53:07,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:07,293::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:07,295::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:07,296::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:07,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205856 s, 49.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:53:07,711::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:07,711::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:53:07,711::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:07,712::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-7087::DEBUG::2014-07-08 16:53:07,714::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:53:07,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::DEBUG::2014-07-08 16:53:07,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`11f435ef-e561-4b50-a076-bea3f4f541f8`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:07,717::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7087::INFO::2014-07-08 16:53:07,719::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:07,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:07,720::__init__::225::IOProcess::(_processLogs) (273759) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:07,720::__init__::225::IOProcess::(_processLogs) (273759) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:07,721::__init__::225::IOProcess::(_processLogs) (273759) Building response >Thread-18::DEBUG::2014-07-08 16:53:07,721::__init__::225::IOProcess::(_processLogs) (273759) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:07,721::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:07,721::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:53:07,726::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::INFO::2014-07-08 16:53:07,873::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:53:07,877::task::1191::Storage.TaskManager.Task::(prepare) Task=`11f435ef-e561-4b50-a076-bea3f4f541f8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:53:07,878::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000550895 s, 839 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:53:07,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`11f435ef-e561-4b50-a076-bea3f4f541f8`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:53:07,881::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:07,882::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:53:07,882::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:07,882::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:07,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:07,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:07,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:07,884::__init__::225::IOProcess::(_processLogs) (273760) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:07,884::__init__::225::IOProcess::(_processLogs) (273760) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:07,885::__init__::225::IOProcess::(_processLogs) (273760) Building response >Thread-18::DEBUG::2014-07-08 16:53:07,885::__init__::225::IOProcess::(_processLogs) (273760) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:07,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:07,886::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::DEBUG::2014-07-08 16:53:07,880::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:53:07,890::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:07,890::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:53:07,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:07,891::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:07,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:07,892::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:07,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:07,892::__init__::225::IOProcess::(_processLogs) (273761) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:07,893::__init__::225::IOProcess::(_processLogs) (273761) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:07,893::__init__::225::IOProcess::(_processLogs) (273761) Building response >Thread-18::DEBUG::2014-07-08 16:53:07,894::__init__::225::IOProcess::(_processLogs) (273761) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:07,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:07,894::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 16:53:07,895::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:53:07,897::task::993::Storage.TaskManager.Task::(_decref) Task=`11f435ef-e561-4b50-a076-bea3f4f541f8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:53:07,899::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:07,899::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:53:07,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:07,900::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:07,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:07,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:07,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:07,901::__init__::225::IOProcess::(_processLogs) (273762) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:07,901::__init__::225::IOProcess::(_processLogs) (273762) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:07,901::__init__::225::IOProcess::(_processLogs) (273762) Building response >Thread-18::DEBUG::2014-07-08 16:53:07,901::__init__::225::IOProcess::(_processLogs) (273762) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:07,902::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:07,902::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:53:07,903::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:07,903::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:53:07,904::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:07,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:07,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:07,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:07,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:07,905::__init__::225::IOProcess::(_processLogs) (273763) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:07,905::__init__::225::IOProcess::(_processLogs) (273763) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:07,905::__init__::225::IOProcess::(_processLogs) (273763) Building response >Thread-18::DEBUG::2014-07-08 16:53:07,905::__init__::225::IOProcess::(_processLogs) (273763) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:07,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:07,906::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:53:07,921::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:53:07,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`956a9c52-8e54-4826-9ad4-37dc5f540b6c`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:53:07,922::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:53:07,923::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`52b2d631-c92a-437e-a9be-fef62ab15c10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:53:07,924::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:53:07,924::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:53:07,924::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`52b2d631-c92a-437e-a9be-fef62ab15c10`::Granted request >Thread-7083::DEBUG::2014-07-08 16:53:07,925::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`956a9c52-8e54-4826-9ad4-37dc5f540b6c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:53:07,925::task::993::Storage.TaskManager.Task::(_decref) Task=`956a9c52-8e54-4826-9ad4-37dc5f540b6c`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:53:07,944::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:07,945::task::1191::Storage.TaskManager.Task::(prepare) Task=`956a9c52-8e54-4826-9ad4-37dc5f540b6c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:07,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`956a9c52-8e54-4826-9ad4-37dc5f540b6c`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:53:07,945::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:53:07,946::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:53:07,946::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:53:07,946::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:53:07,947::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:53:07,947::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:53:07,947::task::993::Storage.TaskManager.Task::(_decref) Task=`956a9c52-8e54-4826-9ad4-37dc5f540b6c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:53:09,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:09,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174498 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:53:11,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:11,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185242 s, 55.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:12,304::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:12,305::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:12,306::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:13,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:14,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172596 s, 59.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:53:14,887::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:53:16,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:16,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254314 s, 40.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:53:16,784::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:53:16,785::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:17,314::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:17,316::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:17,317::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:53:17,909::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:17,909::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:53:17,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:17,910::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:17,910::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:17,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:17,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:17,911::__init__::225::IOProcess::(_processLogs) (273764) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:17,911::__init__::225::IOProcess::(_processLogs) (273764) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:17,911::__init__::225::IOProcess::(_processLogs) (273764) Building response >Thread-18::DEBUG::2014-07-08 16:53:17,912::__init__::225::IOProcess::(_processLogs) (273764) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:17,912::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:17,912::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:53:17,914::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:53:18,068::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000526869 s, 877 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:53:18,068::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:53:18,073::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:18,075::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 16:53:18,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`668c8a0a-8394-4ff0-8a1e-34b2ff88a423`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:18,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:18,078::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::INFO::2014-07-08 16:53:18,077::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:18,079::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:18,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:18,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:18,080::__init__::225::IOProcess::(_processLogs) (273765) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:18,080::__init__::225::IOProcess::(_processLogs) (273765) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:18,081::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273765) Building response >Thread-18::DEBUG::2014-07-08 16:53:18,081::__init__::225::IOProcess::(_processLogs) (273765) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:18,081::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:18,082::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:53:18,086::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:18,086::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:53:18,086::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:18,087::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:18,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:18,087::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:18,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:18,088::__init__::225::IOProcess::(_processLogs) (273766) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:18,089::__init__::225::IOProcess::(_processLogs) (273766) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:18,089::__init__::225::IOProcess::(_processLogs) (273766) Building response >Thread-18::DEBUG::2014-07-08 16:53:18,090::__init__::225::IOProcess::(_processLogs) (273766) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:18,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:18,090::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:53:18,093::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-7087::INFO::2014-07-08 16:53:18,094::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:53:18,095::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:53:18,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:18,096::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-7087::DEBUG::2014-07-08 16:53:18,095::task::1191::Storage.TaskManager.Task::(prepare) Task=`668c8a0a-8394-4ff0-8a1e-34b2ff88a423`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:53:18,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::DEBUG::2014-07-08 16:53:18,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`668c8a0a-8394-4ff0-8a1e-34b2ff88a423`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:53:18,099::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:53:18,101::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:53:18,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7087::DEBUG::2014-07-08 16:53:18,104::task::993::Storage.TaskManager.Task::(_decref) Task=`668c8a0a-8394-4ff0-8a1e-34b2ff88a423`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:53:18,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:18,112::__init__::225::IOProcess::(_processLogs) (273767) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:18,114::__init__::225::IOProcess::(_processLogs) (273767) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:18,116::__init__::225::IOProcess::(_processLogs) (273767) Building response >Thread-18::DEBUG::2014-07-08 16:53:18,117::__init__::225::IOProcess::(_processLogs) (273767) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:18,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:18,120::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:53:18,128::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:53:18,128::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:18,132::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:53:18,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d9f17d2-98c1-471e-8229-880e72da70ce`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:18,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 16:53:18,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:18,139::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:18,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:18,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:53:18,148::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`383e5aa4-aec6-4098-98b0-4b7c46703788`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:53:18,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:53:18,151::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:53:18,153::__init__::225::IOProcess::(_processLogs) (273768) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:18,156::__init__::225::IOProcess::(_processLogs) (273768) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:53:18,157::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:53:18,160::__init__::225::IOProcess::(_processLogs) (273768) Building response >Thread-7083::DEBUG::2014-07-08 16:53:18,161::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`383e5aa4-aec6-4098-98b0-4b7c46703788`::Granted request >Thread-18::DEBUG::2014-07-08 16:53:18,164::__init__::225::IOProcess::(_processLogs) (273768) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:18,168::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:53:18,169::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1d9f17d2-98c1-471e-8229-880e72da70ce`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:53:18,170::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:53:18,172::task::993::Storage.TaskManager.Task::(_decref) Task=`1d9f17d2-98c1-471e-8229-880e72da70ce`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:53:18,223::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:18,225::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d9f17d2-98c1-471e-8229-880e72da70ce`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:18,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d9f17d2-98c1-471e-8229-880e72da70ce`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:53:18,227::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:53:18,228::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:53:18,230::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:53:18,232::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:53:18,232::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:53:18,233::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:53:18,236::task::993::Storage.TaskManager.Task::(_decref) Task=`1d9f17d2-98c1-471e-8229-880e72da70ce`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:53:18,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:18,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182628 s, 56.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:53:19,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`a155d56f-372d-4230-9777-b50eba0fba85`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:53:19,445::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:53:19,446::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526869', 'lastCheck': '1.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:53:19,446::task::1191::Storage.TaskManager.Task::(prepare) Task=`a155d56f-372d-4230-9777-b50eba0fba85`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526869', 'lastCheck': '1.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:53:19,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`a155d56f-372d-4230-9777-b50eba0fba85`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:53:19,446::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:53:19,447::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:53:19,447::task::993::Storage.TaskManager.Task::(_decref) Task=`a155d56f-372d-4230-9777-b50eba0fba85`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:53:19,501::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:20,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:21,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174515 s, 58.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:22,329::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:22,331::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:22,333::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:23,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:23,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370837 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:53:25,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:25,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175401 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:27,340::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:27,341::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:27,342::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:27,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:27,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106652 s, 9.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:53:28,181::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:28,181::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:53:28,182::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:28,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:28,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:28,183::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:28,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:28,183::__init__::225::IOProcess::(_processLogs) (273769) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:28,183::__init__::225::IOProcess::(_processLogs) (273769) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:28,183::__init__::225::IOProcess::(_processLogs) (273769) Building response >Thread-18::DEBUG::2014-07-08 16:53:28,184::__init__::225::IOProcess::(_processLogs) (273769) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:28,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:28,184::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:53:28,186::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:53:28,341::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:53:28,342::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000422947 s, 1.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:53:28,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cf255e3-c18f-407f-be2b-070ec29558bc`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:28,353::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-7087::INFO::2014-07-08 16:53:28,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:28,357::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:53:28,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:28,365::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:28,367::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:28,368::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:28,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:28,369::__init__::225::IOProcess::(_processLogs) (273770) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:28,370::__init__::225::IOProcess::(_processLogs) (273770) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:28,370::__init__::225::IOProcess::(_processLogs) (273770) Building response >Thread-18::DEBUG::2014-07-08 16:53:28,371::__init__::225::IOProcess::(_processLogs) (273770) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:28,371::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:28,371::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::INFO::2014-07-08 16:53:28,376::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:53:28,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`4cf255e3-c18f-407f-be2b-070ec29558bc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:53:28,381::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-7087::DEBUG::2014-07-08 16:53:28,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cf255e3-c18f-407f-be2b-070ec29558bc`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:53:28,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:53:28,384::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7087::DEBUG::2014-07-08 16:53:28,386::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:53:28,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::DEBUG::2014-07-08 16:53:28,389::task::993::Storage.TaskManager.Task::(_decref) Task=`4cf255e3-c18f-407f-be2b-070ec29558bc`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:53:28,390::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:28,393::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:28,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:28,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:28,401::__init__::225::IOProcess::(_processLogs) (273771) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:28,403::__init__::225::IOProcess::(_processLogs) (273771) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:28,404::__init__::225::IOProcess::(_processLogs) (273771) Building response >Thread-18::DEBUG::2014-07-08 16:53:28,405::__init__::225::IOProcess::(_processLogs) (273771) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:28,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:28,408::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:53:28,417::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:53:28,418::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:53:28,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd70833e-f48b-4f38-8539-f45fac60a0b4`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:28,424::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:53:28,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 16:53:28,427::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:28,431::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:28,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:28,437::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:53:28,439::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0aa41d08-b414-4f61-95f9-10a081105c54`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:53:28,440::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:53:28,442::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:53:28,443::__init__::225::IOProcess::(_processLogs) (273772) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:28,447::__init__::225::IOProcess::(_processLogs) (273772) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:53:28,447::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:53:28,451::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0aa41d08-b414-4f61-95f9-10a081105c54`::Granted request >Thread-18::DEBUG::2014-07-08 16:53:28,451::__init__::225::IOProcess::(_processLogs) (273772) Building response >Thread-18::DEBUG::2014-07-08 16:53:28,454::__init__::225::IOProcess::(_processLogs) (273772) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:28,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:53:28,458::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bd70833e-f48b-4f38-8539-f45fac60a0b4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:53:28,461::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:53:28,461::task::993::Storage.TaskManager.Task::(_decref) Task=`bd70833e-f48b-4f38-8539-f45fac60a0b4`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:53:28,471::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:28,475::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:53:28,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:28,479::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:28,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:28,487::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:28,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:28,494::__init__::225::IOProcess::(_processLogs) (273773) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:28,497::__init__::225::IOProcess::(_processLogs) (273773) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:28,499::__init__::225::IOProcess::(_processLogs) (273773) Building response >Thread-18::DEBUG::2014-07-08 16:53:28,502::__init__::225::IOProcess::(_processLogs) (273773) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:28,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:28,508::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:53:28,518::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:28,519::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd70833e-f48b-4f38-8539-f45fac60a0b4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:28,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd70833e-f48b-4f38-8539-f45fac60a0b4`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:53:28,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:53:28,523::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:53:28,525::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:53:28,528::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:53:28,529::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:53:28,530::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:53:28,533::task::993::Storage.TaskManager.Task::(_decref) Task=`bd70833e-f48b-4f38-8539-f45fac60a0b4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:53:30,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:30,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172822 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:53:31,816::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:53:31,817::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:53:32,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:32,431::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:32,433::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:32,437::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:32,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0220883 s, 46.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:53:34,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:53:34,707::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9902791-856a-49bb-8f0a-28e956c667e2`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:53:34,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:53:34,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422947', 'lastCheck': '6.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:53:34,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9902791-856a-49bb-8f0a-28e956c667e2`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422947', 'lastCheck': '6.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:53:34,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9902791-856a-49bb-8f0a-28e956c667e2`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:53:34,721::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:53:34,723::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:53:34,725::task::993::Storage.TaskManager.Task::(_decref) Task=`d9902791-856a-49bb-8f0a-28e956c667e2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:53:34,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.076236 s, 13.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:53:34,897::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:53:36,901::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotunplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [57f37c49] >Thread-7087::DEBUG::2014-07-08 16:53:36,908::vm::3564::vm.Vm::(hotunplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotunplug NIC xml: <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > <mac address="00:1a:4a:16:88:5c"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Dummy-6860::DEBUG::2014-07-08 16:53:37,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:53:37,298::BindingXMLRPC::1114::vds::(wrapper) return vmHotunplugNic with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'pid': '4092', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Opteron_G1', 'smp': '1', 'pauseCode': 'NOERR', 'numaTune': {'mode': 'preferred'}, 'custom': {'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=18a91000-ba5f-4ac4-86c7-b21f96fc1711, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=755ce754-7bee-49fb-b450-d0b85277bd79, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311e': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=3996d27c-c4e2-4a39-968c-616c4c77311e, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=ee937282-11ea-4d93-b4da-1019bcd29ad1, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_18a91000-ba5f-4ac4-86c7-b21f96fc1711device_ee937282-11ea-4d93-b4da-1019bcd29ad1device_3996d27c-c4e2-4a39-968c-616c4c77311edevice_755ce754-7bee-49fb-b450-d0b85277bd79device_988e6a00-cb47-4d6d-b308-befb52ea3952': 'VmDevice {vmId=9b0bd5aa-d706-426a-a077-62a64954b803, deviceId=988e6a00-cb47-4d6d-b308-befb52ea3952, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'vm1', 'nice': '0', 'status': 'Up', 'bootMenuEnable': 'false', 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803', 'copyPasteEnable': 'true', 'displayIp': '10.35.128.17', 'displayPort': u'5900', 'smartcardEnable': 'false', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'fileTransferEnable': 'true', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'devices': [{'device': 'memballoon', 'specParams': {'model': 'none'}, 'type': 'balloon', 'alias': u'balloon0'}, {'index': '0', 'alias': u'scsi0', 'specParams': {}, 'deviceId': '55d5a62a-e1ba-4197-b991-34cb27d29412', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '6f1e54a7-9e7b-4487-b04b-954315a168a4', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'device': 'spice', 'specParams': {'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'copyPasteEnable': 'true', 'keyMap': 'en-us', 'displayIp': '10.35.128.17', 'displayNetwork': 'ovirtmgmt'}, 'type': 'graphics', 'port': u'5900', 'tlsPort': u'5901'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5b', 'linkActive': True, 'network': 'ovirtmgmt', 'alias': u'net0', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '538e4604-ff2c-4884-869d-f245d2051300', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '0ee274c9-1b7d-4857-8324-eccf458f33f2', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '10737418240', 'alias': u'virtio-disk0', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c', 'readonly': 'False', 'shared': 'false', 'truesize': '24576', 'type': 'disk', 'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'reqsize': '0', 'format': 'raw', 'deviceId': 'c1abf407-d743-43d7-85bb-157eec06157c', 'poolID': '36ffc40d-feca-42ea-a0ae-e40506318f67', 'device': 'disk', 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': 'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'specParams': {}, 'volumeChain': [{'domainID': '2b5f401c-f143-45db-8578-1a8666cba539', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'volumeID': u'f49c2dc9-a84e-484a-b8d7-efe4afd34c76', 'leasePath': u'/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/images/c1abf407-d743-43d7-85bb-157eec06157c/f49c2dc9-a84e-484a-b8d7-efe4afd34c76.lease', 'imageID': 'c1abf407-d743-43d7-85bb-157eec06157c'}]}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'timeOffset': '0', 'maxVCpus': '160', 'clientIp': '', 'display': 'qxl'}} >Dummy-6860::DEBUG::2014-07-08 16:53:37,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017311 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:37,448::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:37,454::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:37,459::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:53:38,533::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:38,534::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:53:38,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:38,534::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:38,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-37::DEBUG::2014-07-08 16:53:38,543::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:53:38,790::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00054866 s, 842 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:53:38,789::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:53:38,808::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 16:53:38,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`6be72182-3211-48e8-84f1-781d3a3e36ef`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:38,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::INFO::2014-07-08 16:53:38,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:38,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:38,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:38,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:38,828::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:38,830::__init__::225::IOProcess::(_processLogs) (273775) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:38,832::__init__::225::IOProcess::(_processLogs) (273775) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:38,834::__init__::225::IOProcess::(_processLogs) (273775) Building response >Thread-18::DEBUG::2014-07-08 16:53:38,835::__init__::225::IOProcess::(_processLogs) (273775) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:38,837::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::INFO::2014-07-08 16:53:38,842::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:53:38,846::task::1191::Storage.TaskManager.Task::(prepare) Task=`6be72182-3211-48e8-84f1-781d3a3e36ef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:53:38,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`6be72182-3211-48e8-84f1-781d3a3e36ef`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:53:38,852::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:53:38,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:53:38,854::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7087::DEBUG::2014-07-08 16:53:38,859::task::993::Storage.TaskManager.Task::(_decref) Task=`6be72182-3211-48e8-84f1-781d3a3e36ef`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:53:38,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:38,865::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:38,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:38,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:38,872::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:38,874::__init__::225::IOProcess::(_processLogs) (273776) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:38,875::__init__::225::IOProcess::(_processLogs) (273776) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:38,876::__init__::225::IOProcess::(_processLogs) (273776) Building response >Thread-18::DEBUG::2014-07-08 16:53:38,877::__init__::225::IOProcess::(_processLogs) (273776) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:38,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:38,880::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:53:38,887::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:53:38,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:53:38,890::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:53:38,892::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:38,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:53:38,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`90989173-aef2-4bef-95c5-06e2cf5970a8`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:38,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::INFO::2014-07-08 16:53:38,900::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:38,901::__init__::225::IOProcess::(_processLogs) (273777) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:38,906::__init__::225::IOProcess::(_processLogs) (273777) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:53:38,907::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cc099ebc-96b2-40bb-a2fe-539aa1bccc7e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:53:38,909::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:53:38,910::__init__::225::IOProcess::(_processLogs) (273777) Building response >Thread-18::DEBUG::2014-07-08 16:53:38,913::__init__::225::IOProcess::(_processLogs) (273777) Queuing response >Thread-7083::DEBUG::2014-07-08 16:53:38,913::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:53:38,915::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:53:38,915::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cc099ebc-96b2-40bb-a2fe-539aa1bccc7e`::Granted request >Thread-18::DEBUG::2014-07-08 16:53:38,918::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:53:38,923::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`90989173-aef2-4bef-95c5-06e2cf5970a8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:53:38,926::task::993::Storage.TaskManager.Task::(_decref) Task=`90989173-aef2-4bef-95c5-06e2cf5970a8`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:53:38,927::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:53:38,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:38,935::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:38,939::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:38,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:38,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:38,948::__init__::225::IOProcess::(_processLogs) (273778) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:38,951::__init__::225::IOProcess::(_processLogs) (273778) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:38,955::__init__::225::IOProcess::(_processLogs) (273778) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:38,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:38,960::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:53:38,975::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:38,977::task::1191::Storage.TaskManager.Task::(prepare) Task=`90989173-aef2-4bef-95c5-06e2cf5970a8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:38,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`90989173-aef2-4bef-95c5-06e2cf5970a8`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:53:38,979::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:53:38,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:53:38,983::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:53:38,986::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:53:38,987::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:53:38,988::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:53:38,990::task::993::Storage.TaskManager.Task::(_decref) Task=`90989173-aef2-4bef-95c5-06e2cf5970a8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:53:39,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:39,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411346 s, 24.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:53:41,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:41,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172023 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:42,469::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:42,471::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:42,472::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:43,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:44,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102963 s, 9.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:53:45,509::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:53:46,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:46,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173694 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:53:46,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6e6b286-3af0-4d56-8700-8236ce9852c8`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:53:46,845::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:53:46,846::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:53:46,847::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:46,847::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:46,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:46,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:46,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:46,848::__init__::225::IOProcess::(_processLogs) (273779) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:53:46,849::__init__::225::IOProcess::(_processLogs) (273779) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:53:46,849::__init__::225::IOProcess::(_processLogs) DEBUG|(273779) Building response >Thread-18::DEBUG::2014-07-08 16:53:46,849::__init__::225::IOProcess::(_processLogs) (273779) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:46,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:46,850::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:53:46,852::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:46,852::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:53:46,852::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:46,852::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:46,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:46,853::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:46,853::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:46,853::__init__::225::IOProcess::(_processLogs) (273780) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:53:46,854::__init__::225::IOProcess::(_processLogs) (273780) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:53:46,854::__init__::225::IOProcess::(_processLogs) (273780) Building response >Thread-18::DEBUG::2014-07-08 16:53:46,854::__init__::225::IOProcess::(_processLogs) (273780) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:46,854::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:46,855::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:53:46,856::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:53:46,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`d6e6b286-3af0-4d56-8700-8236ce9852c8`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:53:46,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6e6b286-3af0-4d56-8700-8236ce9852c8`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:53:46,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:53:46,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:53:46,857::task::993::Storage.TaskManager.Task::(_decref) Task=`d6e6b286-3af0-4d56-8700-8236ce9852c8`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:53:46,957::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:53:46,958::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:47,479::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:47,480::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:47,481::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:48,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:48,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282467 s, 36.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:53:48,966::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:53:48,967::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:53:48,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:48,967::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:48,968::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:48,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:48,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:48,968::__init__::225::IOProcess::(_processLogs) (273781) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:48,969::__init__::225::IOProcess::(_processLogs) (273781) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:48,969::__init__::225::IOProcess::(_processLogs) (273781) Building response >Thread-18::DEBUG::2014-07-08 16:53:48,969::__init__::225::IOProcess::(_processLogs) (273781) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:48,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:48,970::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:53:48,971::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:53:49,126::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000546425 s, 845 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:53:49,129::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:53:49,137::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-7087::DEBUG::2014-07-08 16:53:49,140::task::595::Storage.TaskManager.Task::(_updateState) Task=`691b6932-5061-4aa3-a34c-f54b63115a84`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:53:49,142::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:49,143::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:53:49,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:49,151::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:49,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:49,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:49,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:49,158::__init__::225::IOProcess::(_processLogs) (273782) Finding callback 'statvfs'... >Thread-7087::INFO::2014-07-08 16:53:49,159::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:53:49,161::__init__::225::IOProcess::(_processLogs) (273782) Got request for method 'statvfs' >Thread-7087::DEBUG::2014-07-08 16:53:49,161::task::1191::Storage.TaskManager.Task::(prepare) Task=`691b6932-5061-4aa3-a34c-f54b63115a84`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:53:49,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`691b6932-5061-4aa3-a34c-f54b63115a84`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:53:49,165::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:53:49,166::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:53:49,168::task::993::Storage.TaskManager.Task::(_decref) Task=`691b6932-5061-4aa3-a34c-f54b63115a84`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:53:49,165::__init__::225::IOProcess::(_processLogs) (273782) Building response >Thread-18::DEBUG::2014-07-08 16:53:49,172::__init__::225::IOProcess::(_processLogs) (273782) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:49,174::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:49,176::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:53:49,189::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:53:49,190::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 16:53:49,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d40cd07-cfad-4111-958c-b28c552aab9b`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:49,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 16:53:49,197::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:49,198::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:49,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:53:49,205::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`eeed50c0-72e1-4ca3-9baa-85ee40a5b95c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:53:49,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:53:49,207::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:53:49,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:53:49,211::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:53:49,216::__init__::225::IOProcess::(_processLogs) (273783) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:53:49,218::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`eeed50c0-72e1-4ca3-9baa-85ee40a5b95c`::Granted request >Thread-18::DEBUG::2014-07-08 16:53:49,219::__init__::225::IOProcess::(_processLogs) (273783) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:53:49,224::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d40cd07-cfad-4111-958c-b28c552aab9b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:53:49,224::__init__::225::IOProcess::(_processLogs) (273783) Queuing response >Thread-7083::DEBUG::2014-07-08 16:53:49,225::task::993::Storage.TaskManager.Task::(_decref) Task=`8d40cd07-cfad-4111-958c-b28c552aab9b`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:53:49,228::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:49,232::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:53:49,247::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:53:49,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:49,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:49,258::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:49,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:49,262::__init__::225::IOProcess::(_processLogs) (273784) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:49,264::__init__::225::IOProcess::(_processLogs) (273784) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:49,265::__init__::225::IOProcess::(_processLogs) (273784) Building response >Thread-18::DEBUG::2014-07-08 16:53:49,267::__init__::225::IOProcess::(_processLogs) (273784) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:49,268::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:49,269::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:53:49,277::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:49,280::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d40cd07-cfad-4111-958c-b28c552aab9b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:53:49,280::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:53:49,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d40cd07-cfad-4111-958c-b28c552aab9b`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:53:49,284::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:53:49,285::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:53:49,287::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:53:49,288::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:53:49,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:53:49,294::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:53:49,295::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:53:49,298::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:53:49,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:53:49,300::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:53:49,302::__init__::225::IOProcess::(_processLogs) (273785) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:53:49,304::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:53:49,305::__init__::225::IOProcess::(_processLogs) (273785) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:49,311::__init__::225::IOProcess::(_processLogs) (273785) Queuing response >Thread-7083::DEBUG::2014-07-08 16:53:49,312::task::993::Storage.TaskManager.Task::(_decref) Task=`8d40cd07-cfad-4111-958c-b28c552aab9b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:53:49,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:49,412::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 16:53:50,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a049454-bc43-45b3-b064-c780ecbdd127`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:53:50,246::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:53:50,246::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546425', 'lastCheck': '0.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:53:50,246::task::1191::Storage.TaskManager.Task::(prepare) Task=`4a049454-bc43-45b3-b064-c780ecbdd127`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546425', 'lastCheck': '0.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:53:50,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a049454-bc43-45b3-b064-c780ecbdd127`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:53:50,247::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:53:50,247::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:53:50,247::task::993::Storage.TaskManager.Task::(_decref) Task=`4a049454-bc43-45b3-b064-c780ecbdd127`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:53:50,305::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:50,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:51,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172065 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:52,489::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:52,490::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:52,491::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:53,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:53,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175504 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:53:55,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:55,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171825 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:57,497::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:57,499::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:53:57,500::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:53:57,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:53:57,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0513343 s, 19.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:53:59,426::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:53:59,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:59,427::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:59,428::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:59,428::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:59,428::__init__::225::IOProcess::(_processLogs) (273786) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:59,428::__init__::225::IOProcess::(_processLogs) (273786) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:59,428::__init__::225::IOProcess::(_processLogs) (273786) Building response >Thread-18::DEBUG::2014-07-08 16:53:59,429::__init__::225::IOProcess::(_processLogs) (273786) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:59,429::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:59,429::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:53:59,431::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:53:59,589::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:53:59,589::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000440268 s, 1.0 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:53:59,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`d135a1f1-7b9c-4a27-8c6c-d25438d99761`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:59,608::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::INFO::2014-07-08 16:53:59,610::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:59,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:59,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:59,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:59,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:59,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:59,624::__init__::225::IOProcess::(_processLogs) (273787) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:53:59,626::__init__::225::IOProcess::(_processLogs) (273787) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:53:59,627::__init__::225::IOProcess::(_processLogs) (273787) Building response >Thread-7087::INFO::2014-07-08 16:53:59,630::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:53:59,630::__init__::225::IOProcess::(_processLogs) (273787) Queuing response >Thread-7087::DEBUG::2014-07-08 16:53:59,633::task::1191::Storage.TaskManager.Task::(prepare) Task=`d135a1f1-7b9c-4a27-8c6c-d25438d99761`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:53:59,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`d135a1f1-7b9c-4a27-8c6c-d25438d99761`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:53:59,636::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::DEBUG::2014-07-08 16:53:59,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:53:59,642::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:53:59,643::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::DEBUG::2014-07-08 16:53:59,645::task::993::Storage.TaskManager.Task::(_decref) Task=`d135a1f1-7b9c-4a27-8c6c-d25438d99761`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:53:59,660::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:53:59,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:59,663::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:53:59,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:59,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:53:59,671::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:53:59,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:59,676::__init__::225::IOProcess::(_processLogs) (273788) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:53:59,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e4e09cf-5ccf-4761-8430-e67109f6f467`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:53:59,679::__init__::225::IOProcess::(_processLogs) (273788) Got request for method 'access' >Thread-7083::INFO::2014-07-08 16:53:59,680::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:53:59,682::__init__::225::IOProcess::(_processLogs) (273788) Building response >Thread-18::DEBUG::2014-07-08 16:53:59,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:59,688::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:53:59,690::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7cc95a21-931d-404c-be49-738826f3c646`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:53:59,693::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:53:59,698::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:53:59,699::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::DEBUG::2014-07-08 16:53:59,700::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7cc95a21-931d-404c-be49-738826f3c646`::Granted request >Thread-18::DEBUG::2014-07-08 16:53:59,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:59,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:53:59,706::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2e4e09cf-5ccf-4761-8430-e67109f6f467`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:53:59,709::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:53:59,710::task::993::Storage.TaskManager.Task::(_decref) Task=`2e4e09cf-5ccf-4761-8430-e67109f6f467`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:53:59,712::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:59,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:59,720::__init__::225::IOProcess::(_processLogs) (273789) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:59,723::__init__::225::IOProcess::(_processLogs) (273789) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:59,725::__init__::225::IOProcess::(_processLogs) (273789) Building response >Thread-18::DEBUG::2014-07-08 16:53:59,728::__init__::225::IOProcess::(_processLogs) (273789) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:59,731::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:59,736::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:53:59,747::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:53:59,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:53:59,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:53:59,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:53:59,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:53:59,755::__init__::225::IOProcess::(_processLogs) (273790) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:53:59,755::__init__::225::IOProcess::(_processLogs) (273790) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:53:59,755::__init__::225::IOProcess::(_processLogs) (273790) Building response >Thread-18::DEBUG::2014-07-08 16:53:59,756::__init__::225::IOProcess::(_processLogs) (273790) Queuing response >Thread-18::DEBUG::2014-07-08 16:53:59,757::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:53:59,759::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:53:59,769::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:59,771::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e4e09cf-5ccf-4761-8430-e67109f6f467`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:53:59,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e4e09cf-5ccf-4761-8430-e67109f6f467`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:53:59,773::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:53:59,774::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:53:59,777::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:53:59,778::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:53:59,779::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:53:59,780::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:53:59,783::task::993::Storage.TaskManager.Task::(_decref) Task=`2e4e09cf-5ccf-4761-8430-e67109f6f467`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:53:59,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:00,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.091002 s, 11.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:54:02,038::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:54:02,039::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:54:02,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:02,528::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:02,531::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:02,532::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:02,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176454 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:54:04,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:04,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339554 s, 30.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:54:05,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`21489824-ff10-4c3a-80a8-c857cb91fb97`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:54:05,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:54:05,724::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440268', 'lastCheck': '6.0', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:54:05,725::task::1191::Storage.TaskManager.Task::(prepare) Task=`21489824-ff10-4c3a-80a8-c857cb91fb97`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440268', 'lastCheck': '6.0', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:54:05,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`21489824-ff10-4c3a-80a8-c857cb91fb97`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:54:05,725::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:54:05,725::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:54:05,726::task::993::Storage.TaskManager.Task::(_decref) Task=`21489824-ff10-4c3a-80a8-c857cb91fb97`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:54:05,777::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:07,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:07,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170526 s, 60.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:07,536::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:07,537::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:07,538::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:09,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:09,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173263 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:54:09,770::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:54:09,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:09,771::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:09,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:09,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:09,772::__init__::225::IOProcess::(_processLogs) (273791) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:54:09,772::__init__::225::IOProcess::(_processLogs) (273791) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:54:09,772::__init__::225::IOProcess::(_processLogs) (273791) Building response >Thread-18::DEBUG::2014-07-08 16:54:09,773::__init__::225::IOProcess::(_processLogs) (273791) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:09,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:09,773::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:54:09,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:54:09,938::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:54:09,939::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000553409 s, 835 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:54:09,949::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 16:54:09,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`58cb08d6-7ee0-4429-b4e0-300ede2f7151`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:54:09,953::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::INFO::2014-07-08 16:54:09,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:09,956::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:09,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:09,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:09,960::__init__::225::IOProcess::(_processLogs) (273792) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:54:09,961::__init__::225::IOProcess::(_processLogs) (273792) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:54:09,963::__init__::225::IOProcess::(_processLogs) (273792) Building response >Thread-18::DEBUG::2014-07-08 16:54:09,965::__init__::225::IOProcess::(_processLogs) (273792) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:09,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:09,970::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::INFO::2014-07-08 16:54:09,974::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:54:09,978::task::1191::Storage.TaskManager.Task::(prepare) Task=`58cb08d6-7ee0-4429-b4e0-300ede2f7151`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:54:09,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`58cb08d6-7ee0-4429-b4e0-300ede2f7151`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:54:09,983::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:54:09,986::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:54:09,988::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7087::DEBUG::2014-07-08 16:54:09,989::task::993::Storage.TaskManager.Task::(_decref) Task=`58cb08d6-7ee0-4429-b4e0-300ede2f7151`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:54:09,992::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:09,996::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:09,999::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:10,001::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:10,003::__init__::225::IOProcess::(_processLogs) (273793) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:10,004::__init__::225::IOProcess::(_processLogs) (273793) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:10,006::__init__::225::IOProcess::(_processLogs) (273793) Building response >Thread-18::DEBUG::2014-07-08 16:54:10,007::__init__::225::IOProcess::(_processLogs) (273793) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:10,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:10,010::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:54:10,016::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:54:10,018::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:10,019::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:10,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:10,022::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:10,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:54:10,029::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:54:10,030::__init__::225::IOProcess::(_processLogs) (273794) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:54:10,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3b35194-17a7-48a3-9553-53783c4362b7`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:54:10,040::__init__::225::IOProcess::(_processLogs) (273794) Got request for method 'access' >Thread-7083::INFO::2014-07-08 16:54:10,043::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:10,049::__init__::225::IOProcess::(_processLogs) (273794) Building response >Thread-18::DEBUG::2014-07-08 16:54:10,058::__init__::225::IOProcess::(_processLogs) (273794) Queuing response >Thread-7083::DEBUG::2014-07-08 16:54:10,059::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55c7858e-1b27-4a66-86ad-13682a466815`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:54:10,065::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:54:10,066::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:10,075::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:54:10,076::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:54:10,083::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55c7858e-1b27-4a66-86ad-13682a466815`::Granted request >Thread-18::DEBUG::2014-07-08 16:54:10,102::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:54:10,101::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a3b35194-17a7-48a3-9553-53783c4362b7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:54:10,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:54:10,110::task::993::Storage.TaskManager.Task::(_decref) Task=`a3b35194-17a7-48a3-9553-53783c4362b7`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:54:10,115::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:10,123::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:10,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:10,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:10,150::__init__::225::IOProcess::(_processLogs) (273795) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:10,159::__init__::225::IOProcess::(_processLogs) (273795) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:10,166::__init__::225::IOProcess::(_processLogs) (273795) Building response >Thread-18::DEBUG::2014-07-08 16:54:10,168::__init__::225::IOProcess::(_processLogs) (273795) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:10,171::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::INFO::2014-07-08 16:54:10,201::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:54:10,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3b35194-17a7-48a3-9553-53783c4362b7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:54:10,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3b35194-17a7-48a3-9553-53783c4362b7`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:54:10,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:54:10,206::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:54:10,208::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:54:10,209::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:54:10,210::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:54:10,211::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:54:10,214::task::993::Storage.TaskManager.Task::(_decref) Task=`a3b35194-17a7-48a3-9553-53783c4362b7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:54:11,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:11,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170389 s, 60.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:12,543::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:12,545::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:12,546::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:13,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:14,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173775 s, 58.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:54:15,776::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:54:16,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:16,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.135386 s, 7.6 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:54:17,076::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:54:17,076::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:17,553::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:17,554::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:17,555::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:18,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:18,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171855 s, 59.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:54:20,185::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:54:20,186::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:20,186::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:20,186::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:20,187::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:20,187::__init__::225::IOProcess::(_processLogs) (273796) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:54:20,187::__init__::225::IOProcess::(_processLogs) (273796) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:54:20,187::__init__::225::IOProcess::(_processLogs) (273796) Building response >Thread-18::DEBUG::2014-07-08 16:54:20,188::__init__::225::IOProcess::(_processLogs) (273796) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:20,188::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:20,188::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:54:20,190::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:54:20,343::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000495302 s, 933 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:54:20,345::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 16:54:20,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcc16ff4-4919-4073-8d50-3ad49fd43734`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:54:20,355::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::INFO::2014-07-08 16:54:20,358::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:20,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:20,363::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:20,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:20,366::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:20,368::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:20,369::__init__::225::IOProcess::(_processLogs) (273797) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:54:20,371::__init__::225::IOProcess::(_processLogs) (273797) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:54:20,373::__init__::225::IOProcess::(_processLogs) (273797) Building response >Thread-18::DEBUG::2014-07-08 16:54:20,375::__init__::225::IOProcess::(_processLogs) (273797) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:20,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::INFO::2014-07-08 16:54:20,376::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:54:20,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`fcc16ff4-4919-4073-8d50-3ad49fd43734`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:54:20,379::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::DEBUG::2014-07-08 16:54:20,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcc16ff4-4919-4073-8d50-3ad49fd43734`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:54:20,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:54:20,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:54:20,388::task::993::Storage.TaskManager.Task::(_decref) Task=`fcc16ff4-4919-4073-8d50-3ad49fd43734`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:54:20,400::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:54:20,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:20,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:20,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:20,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:20,407::__init__::225::IOProcess::(_processLogs) (273798) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:20,409::__init__::225::IOProcess::(_processLogs) (273798) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:20,410::__init__::225::IOProcess::(_processLogs) (273798) Building response >Thread-18::DEBUG::2014-07-08 16:54:20,414::__init__::225::IOProcess::(_processLogs) (273798) Queuing response >Thread-7083::DEBUG::2014-07-08 16:54:20,417::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:54:20,418::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:20,422::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:54:20,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`194fe1e1-ec3f-4fa2-ba45-fe16ab35477c`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:54:20,427::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:20,434::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:54:20,437::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:54:20,438::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1e4fd2c2-5865-4433-b00d-24fb2ee31e01`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:54:20,440::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:54:20,441::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:20,444::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:54:20,445::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:54:20,448::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1e4fd2c2-5865-4433-b00d-24fb2ee31e01`::Granted request >Thread-18::DEBUG::2014-07-08 16:54:20,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:20,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:54:20,455::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`194fe1e1-ec3f-4fa2-ba45-fe16ab35477c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:54:20,456::__init__::225::IOProcess::(_processLogs) (273799) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:54:20,457::task::993::Storage.TaskManager.Task::(_decref) Task=`194fe1e1-ec3f-4fa2-ba45-fe16ab35477c`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:54:20,460::__init__::225::IOProcess::(_processLogs) (273799) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:20,462::__init__::225::IOProcess::(_processLogs) (273799) Building response >Thread-18::DEBUG::2014-07-08 16:54:20,467::__init__::225::IOProcess::(_processLogs) (273799) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:20,471::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:20,474::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:54:20,487::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:54:20,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:20,495::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:20,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:20,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:20,505::__init__::225::IOProcess::(_processLogs) (273800) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:20,506::__init__::225::IOProcess::(_processLogs) (273800) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:20,508::__init__::225::IOProcess::(_processLogs) (273800) Building response >Thread-18::DEBUG::2014-07-08 16:54:20,510::__init__::225::IOProcess::(_processLogs) (273800) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:20,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:20,513::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:54:20,516::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:54:20,521::task::1191::Storage.TaskManager.Task::(prepare) Task=`194fe1e1-ec3f-4fa2-ba45-fe16ab35477c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:54:20,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`194fe1e1-ec3f-4fa2-ba45-fe16ab35477c`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:54:20,524::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:54:20,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:54:20,528::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:54:20,530::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:54:20,531::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:54:20,532::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:54:20,535::task::993::Storage.TaskManager.Task::(_decref) Task=`194fe1e1-ec3f-4fa2-ba45-fe16ab35477c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:54:20,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:21,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175054 s, 58.5 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:54:21,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3fa9106-d2ef-4ed7-9d33-a6c625893326`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:54:21,154::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:54:21,156::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495302', 'lastCheck': '0.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:54:21,157::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3fa9106-d2ef-4ed7-9d33-a6c625893326`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495302', 'lastCheck': '0.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:54:21,157::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3fa9106-d2ef-4ed7-9d33-a6c625893326`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:54:21,158::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:54:21,159::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:54:21,160::task::993::Storage.TaskManager.Task::(_decref) Task=`d3fa9106-d2ef-4ed7-9d33-a6c625893326`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:54:21,231::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:22,563::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:22,564::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:22,565::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:23,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:23,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180798 s, 56.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:54:25,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:25,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017425 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:27,573::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:27,574::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:27,576::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:27,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:27,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174828 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:54:30,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:30,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017542 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:54:30,523::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:54:30,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:30,524::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:30,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:30,524::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:30,524::__init__::225::IOProcess::(_processLogs) (273801) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:54:30,525::__init__::225::IOProcess::(_processLogs) (273801) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:54:30,525::__init__::225::IOProcess::(_processLogs) (273801) Building response >Thread-18::DEBUG::2014-07-08 16:54:30,525::__init__::225::IOProcess::(_processLogs) (273801) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:30,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:30,526::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:54:30,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:54:30,688::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000549777 s, 840 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:54:30,695::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:54:30,703::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:54:30,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:30,711::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::DEBUG::2014-07-08 16:54:30,711::task::595::Storage.TaskManager.Task::(_updateState) Task=`514f04dd-e54a-4165-b8bc-7054152da263`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:54:30,715::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::INFO::2014-07-08 16:54:30,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:30,719::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:30,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:30,723::__init__::225::IOProcess::(_processLogs) (273802) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:54:30,726::__init__::225::IOProcess::(_processLogs) (273802) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:54:30,728::__init__::225::IOProcess::(_processLogs) (273802) Building response >Thread-18::DEBUG::2014-07-08 16:54:30,729::__init__::225::IOProcess::(_processLogs) (273802) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:30,731::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:30,732::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::INFO::2014-07-08 16:54:30,739::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:54:30,747::task::1191::Storage.TaskManager.Task::(prepare) Task=`514f04dd-e54a-4165-b8bc-7054152da263`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:54:30,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`514f04dd-e54a-4165-b8bc-7054152da263`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:54:30,761::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7087::DEBUG::2014-07-08 16:54:30,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:54:30,767::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7087::DEBUG::2014-07-08 16:54:30,769::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:54:30,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:30,776::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:30,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::DEBUG::2014-07-08 16:54:30,778::task::993::Storage.TaskManager.Task::(_decref) Task=`514f04dd-e54a-4165-b8bc-7054152da263`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:54:30,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:30,788::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:30,792::__init__::225::IOProcess::(_processLogs) (273803) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:30,796::__init__::225::IOProcess::(_processLogs) (273803) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:30,800::__init__::225::IOProcess::(_processLogs) (273803) Building response >Thread-18::DEBUG::2014-07-08 16:54:30,804::__init__::225::IOProcess::(_processLogs) (273803) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:30,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:30,813::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:54:30,829::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:54:30,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:30,839::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::DEBUG::2014-07-08 16:54:30,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce05702a-2f84-41e4-8d01-b0e940ba617b`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:54:30,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:30,853::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::INFO::2014-07-08 16:54:30,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:30,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:30,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:54:30,874::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bf13bd17-0422-45fd-8ac0-28b24b94b732`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:54:30,875::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:54:30,878::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:54:30,881::__init__::225::IOProcess::(_processLogs) (273804) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:54:30,884::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:54:30,884::__init__::225::IOProcess::(_processLogs) (273804) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:54:30,887::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bf13bd17-0422-45fd-8ac0-28b24b94b732`::Granted request >Thread-18::DEBUG::2014-07-08 16:54:30,888::__init__::225::IOProcess::(_processLogs) (273804) Building response >Thread-18::DEBUG::2014-07-08 16:54:30,891::__init__::225::IOProcess::(_processLogs) (273804) Queuing response >Thread-7083::DEBUG::2014-07-08 16:54:30,894::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce05702a-2f84-41e4-8d01-b0e940ba617b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:54:30,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:54:30,897::task::993::Storage.TaskManager.Task::(_decref) Task=`ce05702a-2f84-41e4-8d01-b0e940ba617b`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:54:30,897::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:54:30,911::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:30,916::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:54:30,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:30,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:30,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:30,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:30,935::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:30,939::__init__::225::IOProcess::(_processLogs) (273805) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:30,941::__init__::225::IOProcess::(_processLogs) (273805) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:30,943::__init__::225::IOProcess::(_processLogs) (273805) Building response >Thread-18::DEBUG::2014-07-08 16:54:30,944::__init__::225::IOProcess::(_processLogs) (273805) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:30,946::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:30,947::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:54:30,951::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:54:30,955::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce05702a-2f84-41e4-8d01-b0e940ba617b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:54:30,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce05702a-2f84-41e4-8d01-b0e940ba617b`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:54:30,958::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:54:30,960::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:54:30,962::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:54:30,963::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:54:30,964::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:54:30,965::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:54:30,967::task::993::Storage.TaskManager.Task::(_decref) Task=`ce05702a-2f84-41e4-8d01-b0e940ba617b`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:54:32,173::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:54:32,173::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:54:32,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:32,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100227 s, 10.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:32,600::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:32,692::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:32,700::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:34,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:35,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0688732 s, 14.9 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:54:36,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`db7c52f7-1ee8-4886-8a57-6c9755b19065`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:54:36,746::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:54:36,747::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549777', 'lastCheck': '5.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:54:36,747::task::1191::Storage.TaskManager.Task::(prepare) Task=`db7c52f7-1ee8-4886-8a57-6c9755b19065`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549777', 'lastCheck': '5.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:54:36,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`db7c52f7-1ee8-4886-8a57-6c9755b19065`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:54:36,747::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:54:36,748::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:54:36,748::task::993::Storage.TaskManager.Task::(_decref) Task=`db7c52f7-1ee8-4886-8a57-6c9755b19065`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:54:36,781::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:37,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:37,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176401 s, 58.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:37,710::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:37,711::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:37,712::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:39,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:39,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170635 s, 60.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:54:40,959::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:40,959::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:54:40,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:40,960::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:40,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:40,960::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:40,961::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:40,961::__init__::225::IOProcess::(_processLogs) (273806) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:54:40,961::__init__::225::IOProcess::(_processLogs) (273806) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:54:40,962::__init__::225::IOProcess::(_processLogs) DEBUG|(273806) Building response >Thread-18::DEBUG::2014-07-08 16:54:40,962::__init__::225::IOProcess::(_processLogs) (273806) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:40,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:40,962::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:54:40,964::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:54:41,122::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000468484 s, 986 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:54:41,130::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:54:41,139::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:41,146::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 16:54:41,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`08e98c95-2a70-4f2f-bbcf-4c68679e8fa0`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:54:41,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::INFO::2014-07-08 16:54:41,153::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:41,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:41,167::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:41,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:41,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:41,173::__init__::225::IOProcess::(_processLogs) (273807) Finding callback 'statvfs'... >Thread-7087::INFO::2014-07-08 16:54:41,174::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:54:41,179::__init__::225::IOProcess::(_processLogs) (273807) Got request for method 'statvfs' >Thread-7087::DEBUG::2014-07-08 16:54:41,182::task::1191::Storage.TaskManager.Task::(prepare) Task=`08e98c95-2a70-4f2f-bbcf-4c68679e8fa0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:54:41,187::__init__::225::IOProcess::(_processLogs) (273807) Building response >Thread-7087::DEBUG::2014-07-08 16:54:41,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`08e98c95-2a70-4f2f-bbcf-4c68679e8fa0`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:54:41,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:54:41,194::__init__::225::IOProcess::(_processLogs) (273807) Queuing response >Thread-7087::DEBUG::2014-07-08 16:54:41,198::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:54:41,202::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-7087::DEBUG::2014-07-08 16:54:41,205::task::993::Storage.TaskManager.Task::(_decref) Task=`08e98c95-2a70-4f2f-bbcf-4c68679e8fa0`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:54:41,206::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:54:41,234::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:41,241::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 16:54:41,246::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:54:41,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:41,256::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:54:41,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`7937532e-39c5-4d76-9412-1a01e621e229`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:54:41,262::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::INFO::2014-07-08 16:54:41,265::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:41,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:41,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:54:41,276::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`50160900-edff-4819-841c-9973e28c8195`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:54:41,279::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:54:41,278::__init__::225::IOProcess::(_processLogs) (273808) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:41,281::__init__::225::IOProcess::(_processLogs) (273808) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:54:41,283::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:54:41,285::__init__::225::IOProcess::(_processLogs) DEBUG|(273808) Building response >Thread-7083::DEBUG::2014-07-08 16:54:41,286::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`50160900-edff-4819-841c-9973e28c8195`::Granted request >Thread-18::DEBUG::2014-07-08 16:54:41,289::__init__::225::IOProcess::(_processLogs) (273808) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:41,293::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:54:41,295::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7937532e-39c5-4d76-9412-1a01e621e229`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:54:41,295::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:54:41,298::task::993::Storage.TaskManager.Task::(_decref) Task=`7937532e-39c5-4d76-9412-1a01e621e229`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:54:41,308::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:41,313::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:54:41,316::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:41,320::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:41,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:41,328::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:41,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:41,342::__init__::225::IOProcess::(_processLogs) (273809) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:41,344::__init__::225::IOProcess::(_processLogs) (273809) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:41,345::__init__::225::IOProcess::(_processLogs) (273809) Building response >Thread-18::DEBUG::2014-07-08 16:54:41,347::__init__::225::IOProcess::(_processLogs) (273809) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:41,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:41,350::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:54:41,355::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::INFO::2014-07-08 16:54:41,358::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:54:41,359::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:54:41,361::task::1191::Storage.TaskManager.Task::(prepare) Task=`7937532e-39c5-4d76-9412-1a01e621e229`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:54:41,363::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:54:41,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`7937532e-39c5-4d76-9412-1a01e621e229`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:54:41,366::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:54:41,367::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:54:41,369::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:54:41,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:54:41,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:41,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:54:41,376::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:54:41,379::__init__::225::IOProcess::(_processLogs) (273810) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:54:41,381::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:54:41,382::__init__::225::IOProcess::(_processLogs) (273810) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:54:41,384::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:54:41,385::__init__::225::IOProcess::(_processLogs) (273810) Building response >Thread-7083::DEBUG::2014-07-08 16:54:41,387::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:54:41,389::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273810) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:41,391::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:54:41,391::task::993::Storage.TaskManager.Task::(_decref) Task=`7937532e-39c5-4d76-9412-1a01e621e229`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:54:41,393::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:54:41,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:42,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171758 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:42,720::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:42,721::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:42,722::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:44,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:44,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173216 s, 59.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:54:45,929::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:54:46,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:46,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173733 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:54:47,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb7804b0-d8ea-4b10-b208-e2c24c2bb3f6`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:54:47,210::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:54:47,211::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:47,212::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:54:47,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:47,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:47,213::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:47,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:47,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:47,214::__init__::225::IOProcess::(_processLogs) (273811) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:54:47,214::__init__::225::IOProcess::(_processLogs) (273811) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:54:47,214::__init__::225::IOProcess::(_processLogs) (273811) Building response >Thread-18::DEBUG::2014-07-08 16:54:47,214::__init__::225::IOProcess::(_processLogs) (273811) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:47,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:47,215::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:54:47,217::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:47,217::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:54:47,217::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:47,218::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:47,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:47,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:47,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:47,218::__init__::225::IOProcess::(_processLogs) (273812) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:54:47,219::__init__::225::IOProcess::(_processLogs) (273812) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:54:47,219::__init__::225::IOProcess::(_processLogs) (273812) Building response >Thread-18::DEBUG::2014-07-08 16:54:47,219::__init__::225::IOProcess::(_processLogs) (273812) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:47,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:47,220::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:54:47,221::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:54:47,221::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb7804b0-d8ea-4b10-b208-e2c24c2bb3f6`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:54:47,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb7804b0-d8ea-4b10-b208-e2c24c2bb3f6`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:54:47,222::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:54:47,222::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:54:47,222::task::993::Storage.TaskManager.Task::(_decref) Task=`eb7804b0-d8ea-4b10-b208-e2c24c2bb3f6`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:54:47,304::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:54:47,304::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:47,729::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:47,731::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:47,732::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:48,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:48,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0910375 s, 11.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:54:50,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:51,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174495 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:54:51,404::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:51,405::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:54:51,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:51,405::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:51,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:51,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:51,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:51,406::__init__::225::IOProcess::(_processLogs) (273813) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:54:51,407::__init__::225::IOProcess::(_processLogs) (273813) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:54:51,407::__init__::225::IOProcess::(_processLogs) (273813) Building response >Thread-18::DEBUG::2014-07-08 16:54:51,407::__init__::225::IOProcess::(_processLogs) (273813) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:51,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:51,407::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:54:51,409::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:54:51,571::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:54:51,572::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000527149 s, 876 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:54:51,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`e56cee2b-1a4f-4504-992b-49cc4b0a7de3`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:54:51,591::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7087::INFO::2014-07-08 16:54:51,596::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:51,599::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:54:51,605::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:51,606::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:51,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:51,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:51,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::INFO::2014-07-08 16:54:51,617::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:54:51,621::__init__::225::IOProcess::(_processLogs) (273814) Finding callback 'statvfs'... >Thread-7087::DEBUG::2014-07-08 16:54:51,624::task::1191::Storage.TaskManager.Task::(prepare) Task=`e56cee2b-1a4f-4504-992b-49cc4b0a7de3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:54:51,628::task::595::Storage.TaskManager.Task::(_updateState) Task=`e56cee2b-1a4f-4504-992b-49cc4b0a7de3`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:54:51,631::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:54:51,630::__init__::225::IOProcess::(_processLogs) (273814) Got request for method 'statvfs' >Thread-7087::DEBUG::2014-07-08 16:54:51,634::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:54:51,638::task::993::Storage.TaskManager.Task::(_decref) Task=`e56cee2b-1a4f-4504-992b-49cc4b0a7de3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:54:51,640::__init__::225::IOProcess::(_processLogs) (273814) Building response >Thread-18::DEBUG::2014-07-08 16:54:51,650::__init__::225::IOProcess::(_processLogs) (273814) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:51,658::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:51,661::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:54:51,687::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:54:51,691::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:54:51,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f21efbf-3321-4dac-9cd0-7d2a8a5a04fc`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:54:51,700::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::INFO::2014-07-08 16:54:51,707::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:54:51,708::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:51,714::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:54:51,718::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e865c074-925a-4f59-b3fe-d216e6f1d755`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:54:51,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:54:51,720::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:54:51,722::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:54:51,724::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:54:51,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:54:51,727::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e865c074-925a-4f59-b3fe-d216e6f1d755`::Granted request >Thread-18::DEBUG::2014-07-08 16:54:51,728::__init__::225::IOProcess::(_processLogs) (273815) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:51,731::__init__::225::IOProcess::(_processLogs) (273815) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:54:51,735::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2f21efbf-3321-4dac-9cd0-7d2a8a5a04fc`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:54:51,735::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273815) Building response >Thread-7083::DEBUG::2014-07-08 16:54:51,737::task::993::Storage.TaskManager.Task::(_decref) Task=`2f21efbf-3321-4dac-9cd0-7d2a8a5a04fc`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:54:51,738::__init__::225::IOProcess::(_processLogs) (273815) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:51,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:51,745::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:54:51,758::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:54:51,762::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:54:51,764::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:51,769::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:54:51,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:51,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:54:51,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:54:51,777::__init__::225::IOProcess::(_processLogs) (273816) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:54:51,778::__init__::225::IOProcess::(_processLogs) (273816) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:51,779::__init__::225::IOProcess::(_processLogs) (273816) Building response >Thread-18::DEBUG::2014-07-08 16:54:51,780::__init__::225::IOProcess::(_processLogs) (273816) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:51,781::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:51,782::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:54:51,788::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:54:51,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f21efbf-3321-4dac-9cd0-7d2a8a5a04fc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:54:51,791::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:54:51,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f21efbf-3321-4dac-9cd0-7d2a8a5a04fc`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:54:51,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:54:51,795::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:54:51,796::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:54:51,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:54:51,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:54:51,802::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:54:51,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:54:51,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:54:51,807::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:54:51,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:54:51,810::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:54:51,812::__init__::225::IOProcess::(_processLogs) (273817) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:54:51,813::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:54:51,815::__init__::225::IOProcess::(_processLogs) (273817) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:54:51,818::__init__::225::IOProcess::(_processLogs) (273817) Building response >Thread-7083::DEBUG::2014-07-08 16:54:51,818::task::993::Storage.TaskManager.Task::(_decref) Task=`2f21efbf-3321-4dac-9cd0-7d2a8a5a04fc`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:54:51,820::__init__::225::IOProcess::(_processLogs) (273817) Queuing response >Thread-18::DEBUG::2014-07-08 16:54:51,823::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:54:51,826::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 16:54:51,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`70058767-42c5-4640-a56f-9a15a536ce41`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:54:51,940::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:54:51,941::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527149', 'lastCheck': '0.1', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:54:51,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`70058767-42c5-4640-a56f-9a15a536ce41`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527149', 'lastCheck': '0.1', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:54:51,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`70058767-42c5-4640-a56f-9a15a536ce41`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:54:51,941::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:54:51,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:54:51,942::task::993::Storage.TaskManager.Task::(_decref) Task=`70058767-42c5-4640-a56f-9a15a536ce41`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:54:51,985::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:52,739::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:52,740::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:52,741::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:53,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:53,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176906 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:54:55,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:54:55,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173607 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:54:57,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:57,861::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:57,875::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:54:57,903::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:54:58,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0704007 s, 14.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:00,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:00,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173085 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:55:01,835::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:01,836::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:55:01,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:01,836::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:01,837::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:01,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:01,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:01,837::__init__::225::IOProcess::(_processLogs) (273818) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:55:01,838::__init__::225::IOProcess::(_processLogs) (273818) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:01,838::__init__::225::IOProcess::(_processLogs) (273818) Building response >Thread-18::DEBUG::2014-07-08 16:55:01,838::__init__::225::IOProcess::(_processLogs) (273818) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:01,838::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:01,839::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:55:01,840::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:55:02,001::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 16:55:02,001::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000548101 s, 843 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:55:02,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec807fa7-9930-4c0b-bba9-be561e08cdc3`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:55:02,013::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:02,014::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:02,018::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:55:02,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:02,020::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:02,022::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:02,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:02,026::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:02,028::__init__::225::IOProcess::(_processLogs) (273819) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:55:02,029::__init__::225::IOProcess::(_processLogs) (273819) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:02,031::__init__::225::IOProcess::(_processLogs) (273819) Building response >Thread-7087::INFO::2014-07-08 16:55:02,033::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:55:02,033::__init__::225::IOProcess::(_processLogs) (273819) Queuing response >Thread-7087::DEBUG::2014-07-08 16:55:02,037::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec807fa7-9930-4c0b-bba9-be561e08cdc3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:55:02,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec807fa7-9930-4c0b-bba9-be561e08cdc3`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:55:02,041::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::DEBUG::2014-07-08 16:55:02,042::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:55:02,045::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::DEBUG::2014-07-08 16:55:02,045::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:55:02,049::task::993::Storage.TaskManager.Task::(_decref) Task=`ec807fa7-9930-4c0b-bba9-be561e08cdc3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:55:02,074::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:02,080::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:55:02,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:55:02,091::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:55:02,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:55:02,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7732c25-cba8-4da5-b9e4-fad338f41787`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:55:02,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::INFO::2014-07-08 16:55:02,112::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:02,118::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:02,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:55:02,131::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`70542661-cb2a-4480-828d-37b2e58df40a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:55:02,133::__init__::225::IOProcess::(_processLogs) (273820) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:55:02,135::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:55:02,141::__init__::225::IOProcess::(_processLogs) (273820) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:55:02,146::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:55:02,148::__init__::225::IOProcess::(_processLogs) (273820) Building response >Thread-7083::DEBUG::2014-07-08 16:55:02,153::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`70542661-cb2a-4480-828d-37b2e58df40a`::Granted request >Thread-18::DEBUG::2014-07-08 16:55:02,157::__init__::225::IOProcess::(_processLogs) (273820) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:02,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:55:02,171::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f7732c25-cba8-4da5-b9e4-fad338f41787`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:55:02,173::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:55:02,179::task::993::Storage.TaskManager.Task::(_decref) Task=`f7732c25-cba8-4da5-b9e4-fad338f41787`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:55:02,202::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:02,208::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:55:02,211::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:02,214::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:02,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:02,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:02,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:02,227::__init__::225::IOProcess::(_processLogs) (273821) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:02,230::__init__::225::IOProcess::(_processLogs) (273821) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:02,235::__init__::225::IOProcess::(_processLogs) (273821) Building response >Thread-18::DEBUG::2014-07-08 16:55:02,238::__init__::225::IOProcess::(_processLogs) (273821) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:02,239::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:02,241::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:55:02,247::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:02,249::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:55:02,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 16:55:02,255::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:55:02,258::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7732c25-cba8-4da5-b9e4-fad338f41787`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:55:02,259::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-7083::DEBUG::2014-07-08 16:55:02,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7732c25-cba8-4da5-b9e4-fad338f41787`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:55:02,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:55:02,265::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:55:02,268::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:55:02,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:55:02,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:55:02,275::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:55:02,276::__init__::225::IOProcess::(_processLogs) (273822) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:02,280::__init__::225::IOProcess::(_processLogs) (273822) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:55:02,281::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:55:02,283::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:55:02,283::__init__::225::IOProcess::(_processLogs) (273822) Building response >Thread-7083::DEBUG::2014-07-08 16:55:02,285::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:55:02,287::__init__::225::IOProcess::(_processLogs) (273822) Queuing response >Thread-7083::DEBUG::2014-07-08 16:55:02,290::task::993::Storage.TaskManager.Task::(_decref) Task=`f7732c25-cba8-4da5-b9e4-fad338f41787`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:55:02,290::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:02,294::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:55:02,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7086::DEBUG::2014-07-08 16:55:02,507::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:55:02,511::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:55:02,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564999 s, 18.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:02,923::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:02,924::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:02,926::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:04,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:05,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.115296 s, 8.9 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:55:07,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`ede6e818-39f3-4061-8000-62b19778a384`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:55:07,127::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:55:07,128::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548101', 'lastCheck': '4.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:55:07,128::task::1191::Storage.TaskManager.Task::(prepare) Task=`ede6e818-39f3-4061-8000-62b19778a384`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548101', 'lastCheck': '4.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:55:07,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`ede6e818-39f3-4061-8000-62b19778a384`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:55:07,128::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:55:07,129::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:55:07,129::task::993::Storage.TaskManager.Task::(_decref) Task=`ede6e818-39f3-4061-8000-62b19778a384`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:55:07,165::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:07,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:07,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172708 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:07,934::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:07,935::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:07,936::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:09,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:09,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171409 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:11,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:12,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178806 s, 57.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:55:12,308::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:12,308::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:55:12,309::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:12,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:12,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:12,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:12,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:12,310::__init__::225::IOProcess::(_processLogs) (273823) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:55:12,310::__init__::225::IOProcess::(_processLogs) (273823) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:12,310::__init__::225::IOProcess::(_processLogs) (273823) Building response >Thread-18::DEBUG::2014-07-08 16:55:12,311::__init__::225::IOProcess::(_processLogs) (273823) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:12,311::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:12,311::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:55:12,313::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:55:12,461::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000559274 s, 826 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:55:12,467::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:12,470::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:55:12,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:12,473::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:12,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:12,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:12,486::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-7087::DEBUG::2014-07-08 16:55:12,486::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [3d91d208] >Thread-18::DEBUG::2014-07-08 16:55:12,490::__init__::225::IOProcess::(_processLogs) (273824) Finding callback 'statvfs'... >Thread-7087::DEBUG::2014-07-08 16:55:12,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ae313ff-27fc-4d56-983c-eaef9d82be31`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:55:12,495::__init__::225::IOProcess::(_processLogs) (273824) Got request for method 'statvfs' >Thread-7087::INFO::2014-07-08 16:55:12,499::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:12,501::__init__::225::IOProcess::(_processLogs) (273824) Building response >Thread-18::DEBUG::2014-07-08 16:55:12,504::__init__::225::IOProcess::(_processLogs) (273824) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:12,505::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:12,506::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:55:12,514::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:12,515::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:55:12,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::INFO::2014-07-08 16:55:12,518::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:55:12,521::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::DEBUG::2014-07-08 16:55:12,523::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ae313ff-27fc-4d56-983c-eaef9d82be31`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:55:12,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::DEBUG::2014-07-08 16:55:12,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ae313ff-27fc-4d56-983c-eaef9d82be31`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:55:12,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7087::DEBUG::2014-07-08 16:55:12,530::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:55:12,534::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:55:12,534::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-7087::DEBUG::2014-07-08 16:55:12,538::task::993::Storage.TaskManager.Task::(_decref) Task=`1ae313ff-27fc-4d56-983c-eaef9d82be31`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:55:12,538::__init__::225::IOProcess::(_processLogs) (273825) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:12,540::__init__::225::IOProcess::(_processLogs) (273825) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:12,541::__init__::225::IOProcess::(_processLogs) (273825) Building response >Thread-18::DEBUG::2014-07-08 16:55:12,542::__init__::225::IOProcess::(_processLogs) (273825) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:12,543::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:12,543::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:55:12,544::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:12,544::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:55:12,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:12,545::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:12,545::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:12,545::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:12,546::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:12,546::__init__::225::IOProcess::(_processLogs) (273826) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:12,546::__init__::225::IOProcess::(_processLogs) (273826) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:12,546::__init__::225::IOProcess::(_processLogs) (273826) Building response >Thread-18::DEBUG::2014-07-08 16:55:12,547::__init__::225::IOProcess::(_processLogs) (273826) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:12,547::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:12,547::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:55:12,548::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:12,549::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:55:12,549::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:12,549::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:12,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:12,550::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:12,550::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:12,550::__init__::225::IOProcess::(_processLogs) (273827) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:12,550::__init__::225::IOProcess::(_processLogs) (273827) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:12,551::__init__::225::IOProcess::(_processLogs) (273827) Building response >Thread-18::DEBUG::2014-07-08 16:55:12,551::__init__::225::IOProcess::(_processLogs) (273827) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:12,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:12,551::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:55:12,560::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [3d91d208] >Thread-7083::DEBUG::2014-07-08 16:55:12,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9a24454-2f6d-4d60-91fd-1f16fceba364`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:55:12,562::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:55:12,563::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`51451919-38a2-4f7c-9808-085238324d2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:55:12,563::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:55:12,563::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:55:12,564::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`51451919-38a2-4f7c-9808-085238324d2e`::Granted request >Thread-7083::DEBUG::2014-07-08 16:55:12,564::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f9a24454-2f6d-4d60-91fd-1f16fceba364`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:55:12,564::task::993::Storage.TaskManager.Task::(_decref) Task=`f9a24454-2f6d-4d60-91fd-1f16fceba364`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:55:12,583::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:55:12,584::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9a24454-2f6d-4d60-91fd-1f16fceba364`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:55:12,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9a24454-2f6d-4d60-91fd-1f16fceba364`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:55:12,584::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:55:12,584::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:55:12,585::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:55:12,585::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:55:12,586::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:55:12,586::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:55:12,586::task::993::Storage.TaskManager.Task::(_decref) Task=`f9a24454-2f6d-4d60-91fd-1f16fceba364`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:12,943::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:12,945::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:12,946::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:14,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:14,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172143 s, 59.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:55:16,260::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:55:16,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:16,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0187472 s, 54.6 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:55:17,578::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:55:17,579::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:17,953::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:17,955::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:17,956::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:18,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:18,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196987 s, 52.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:20,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:21,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0909065 s, 11.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:55:22,554::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:22,555::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:55:22,555::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:22,555::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:22,556::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:22,556::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:22,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:22,556::__init__::225::IOProcess::(_processLogs) (273828) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:55:22,557::__init__::225::IOProcess::(_processLogs) (273828) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:22,557::__init__::225::IOProcess::(_processLogs) (273828) Building response >Thread-18::DEBUG::2014-07-08 16:55:22,557::__init__::225::IOProcess::(_processLogs) (273828) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:22,557::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:22,558::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:55:22,559::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:55:22,713::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000445855 s, 1.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:55:22,717::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:55:22,726::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 16:55:22,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`69f4f98a-d7a1-4b78-bfff-f6dfb2753b92`::moving from state init -> state preparing >Thread-7087::DEBUG::2014-07-08 16:55:22,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4972723-0ba1-4903-9f99-63e6a5092847`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:55:22,732::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::INFO::2014-07-08 16:55:22,733::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:55:22,733::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 16:55:22,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559274', 'lastCheck': '10.2', 'valid': True}} >Thread-18::DEBUG::2014-07-08 16:55:22,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::DEBUG::2014-07-08 16:55:22,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4972723-0ba1-4903-9f99-63e6a5092847`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559274', 'lastCheck': '10.2', 'valid': True}} >Thread-18::DEBUG::2014-07-08 16:55:22,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::DEBUG::2014-07-08 16:55:22,740::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4972723-0ba1-4903-9f99-63e6a5092847`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:55:22,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::DEBUG::2014-07-08 16:55:22,741::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:55:22,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:55:22,743::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-7087::DEBUG::2014-07-08 16:55:22,744::task::993::Storage.TaskManager.Task::(_decref) Task=`b4972723-0ba1-4903-9f99-63e6a5092847`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:55:22,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:22,746::__init__::225::IOProcess::(_processLogs) (273829) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:55:22,748::__init__::225::IOProcess::(_processLogs) (273829) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:22,750::__init__::225::IOProcess::(_processLogs) (273829) Building response >Thread-7082::INFO::2014-07-08 16:55:22,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:55:22,755::__init__::225::IOProcess::(_processLogs) (273829) Queuing response >Thread-7082::DEBUG::2014-07-08 16:55:22,757::task::1191::Storage.TaskManager.Task::(prepare) Task=`69f4f98a-d7a1-4b78-bfff-f6dfb2753b92`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:55:22,760::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 16:55:22,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`69f4f98a-d7a1-4b78-bfff-f6dfb2753b92`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:55:22,763::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 16:55:22,763::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:55:22,766::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:55:22,770::task::993::Storage.TaskManager.Task::(_decref) Task=`69f4f98a-d7a1-4b78-bfff-f6dfb2753b92`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:55:22,780::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:22,782::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:55:22,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:22,785::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:22,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:22,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:22,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:22,790::__init__::225::IOProcess::(_processLogs) (273830) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:22,792::__init__::225::IOProcess::(_processLogs) (273830) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:22,793::__init__::225::IOProcess::(_processLogs) (273830) Building response >Thread-18::DEBUG::2014-07-08 16:55:22,794::__init__::225::IOProcess::(_processLogs) (273830) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:22,795::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:22,795::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:55:22,796::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:22,797::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:55:22,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:22,798::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:22,799::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:55:22,800::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:55:22,802::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:22,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:55:22,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`6330f6e3-8187-453d-8fa8-1389ec26cdc5`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:55:22,805::__init__::225::IOProcess::(_processLogs) (273831) Finding callback 'access'... >Thread-7083::INFO::2014-07-08 16:55:22,805::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:22,806::__init__::225::IOProcess::(_processLogs) (273831) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:22,808::__init__::225::IOProcess::(_processLogs) (273831) Building response >Thread-7083::DEBUG::2014-07-08 16:55:22,809::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6e2f0b20-74e6-4cd0-b3e8-239a85bd5a36`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:55:22,810::__init__::225::IOProcess::(_processLogs) (273831) Queuing response >Thread-7083::DEBUG::2014-07-08 16:55:22,810::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:55:22,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:55:22,812::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:55:22,814::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6e2f0b20-74e6-4cd0-b3e8-239a85bd5a36`::Granted request >Thread-18::DEBUG::2014-07-08 16:55:22,814::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:55:22,821::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6330f6e3-8187-453d-8fa8-1389ec26cdc5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:55:22,827::task::993::Storage.TaskManager.Task::(_decref) Task=`6330f6e3-8187-453d-8fa8-1389ec26cdc5`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:55:22,836::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-7087::DEBUG::2014-07-08 16:55:22,844::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:55:22,845::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:55:22,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:22,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:22,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:22,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:22,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:22,886::__init__::225::IOProcess::(_processLogs) (273832) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:22,891::__init__::225::IOProcess::(_processLogs) (273832) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:22,895::__init__::225::IOProcess::(_processLogs) (273832) Building response >Thread-18::DEBUG::2014-07-08 16:55:22,909::__init__::225::IOProcess::(_processLogs) (273832) Queuing response >Thread-7083::INFO::2014-07-08 16:55:22,910::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:55:22,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:55:22,916::task::1191::Storage.TaskManager.Task::(prepare) Task=`6330f6e3-8187-453d-8fa8-1389ec26cdc5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:55:22,919::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:55:22,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`6330f6e3-8187-453d-8fa8-1389ec26cdc5`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:55:22,928::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:55:22,932::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:55:22,943::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:55:22,952::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:55:22,956::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:55:22,960::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:22,969::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7083::DEBUG::2014-07-08 16:55:22,973::task::993::Storage.TaskManager.Task::(_decref) Task=`6330f6e3-8187-453d-8fa8-1389ec26cdc5`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:22,985::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:23,001::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:23,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:23,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174426 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:25,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:25,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175426 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:27,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:28,043::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:28,049::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:28,054::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:28,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386863 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:30,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:30,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173082 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:32,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:32,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173777 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:55:32,676::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:55:32,677::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 16:55:32,941::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:32,941::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:55:32,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:32,942::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:32,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:32,943::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:32,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:32,943::__init__::225::IOProcess::(_processLogs) (273833) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:55:32,943::__init__::225::IOProcess::(_processLogs) (273833) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:32,944::__init__::225::IOProcess::(_processLogs) (273833) Building response >Thread-18::DEBUG::2014-07-08 16:55:32,944::__init__::225::IOProcess::(_processLogs) (273833) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:32,944::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:32,944::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:55:32,946::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:55:33,112::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:33,113::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-37::DEBUG::2014-07-08 16:55:33,114::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000580784 s, 795 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:55:33,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0e979da-887f-438c-80ea-18b925b55ee1`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:55:33,138::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:33,147::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::INFO::2014-07-08 16:55:33,146::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:33,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:33,160::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:55:33,166::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:33,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::INFO::2014-07-08 16:55:33,175::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:55:33,176::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7087::DEBUG::2014-07-08 16:55:33,184::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0e979da-887f-438c-80ea-18b925b55ee1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:55:33,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0e979da-887f-438c-80ea-18b925b55ee1`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:55:33,190::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-7087::DEBUG::2014-07-08 16:55:33,195::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:33,196::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:55:33,200::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:55:33,202::__init__::225::IOProcess::(_processLogs) (273834) Finding callback 'statvfs'... >Thread-7087::DEBUG::2014-07-08 16:55:33,207::task::993::Storage.TaskManager.Task::(_decref) Task=`e0e979da-887f-438c-80ea-18b925b55ee1`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:55:33,212::__init__::225::IOProcess::(_processLogs) (273834) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:33,223::__init__::225::IOProcess::(_processLogs) (273834) Building response >Thread-18::DEBUG::2014-07-08 16:55:33,229::__init__::225::IOProcess::(_processLogs) (273834) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:33,234::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:33,239::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:55:33,246::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:55:33,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fdd68a2-d195-4630-8334-022751732010`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:55:33,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:33,274::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:33,284::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 16:55:33,288::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e132994f-738e-4fa8-9f98-8705bc60b172`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:55:33,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:55:33,293::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:55:33,303::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:55:33,308::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:55:33,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:55:33,310::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e132994f-738e-4fa8-9f98-8705bc60b172`::Granted request >Thread-18::DEBUG::2014-07-08 16:55:33,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:33,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:33,317::__init__::225::IOProcess::(_processLogs) (273835) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:55:33,318::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7fdd68a2-d195-4630-8334-022751732010`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:55:33,320::__init__::225::IOProcess::(_processLogs) (273835) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:55:33,321::task::993::Storage.TaskManager.Task::(_decref) Task=`7fdd68a2-d195-4630-8334-022751732010`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:55:33,323::__init__::225::IOProcess::(_processLogs) (273835) Building response >Thread-18::DEBUG::2014-07-08 16:55:33,327::__init__::225::IOProcess::(_processLogs) (273835) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:33,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:33,335::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:55:33,349::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:33,352::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:55:33,355::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:33,358::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:33,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:33,363::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:33,368::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:33,370::__init__::225::IOProcess::(_processLogs) (273836) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:33,371::__init__::225::IOProcess::(_processLogs) (273836) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:33,371::__init__::225::IOProcess::(_processLogs) (273836) Building response >Thread-18::DEBUG::2014-07-08 16:55:33,372::__init__::225::IOProcess::(_processLogs) (273836) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:33,372::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:33,372::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:55:33,375::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:33,375::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:55:33,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:33,376::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:33,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:33,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:33,379::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:33,380::__init__::225::IOProcess::(_processLogs) (273837) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:33,380::__init__::225::IOProcess::(_processLogs) (273837) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:33,386::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(273837) Building response >Thread-7083::INFO::2014-07-08 16:55:33,389::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:55:33,391::task::1191::Storage.TaskManager.Task::(prepare) Task=`7fdd68a2-d195-4630-8334-022751732010`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:55:33,392::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|(273837) Queuing response >Thread-7083::DEBUG::2014-07-08 16:55:33,393::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fdd68a2-d195-4630-8334-022751732010`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:55:33,395::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:55:33,396::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:55:33,399::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:55:33,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:55:33,400::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:55:33,402::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:55:33,402::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:55:33,402::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:55:33,407::task::993::Storage.TaskManager.Task::(_decref) Task=`7fdd68a2-d195-4630-8334-022751732010`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:55:34,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:34,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373024 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:37,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:37,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150743 s, 6.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:55:38,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`991aa1c3-963d-4bf3-a492-53625946b712`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:55:38,025::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:55:38,025::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580784', 'lastCheck': '4.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:55:38,026::task::1191::Storage.TaskManager.Task::(prepare) Task=`991aa1c3-963d-4bf3-a492-53625946b712`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580784', 'lastCheck': '4.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:55:38,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`991aa1c3-963d-4bf3-a492-53625946b712`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:55:38,026::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:55:38,026::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:55:38,027::task::993::Storage.TaskManager.Task::(_decref) Task=`991aa1c3-963d-4bf3-a492-53625946b712`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 16:55:38,074::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:38,229::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:38,231::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:38,232::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:39,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:39,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175878 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:41,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:42,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017475 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:43,239::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:43,240::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:43,241::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:55:43,412::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:43,413::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:55:43,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:43,413::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:43,413::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:43,414::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:43,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:43,414::__init__::225::IOProcess::(_processLogs) (273838) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:55:43,414::__init__::225::IOProcess::(_processLogs) (273838) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:43,415::__init__::225::IOProcess::(_processLogs) (273838) Building response >Thread-18::DEBUG::2014-07-08 16:55:43,415::__init__::225::IOProcess::(_processLogs) (273838) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:43,415::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:55:43,416::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:55:43,417::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:55:43,575::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000558716 s, 827 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:55:43,578::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:55:43,583::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:43,586::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:55:43,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::DEBUG::2014-07-08 16:55:43,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5598f5a-4085-49e0-8c9e-c8df8c6a266e`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:55:43,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::INFO::2014-07-08 16:55:43,594::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:43,596::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:43,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:43,600::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:43,602::__init__::225::IOProcess::(_processLogs) (273839) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:55:43,604::__init__::225::IOProcess::(_processLogs) (273839) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:43,606::__init__::225::IOProcess::(_processLogs) (273839) Building response >Thread-18::DEBUG::2014-07-08 16:55:43,607::__init__::225::IOProcess::(_processLogs) (273839) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:43,609::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:43,610::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::INFO::2014-07-08 16:55:43,613::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:55:43,616::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5598f5a-4085-49e0-8c9e-c8df8c6a266e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:55:43,618::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5598f5a-4085-49e0-8c9e-c8df8c6a266e`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:55:43,620::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:55:43,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:55:43,625::task::993::Storage.TaskManager.Task::(_decref) Task=`a5598f5a-4085-49e0-8c9e-c8df8c6a266e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:55:43,628::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:43,632::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:55:43,634::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:43,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:43,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:43,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:43,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:43,641::__init__::225::IOProcess::(_processLogs) (273840) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:43,643::__init__::225::IOProcess::(_processLogs) (273840) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:43,644::__init__::225::IOProcess::(_processLogs) (273840) Building response >Thread-18::DEBUG::2014-07-08 16:55:43,645::__init__::225::IOProcess::(_processLogs) (273840) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:43,647::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:55:43,649::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:55:43,657::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:55:43,659::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:55:43,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ad57a6b-d600-4d4d-a70a-00e8b1140c60`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:55:43,664::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::INFO::2014-07-08 16:55:43,666::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:43,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:43,673::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:55:43,674::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e1f80a7c-8971-415d-aef5-4dbd4a5f3d5b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:55:43,676::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:55:43,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:43,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:55:43,681::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:55:43,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:55:43,684::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e1f80a7c-8971-415d-aef5-4dbd4a5f3d5b`::Granted request >Thread-18::DEBUG::2014-07-08 16:55:43,686::__init__::225::IOProcess::(_processLogs) (273841) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:43,694::__init__::225::IOProcess::(_processLogs) (273841) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:43,697::__init__::225::IOProcess::(_processLogs) (273841) Building response >Thread-7083::DEBUG::2014-07-08 16:55:43,697::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6ad57a6b-d600-4d4d-a70a-00e8b1140c60`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:55:43,699::__init__::225::IOProcess::(_processLogs) (273841) Queuing response >Thread-7083::DEBUG::2014-07-08 16:55:43,700::task::993::Storage.TaskManager.Task::(_decref) Task=`6ad57a6b-d600-4d4d-a70a-00e8b1140c60`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:55:43,702::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:43,706::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:55:43,719::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:43,725::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:55:43,730::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:43,736::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:43,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:43,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:43,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:43,743::__init__::225::IOProcess::(_processLogs) (273842) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:43,744::__init__::225::IOProcess::(_processLogs) (273842) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:43,746::__init__::225::IOProcess::(_processLogs) (273842) Building response >Thread-18::DEBUG::2014-07-08 16:55:43,747::__init__::225::IOProcess::(_processLogs) (273842) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:43,749::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::INFO::2014-07-08 16:55:43,755::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:55:43,757::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:55:43,763::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ad57a6b-d600-4d4d-a70a-00e8b1140c60`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:55:43,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ad57a6b-d600-4d4d-a70a-00e8b1140c60`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:55:43,776::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:55:43,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:55:43,790::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:55:43,797::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:55:43,799::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:55:43,802::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:55:43,809::task::993::Storage.TaskManager.Task::(_decref) Task=`6ad57a6b-d600-4d4d-a70a-00e8b1140c60`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:55:44,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:44,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175917 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:46,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-07-08 16:55:46,677::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:55:46,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174266 s, 58.8 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:55:47,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`255cee8e-f535-4191-ab76-cf34f524e51c`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:55:47,696::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:55:47,698::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:47,698::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:55:47,699::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:47,699::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:47,699::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:47,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:47,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:47,700::__init__::225::IOProcess::(_processLogs) (273843) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:55:47,700::__init__::225::IOProcess::(_processLogs) (273843) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:55:47,700::__init__::225::IOProcess::(_processLogs) (273843) Building response >Thread-18::DEBUG::2014-07-08 16:55:47,700::__init__::225::IOProcess::(_processLogs) (273843) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:47,701::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:47,701::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:55:47,703::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:47,703::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:55:47,704::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:47,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:47,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:47,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:47,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:47,705::__init__::225::IOProcess::(_processLogs) (273844) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:55:47,705::__init__::225::IOProcess::(_processLogs) (273844) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:55:47,705::__init__::225::IOProcess::(_processLogs) (273844) Building response >Thread-18::DEBUG::2014-07-08 16:55:47,705::__init__::225::IOProcess::(_processLogs) (273844) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:47,706::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:47,706::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:55:47,707::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:55:47,707::task::1191::Storage.TaskManager.Task::(prepare) Task=`255cee8e-f535-4191-ab76-cf34f524e51c`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:55:47,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`255cee8e-f535-4191-ab76-cf34f524e51c`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:55:47,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:55:47,708::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:55:47,708::task::993::Storage.TaskManager.Task::(_decref) Task=`255cee8e-f535-4191-ab76-cf34f524e51c`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:55:47,801::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:55:47,801::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:48,300::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:48,303::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:48,304::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:48,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:49,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177032 s, 57.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:51,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:51,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01749 s, 58.5 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:55:53,286::task::595::Storage.TaskManager.Task::(_updateState) Task=`8674b7f4-1589-495d-a4ef-cc956e1fa427`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 16:55:53,286::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 16:55:53,287::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558716', 'lastCheck': '9.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:55:53,287::task::1191::Storage.TaskManager.Task::(prepare) Task=`8674b7f4-1589-495d-a4ef-cc956e1fa427`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558716', 'lastCheck': '9.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 16:55:53,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`8674b7f4-1589-495d-a4ef-cc956e1fa427`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:55:53,288::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:55:53,288::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:55:53,288::task::993::Storage.TaskManager.Task::(_decref) Task=`8674b7f4-1589-495d-a4ef-cc956e1fa427`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:55:53,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:53,553::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 16:55:53,562::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:53,568::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:53,580::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:55:53,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.14355 s, 7.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:55:53,788::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:53,789::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:55:53,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:53,790::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:53,790::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:53,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:53,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:53,791::__init__::225::IOProcess::(_processLogs) (273845) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:55:53,791::__init__::225::IOProcess::(_processLogs) (273845) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:53,791::__init__::225::IOProcess::(_processLogs) (273845) Building response >Thread-18::DEBUG::2014-07-08 16:55:53,792::__init__::225::IOProcess::(_processLogs) (273845) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:53,792::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:53,792::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:55:53,794::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 16:55:54,093::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [7bf61fec] >Thread-37::DEBUG::2014-07-08 16:55:54,096::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000502844 s, 919 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:55:54,111::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-7087::DEBUG::2014-07-08 16:55:54,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`a925ea01-794c-4517-bc65-97677c60e884`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:55:54,118::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::INFO::2014-07-08 16:55:54,120::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:54,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:54,130::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:54,133::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:54,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:54,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::INFO::2014-07-08 16:55:54,142::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:55:54,147::task::1191::Storage.TaskManager.Task::(prepare) Task=`a925ea01-794c-4517-bc65-97677c60e884`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:55:54,147::__init__::225::IOProcess::(_processLogs) (273846) Finding callback 'statvfs'... >Thread-7087::DEBUG::2014-07-08 16:55:54,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`a925ea01-794c-4517-bc65-97677c60e884`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 16:55:54,155::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 16:55:54,157::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 16:55:54,161::task::993::Storage.TaskManager.Task::(_decref) Task=`a925ea01-794c-4517-bc65-97677c60e884`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:55:54,158::__init__::225::IOProcess::(_processLogs) (273846) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:55:54,169::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|(273846) Building response >Thread-18::DEBUG::2014-07-08 16:55:54,174::__init__::225::IOProcess::(_processLogs) (273846) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:54,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:54,180::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:55:54,191::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [7bf61fec] >Thread-7083::DEBUG::2014-07-08 16:55:54,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`8de6de63-04d4-48a7-a996-ce92f6a660a7`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:55:54,204::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:55:54,220::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:55:54,225::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2d4269bb-e172-4c34-aef5-f8068b7d853a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:55:54,226::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 16:55:54,229::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:55:54,233::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:55:54,235::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:55:54,236::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:55:54,238::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2d4269bb-e172-4c34-aef5-f8068b7d853a`::Granted request >Thread-18::DEBUG::2014-07-08 16:55:54,238::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:54,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:54,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:54,247::__init__::225::IOProcess::(_processLogs) (273847) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:55:54,248::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8de6de63-04d4-48a7-a996-ce92f6a660a7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:55:54,251::__init__::225::IOProcess::(_processLogs) (273847) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:55:54,252::task::993::Storage.TaskManager.Task::(_decref) Task=`8de6de63-04d4-48a7-a996-ce92f6a660a7`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:55:54,254::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|(273847) Building response >Thread-18::DEBUG::2014-07-08 16:55:54,257::__init__::225::IOProcess::(_processLogs) (273847) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:54,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:54,266::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:55:54,277::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:54,280::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:55:54,283::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:55:54,287::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:55:54,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:55:54,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:55:54,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:54,298::__init__::225::IOProcess::(_processLogs) (273848) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:55:54,299::__init__::225::IOProcess::(_processLogs) (273848) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:55:54,300::__init__::225::IOProcess::(_processLogs) (273848) Building response >Thread-18::DEBUG::2014-07-08 16:55:54,303::__init__::225::IOProcess::(_processLogs) (273848) Queuing response >Thread-18::DEBUG::2014-07-08 16:55:54,305::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:55:54,306::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:55:54,311::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:55:54,315::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:55:54,317::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:55:54,317::task::1191::Storage.TaskManager.Task::(prepare) Task=`8de6de63-04d4-48a7-a996-ce92f6a660a7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:55:54,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:55:54,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`8de6de63-04d4-48a7-a996-ce92f6a660a7`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:55:54,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:55:54,324::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:55:54,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:55:54,326::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:55:54,329::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:55:54,331::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:55:54,332::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:55:54,335::__init__::225::IOProcess::(_processLogs) (273849) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:55:54,335::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:55:54,338::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:55:54,338::__init__::225::IOProcess::(_processLogs) (273849) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:55:54,340::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:55:54,340::__init__::225::IOProcess::(_processLogs) (273849) Building response >Thread-18::DEBUG::2014-07-08 16:55:54,343::__init__::225::IOProcess::(_processLogs) (273849) Queuing response >Thread-7083::DEBUG::2014-07-08 16:55:54,344::task::993::Storage.TaskManager.Task::(_decref) Task=`8de6de63-04d4-48a7-a996-ce92f6a660a7`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:55:54,347::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:55:54,350::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:55:55,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:56,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171629 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:55:58,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:55:58,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204286 s, 50.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:58,596::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:58,597::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:55:58,598::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:55:58,950::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7087::DEBUG::2014-07-08 16:55:58,952::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call setupNetworks with ({'net5': {'nic': 'eth3', 'vlan': '5', 'ipaddr': '1.1.1.1', 'mtu': '1500', 'netmask': '255.255.255.0', 'STP': 'no', 'bridged': 'true'}}, {}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:55:58,953::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7082::DEBUG::2014-07-08 16:55:59,462::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:55:59,465::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7082::DEBUG::2014-07-08 16:55:59,971::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:55:59,972::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-6860::DEBUG::2014-07-08 16:56:00,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:56:00,504::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:56:00,505::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-6860::DEBUG::2014-07-08 16:56:00,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174135 s, 58.8 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:56:01,044::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:56:01,047::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7082::DEBUG::2014-07-08 16:56:01,553::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:56:01,554::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7082::DEBUG::2014-07-08 16:56:02,059::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:56:02,060::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7082::DEBUG::2014-07-08 16:56:02,565::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:56:02,566::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-6860::DEBUG::2014-07-08 16:56:02,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:02,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179784 s, 57.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:56:03,090::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:56:03,091::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7086::DEBUG::2014-07-08 16:56:03,249::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:56:03,249::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:03,608::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:56:03,610::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:56:03,612::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:03,616::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:03,619::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:56:04,122::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [1655a8c0] >Thread-7082::DEBUG::2014-07-08 16:56:04,123::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7087::DEBUG::2014-07-08 16:56:04,149::BindingXMLRPC::1114::vds::(wrapper) return setupNetworks with {'status': {'message': 'Done', 'code': 0}} >Thread-18::DEBUG::2014-07-08 16:56:04,359::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:04,360::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:56:04,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:04,360::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:04,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:04,361::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:04,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:04,361::__init__::225::IOProcess::(_processLogs) (273850) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:04,362::__init__::225::IOProcess::(_processLogs) (273850) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:04,362::__init__::225::IOProcess::(_processLogs) (273850) Building response >Thread-18::DEBUG::2014-07-08 16:56:04,362::__init__::225::IOProcess::(_processLogs) (273850) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:04,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:04,363::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:56:04,365::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:56:04,532::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000730242 s, 633 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:56:04,618::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:56:04,655::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 16:56:04,658::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call getCapabilities with () {} flowID [1655a8c0] >Thread-7087::DEBUG::2014-07-08 16:56:04,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1e372ab-0128-4a45-a03a-92ff5c2c317e`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:56:04,668::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::INFO::2014-07-08 16:56:04,675::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:56:04,680::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:04,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:04,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:04,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 16:56:04,706::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-7087::INFO::2014-07-08 16:56:04,707::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:56:04,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::DEBUG::2014-07-08 16:56:04,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1e372ab-0128-4a45-a03a-92ff5c2c317e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 16:56:04,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1e372ab-0128-4a45-a03a-92ff5c2c317e`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:56:04,883::__init__::225::IOProcess::(_processLogs) (273851) Finding callback 'statvfs'... >Thread-7087::DEBUG::2014-07-08 16:56:04,884::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Dummy-6860::DEBUG::2014-07-08 16:56:04,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:56:04,990::__init__::225::IOProcess::(_processLogs) (273851) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 16:56:04,989::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 16:56:05,154::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:56:05,168::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|(273851) Building response >Thread-7087::DEBUG::2014-07-08 16:56:05,178::task::993::Storage.TaskManager.Task::(_decref) Task=`f1e372ab-0128-4a45-a03a-92ff5c2c317e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:56:05,186::__init__::225::IOProcess::(_processLogs) (273851) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:05,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:05,215::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:56:05,252::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:56:05,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`151c82f8-5615-404c-868f-c87cdb241857`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:56:05,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:56:05,294::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:05,310::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 16:56:05,318::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f3f3b3e9-8b96-4566-808e-26ea73698173`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:56:05,326::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:56:05,327::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:56:05,343::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:56:05,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:56:05,354::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f3f3b3e9-8b96-4566-808e-26ea73698173`::Granted request >Thread-18::DEBUG::2014-07-08 16:56:05,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:05,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:56:05,380::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`151c82f8-5615-404c-868f-c87cdb241857`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:56:05,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:56:05,392::task::993::Storage.TaskManager.Task::(_decref) Task=`151c82f8-5615-404c-868f-c87cdb241857`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:56:05,406::__init__::225::IOProcess::(_processLogs) (273852) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:05,418::__init__::225::IOProcess::(_processLogs) (273852) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:05,429::__init__::225::IOProcess::(_processLogs) (273852) Building response >Thread-18::DEBUG::2014-07-08 16:56:05,434::__init__::225::IOProcess::(_processLogs) (273852) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:05,438::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:05,450::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:56:05,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.290921 s, 3.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:56:05,557::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:05,567::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:56:05,573::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:05,578::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:05,587::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:05,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:05,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:05,606::__init__::225::IOProcess::(_processLogs) (273853) Finding callback 'access'... >Thread-7083::INFO::2014-07-08 16:56:05,609::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:56:05,610::__init__::225::IOProcess::(_processLogs) (273853) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:05,622::__init__::225::IOProcess::(_processLogs) (273853) Building response >Thread-7083::DEBUG::2014-07-08 16:56:05,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`151c82f8-5615-404c-868f-c87cdb241857`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:05,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`151c82f8-5615-404c-868f-c87cdb241857`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:56:05,630::__init__::225::IOProcess::(_processLogs) (273853) Queuing response >Thread-7083::DEBUG::2014-07-08 16:56:05,638::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:56:05,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 16:56:05,645::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:56:05,649::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:56:05,665::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 16:56:05,679::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:56:05,680::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:56:05,687::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:56:05,688::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:56:05,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:56:05,696::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:56:05,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:05,712::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:56:05,714::task::993::Storage.TaskManager.Task::(_decref) Task=`151c82f8-5615-404c-868f-c87cdb241857`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:56:05,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:05,729::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:05,738::__init__::225::IOProcess::(_processLogs) (273854) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:05,747::__init__::225::IOProcess::(_processLogs) (273854) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:05,756::__init__::225::IOProcess::(_processLogs) (273854) Building response >Thread-18::DEBUG::2014-07-08 16:56:05,764::__init__::225::IOProcess::(_processLogs) (273854) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:05,769::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:05,774::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 16:56:06,111::BindingXMLRPC::1114::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:orange-vdsc'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.17.1.el6.x86_64', 'buildtime': 1397226420.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '3.git601f786.el6', 'buildtime': 1404118673L, 'version': '4.16.0'}, 'qemu-kvm': {'release': '2.415.el6_5.11', 'buildtime': 1403019242L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.11', 'buildtime': 1403019242L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Dual-Core AMD Opteron(tm) Processor 2210', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}, '10_faqemu': {'md5': 'e3cb338be6b9075a04bed0e7400ab7e2'}, '50_nestedvt': {'md5': '1eb86fc52cea5ee7812978176ce2d545'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 1, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.128.17', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745e/64'], 'gateway': '10.35.128.254', 'bootproto4': 'none', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.128.17/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}, 'net5': {'iface': 'net5', 'addr': '1.1.1.1', 'cfg': {'DEFROUTE': 'no', 'IPADDR': '1.1.1.1', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net5', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'gateway': '', 'bootproto4': 'none', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['1.1.1.1/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth3.5']}, 'net3': {'iface': 'net3', 'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net3', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'gateway': '', 'bootproto4': 'none', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth3.4093']}, 'net1': {'iface': 'net1', 'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net1', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745f/64'], 'gateway': '', 'bootproto4': 'none', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['bond0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.128.17', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745e/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.128.17/24'], 'ipv6gateway': '::', 'gateway': '10.35.128.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '129', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745e', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745e', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '28', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}, 'net5': {'addr': '1.1.1.1', 'cfg': {'DEFROUTE': 'no', 'IPADDR': '1.1.1.1', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net5', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['1.1.1.1/24'], 'ipv6gateway': '::', 'gateway': '', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '118', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745d', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745d', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '18', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth3.5']}, 'net3': {'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net3', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': '', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '126', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745d', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745d', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '26', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth3.4093']}, 'net1': {'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net1', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745f/64'], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': '', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '23', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745f', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745f', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '23', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['bond0']}}, 'uuid': '007EF314-A079-0010-A38A-0016367B3DFE', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth3': {'addr': '', 'cfg': {'DEVICE': 'eth3', 'HWADDR': '00:16:36:84:74:5d', 'ONBOOT': 'no', 'NM_CONTROLLED': 'no', 'MTU': '1500'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5d', 'speed': 1000}, 'eth2': {'permhwaddr': '00:16:36:84:74:5C', 'addr': '', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '5000', 'HWADDR': '00:16:36:84:74:5c', 'MASTER': 'bond0', 'DEVICE': 'eth2', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5f', 'speed': 1000}, 'eth1': {'permhwaddr': '00:16:36:84:74:5F', 'addr': '', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '5000', 'HWADDR': '00:16:36:84:74:5f', 'MASTER': 'bond0', 'DEVICE': 'eth1', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '5000', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5f', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:16:36:84:74:5e', 'DEVICE': 'eth0', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5e', 'speed': 0}}, 'software_revision': '3', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ht,syscall,nx,mmxext,fxsr_opt,rdtscp,lm,3dnowext,3dnow,rep_good,extd_apicid,pni,cx16,lahf_lm,cmp_legacy,svm,extapic,cr8_legacy,model_athlon,model_Opteron_G1,model_Opteron_G2', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:orange-vdsc', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond0': {'addr': '', 'cfg': {'BRIDGE': 'net1', 'HOTPLUG': 'no', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BONDING_OPTS': 'mode=1 miimon=100', 'DEVICE': 'bond0', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745f/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5f', 'slaves': ['eth1', 'eth2'], 'opts': {'miimon': '100', 'mode': '1'}}, 'bond1': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond2': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond3': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}}, 'software_version': '4.16', 'memSize': '3830', 'cpuSpeed': '1809.257', 'numaNodes': {u'0': {'totalMemory': '3830', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {'eth3.5': {'iface': 'eth3', 'addr': '', 'cfg': {'BRIDGE': 'net5', 'VLAN': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'DEVICE': 'eth3.5', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'vlanid': 5, 'mtu': '1500', 'netmask': '', 'ipv4addrs': []}, 'eth3.4093': {'iface': 'eth3', 'addr': '', 'cfg': {'BRIDGE': 'net3', 'VLAN': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'DEVICE': 'eth3.4093', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'vlanid': 4093, 'mtu': '1500', 'netmask': '', 'ipv4addrs': []}}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.162.23'}} >Thread-7082::DEBUG::2014-07-08 16:56:06,529::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call setSafeNetworkConfig with () {} flowID [5dd15c40] >Thread-7082::DEBUG::2014-07-08 16:56:06,585::BindingXMLRPC::1114::vds::(wrapper) return setSafeNetworkConfig with {'status': {'message': 'Done', 'code': 0}} >Dummy-6860::DEBUG::2014-07-08 16:56:08,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:08,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0238485 s, 42.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:08,627::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:08,628::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:08,629::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:56:08,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`d281bd55-b709-4f36-a859-d358ceab5eff`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:56:08,852::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:56:08,853::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730242', 'lastCheck': '3.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:56:08,853::task::1191::Storage.TaskManager.Task::(prepare) Task=`d281bd55-b709-4f36-a859-d358ceab5eff`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730242', 'lastCheck': '3.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:56:08,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`d281bd55-b709-4f36-a859-d358ceab5eff`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:56:08,853::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:56:08,854::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:56:08,854::task::993::Storage.TaskManager.Task::(_decref) Task=`d281bd55-b709-4f36-a859-d358ceab5eff`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:56:08,914::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:10,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:10,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173948 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:56:12,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:13,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175012 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:13,639::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:13,644::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:13,649::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:15,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:15,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174336 s, 58.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:56:15,825::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 16:56:15,826::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:56:15,828::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:56:15,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 16:56:15,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`90d873b3-8c37-4d40-8308-0b593f05d19f`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:56:15,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::INFO::2014-07-08 16:56:15,833::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:56:15,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:15,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:15,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:15,836::__init__::225::IOProcess::(_processLogs) (273855) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:15,836::__init__::225::IOProcess::(_processLogs) (273855) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:15,836::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|(273855) Building response >Thread-18::DEBUG::2014-07-08 16:56:15,837::__init__::225::IOProcess::(_processLogs) (273855) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:15,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:15,840::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:56:15,843::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::INFO::2014-07-08 16:56:15,993::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 16:56:15,999::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000556202 s, 831 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:56:15,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`90d873b3-8c37-4d40-8308-0b593f05d19f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:56:16,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`90d873b3-8c37-4d40-8308-0b593f05d19f`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:56:16,004::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 16:56:16,005::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:56:16,006::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::DEBUG::2014-07-08 16:56:16,007::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:56:16,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:16,009::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 16:56:16,009::task::993::Storage.TaskManager.Task::(_decref) Task=`90d873b3-8c37-4d40-8308-0b593f05d19f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:56:16,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:16,012::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:16,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:16,015::__init__::225::IOProcess::(_processLogs) (273856) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:16,016::__init__::225::IOProcess::(_processLogs) (273856) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:16,016::__init__::225::IOProcess::(_processLogs) (273856) Building response >Thread-18::DEBUG::2014-07-08 16:56:16,017::__init__::225::IOProcess::(_processLogs) (273856) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:16,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:16,017::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:56:16,019::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:16,020::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:56:16,020::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:16,020::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:16,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:16,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:16,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:16,021::__init__::225::IOProcess::(_processLogs) (273857) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:16,021::__init__::225::IOProcess::(_processLogs) (273857) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:16,022::__init__::225::IOProcess::(_processLogs) (273857) Building response >Thread-18::DEBUG::2014-07-08 16:56:16,022::__init__::225::IOProcess::(_processLogs) (273857) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:16,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:16,022::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:56:16,023::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:16,024::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:56:16,024::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:16,024::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:16,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:16,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:16,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:16,025::__init__::225::IOProcess::(_processLogs) (273858) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:16,025::__init__::225::IOProcess::(_processLogs) (273858) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:16,026::__init__::225::IOProcess::(_processLogs) (273858) Building response >Thread-18::DEBUG::2014-07-08 16:56:16,026::__init__::225::IOProcess::(_processLogs) (273858) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:16,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:16,028::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:56:16,029::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:56:16,033::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c887d8f-4943-4ad0-b42c-033a557fce44`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:56:16,035::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:56:16,036::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 16:56:16,039::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55c936d8-cc8d-4dfa-88e9-81766a75631a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:56:16,039::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 16:56:16,040::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:56:16,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:56:16,042::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:56:16,043::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:56:16,043::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55c936d8-cc8d-4dfa-88e9-81766a75631a`::Granted request >Thread-18::DEBUG::2014-07-08 16:56:16,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:16,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:56:16,047::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7c887d8f-4943-4ad0-b42c-033a557fce44`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:56:16,048::task::993::Storage.TaskManager.Task::(_decref) Task=`7c887d8f-4943-4ad0-b42c-033a557fce44`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:56:16,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:16,050::__init__::225::IOProcess::(_processLogs) (273859) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:16,052::__init__::225::IOProcess::(_processLogs) (273859) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:16,054::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|(273859) Building response >Thread-18::DEBUG::2014-07-08 16:56:16,056::__init__::225::IOProcess::(_processLogs) (273859) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:16,057::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:16,059::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 16:56:16,079::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:16,080::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c887d8f-4943-4ad0-b42c-033a557fce44`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:16,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c887d8f-4943-4ad0-b42c-033a557fce44`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:56:16,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:56:16,081::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:56:16,081::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:56:16,081::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:56:16,082::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:56:16,082::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:56:16,082::task::993::Storage.TaskManager.Task::(_decref) Task=`7c887d8f-4943-4ad0-b42c-033a557fce44`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-08 16:56:17,007::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:56:17,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:17,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178987 s, 57.2 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:56:18,347::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:56:18,347::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:18,658::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:18,660::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:18,661::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:19,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:19,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349027 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:56:21,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:22,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174931 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:23,668::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:23,670::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:23,671::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:24,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:56:24,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`a171910d-681d-4031-aa08-0720f929b447`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:56:24,332::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:56:24,333::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556202', 'lastCheck': '8.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:56:24,334::task::1191::Storage.TaskManager.Task::(prepare) Task=`a171910d-681d-4031-aa08-0720f929b447`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556202', 'lastCheck': '8.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:56:24,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`a171910d-681d-4031-aa08-0720f929b447`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:56:24,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:56:24,335::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:56:24,335::task::993::Storage.TaskManager.Task::(_decref) Task=`a171910d-681d-4031-aa08-0720f929b447`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:56:24,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291365 s, 35.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:56:24,430::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:56:26,066::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:26,067::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:56:26,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:26,067::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:26,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:26,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:26,068::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:26,068::__init__::225::IOProcess::(_processLogs) (273860) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:26,068::__init__::225::IOProcess::(_processLogs) (273860) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:26,069::__init__::225::IOProcess::(_processLogs) (273860) Building response >Thread-18::DEBUG::2014-07-08 16:56:26,069::__init__::225::IOProcess::(_processLogs) (273860) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:26,069::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:26,069::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:56:26,071::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:56:26,228::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000838353 s, 551 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:56:26,229::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:56:26,235::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUGDEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 16:56:26,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f2d3fdb-318e-4cc6-9726-988a3926b25c`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:56:26,237::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 16:56:26,238::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:56:26,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:26,240::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:26,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:26,240::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:26,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:26,241::__init__::225::IOProcess::(_processLogs) (273861) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:26,241::__init__::225::IOProcess::(_processLogs) (273861) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:26,242::__init__::225::IOProcess::(_processLogs) (273861) Building response >Thread-18::DEBUG::2014-07-08 16:56:26,242::__init__::225::IOProcess::(_processLogs) (273861) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:26,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:26,242::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:56:26,245::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:56:26,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:26,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:26,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:26,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:26,246::__init__::225::IOProcess::(_processLogs) (273862) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:26,246::__init__::225::IOProcess::(_processLogs) (273862) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:26,247::__init__::225::IOProcess::(_processLogs) (273862) Building response >Thread-18::DEBUG::2014-07-08 16:56:26,247::__init__::225::IOProcess::(_processLogs) (273862) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:26,247::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:26,247::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:56:26,248::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:56:26,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:26,249::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:26,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:26,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:26,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:26,250::__init__::225::IOProcess::(_processLogs) (273863) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:26,250::__init__::225::IOProcess::(_processLogs) (273863) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:26,250::__init__::225::IOProcess::(_processLogs) (273863) Building response >Thread-18::DEBUG::2014-07-08 16:56:26,251::__init__::225::IOProcess::(_processLogs) (273863) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:26,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:26,251::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:56:26,252::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:26,253::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:56:26,253::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:26,253::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:26,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:26,254::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:26,254::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:26,254::__init__::225::IOProcess::(_processLogs) (273864) Finding callback 'access'... >Thread-7082::INFO::2014-07-08 16:56:26,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:56:26,254::__init__::225::IOProcess::(_processLogs) (273864) Got request for method 'access' >Thread-7082::DEBUG::2014-07-08 16:56:26,256::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f2d3fdb-318e-4cc6-9726-988a3926b25c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:56:26,257::__init__::225::IOProcess::(_processLogs) (273864) Building response >Thread-7082::DEBUG::2014-07-08 16:56:26,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f2d3fdb-318e-4cc6-9726-988a3926b25c`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:56:26,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:56:26,259::__init__::225::IOProcess::(_processLogs) (273864) Queuing response >Thread-7082::DEBUG::2014-07-08 16:56:26,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:56:26,261::task::993::Storage.TaskManager.Task::(_decref) Task=`2f2d3fdb-318e-4cc6-9726-988a3926b25c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:56:26,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:26,263::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:56:26,276::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:56:26,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e4f3d87-3a2a-44e7-9ae0-46558d0a05cb`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:56:26,278::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:56:26,279::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6bedd6fe-3864-4007-b28c-3e5b88adfe99`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:56:26,279::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:56:26,279::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:56:26,280::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6bedd6fe-3864-4007-b28c-3e5b88adfe99`::Granted request >Thread-7083::DEBUG::2014-07-08 16:56:26,280::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0e4f3d87-3a2a-44e7-9ae0-46558d0a05cb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:56:26,281::task::993::Storage.TaskManager.Task::(_decref) Task=`0e4f3d87-3a2a-44e7-9ae0-46558d0a05cb`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:56:26,300::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:26,300::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e4f3d87-3a2a-44e7-9ae0-46558d0a05cb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:26,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e4f3d87-3a2a-44e7-9ae0-46558d0a05cb`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:56:26,301::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:56:26,301::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:56:26,301::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:56:26,302::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:56:26,302::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:56:26,302::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:56:26,303::task::993::Storage.TaskManager.Task::(_decref) Task=`0e4f3d87-3a2a-44e7-9ae0-46558d0a05cb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:56:26,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:26,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116788 s, 8.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:28,678::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:28,679::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:28,681::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:28,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:29,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174213 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:56:31,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:31,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0213421 s, 48.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:56:33,380::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:56:33,381::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:56:33,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:33,694::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:33,705::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:33,710::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:33,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341225 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:56:35,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:36,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173805 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:56:36,268::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:36,268::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:56:36,269::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:36,269::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:36,269::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:36,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:36,270::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:36,270::__init__::225::IOProcess::(_processLogs) (273865) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:36,270::__init__::225::IOProcess::(_processLogs) (273865) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:36,270::__init__::225::IOProcess::(_processLogs) (273865) Building response >Thread-18::DEBUG::2014-07-08 16:56:36,271::__init__::225::IOProcess::(_processLogs) (273865) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:36,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:36,271::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:56:36,273::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:56:36,428::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000517091 s, 893 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:56:36,430::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [7bf61fec] >Thread-18::DEBUG::2014-07-08 16:56:36,435::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 16:56:36,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0f5d6ad-2207-442e-bf9a-6038bc4cc425`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:56:36,437::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 16:56:36,439::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:56:36,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:36,441::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:36,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:36,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:36,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:36,442::__init__::225::IOProcess::(_processLogs) (273866) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:36,442::__init__::225::IOProcess::(_processLogs) (273866) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:36,442::__init__::225::IOProcess::(_processLogs) (273866) Building response >Thread-18::DEBUG::2014-07-08 16:56:36,443::__init__::225::IOProcess::(_processLogs) (273866) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:36,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:36,443::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:56:36,445::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:36,446::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:56:36,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:36,446::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:36,446::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:36,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:36,448::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:36,449::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(273867) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:36,449::__init__::225::IOProcess::(_processLogs) (273867) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:36,449::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(273867) Building response >Thread-18::DEBUG::2014-07-08 16:56:36,450::__init__::225::IOProcess::(_processLogs) (273867) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:36,450::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:36,450::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:56:36,451::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:36,452::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:56:36,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:36,452::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:36,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:36,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:36,453::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:36,454::__init__::225::IOProcess::(_processLogs) DEBUG|(273868) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:36,454::__init__::225::IOProcess::(_processLogs) (273868) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:36,455::__init__::225::IOProcess::(_processLogs) DEBUG|(273868) Building response >Thread-7082::INFO::2014-07-08 16:56:36,455::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:56:36,455::__init__::225::IOProcess::(_processLogs) (273868) Queuing response >Thread-7082::DEBUG::2014-07-08 16:56:36,457::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0f5d6ad-2207-442e-bf9a-6038bc4cc425`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:56:36,457::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 16:56:36,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0f5d6ad-2207-442e-bf9a-6038bc4cc425`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:56:36,459::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 16:56:36,459::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:56:36,460::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:56:36,462::task::993::Storage.TaskManager.Task::(_decref) Task=`e0f5d6ad-2207-442e-bf9a-6038bc4cc425`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:56:36,464::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:36,465::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:56:36,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:36,466::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:36,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:36,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:36,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:36,467::__init__::225::IOProcess::(_processLogs) (273869) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:36,467::__init__::225::IOProcess::(_processLogs) (273869) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:36,468::__init__::225::IOProcess::(_processLogs) (273869) Building response >Thread-18::DEBUG::2014-07-08 16:56:36,468::__init__::225::IOProcess::(_processLogs) (273869) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:36,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:36,469::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:56:36,483::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [7bf61fec] >Thread-7083::DEBUG::2014-07-08 16:56:36,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`44a21504-cce9-4231-b8c8-275c91053f0e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:56:36,485::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:56:36,486::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3dc73dc1-f450-455b-a404-b1f2debc575c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:56:36,486::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:56:36,486::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:56:36,487::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3dc73dc1-f450-455b-a404-b1f2debc575c`::Granted request >Thread-7083::DEBUG::2014-07-08 16:56:36,492::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`44a21504-cce9-4231-b8c8-275c91053f0e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:56:36,492::task::993::Storage.TaskManager.Task::(_decref) Task=`44a21504-cce9-4231-b8c8-275c91053f0e`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:56:36,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:36,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`44a21504-cce9-4231-b8c8-275c91053f0e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:36,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`44a21504-cce9-4231-b8c8-275c91053f0e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:56:36,512::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:56:36,512::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:56:36,512::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:56:36,513::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:56:36,513::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:56:36,513::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:56:36,514::task::993::Storage.TaskManager.Task::(_decref) Task=`44a21504-cce9-4231-b8c8-275c91053f0e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:56:38,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:38,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173551 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:38,721::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:38,722::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:38,723::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:56:39,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`77245c8f-fbe9-49c4-ac2e-66f8caddab16`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:56:39,804::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:56:39,805::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517091', 'lastCheck': '3.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:56:39,805::task::1191::Storage.TaskManager.Task::(prepare) Task=`77245c8f-fbe9-49c4-ac2e-66f8caddab16`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517091', 'lastCheck': '3.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:56:39,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`77245c8f-fbe9-49c4-ac2e-66f8caddab16`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:56:39,805::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:56:39,806::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:56:39,806::task::993::Storage.TaskManager.Task::(_decref) Task=`77245c8f-fbe9-49c4-ac2e-66f8caddab16`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:56:39,847::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:40,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:40,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251696 s, 40.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:56:42,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:42,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.114116 s, 9.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:43,730::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:43,732::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:43,733::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:45,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:45,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172372 s, 59.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:56:46,473::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:46,473::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:56:46,474::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:46,474::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:46,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:46,474::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:46,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:46,475::__init__::225::IOProcess::(_processLogs) (273870) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:46,475::__init__::225::IOProcess::(_processLogs) (273870) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:46,475::__init__::225::IOProcess::(_processLogs) (273870) Building response >Thread-18::DEBUG::2014-07-08 16:56:46,476::__init__::225::IOProcess::(_processLogs) (273870) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:46,476::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:56:46,476::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:56:46,478::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:56:46,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000662636 s, 697 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:56:46,640::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:46,641::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:56:46,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 16:56:46,645::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:56:46,645::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:46,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 16:56:46,649::task::595::Storage.TaskManager.Task::(_updateState) Task=`afcf969f-ea79-4b0d-a247-5443deda32e6`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:56:46,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 16:56:46,650::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:56:46,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:46,652::__init__::225::IOProcess::(_processLogs) (273871) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:46,653::__init__::225::IOProcess::(_processLogs) (273871) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:46,653::__init__::225::IOProcess::(_processLogs) (273871) Building response >Thread-18::DEBUG::2014-07-08 16:56:46,653::__init__::225::IOProcess::(_processLogs) (273871) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:46,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:46,654::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:56:46,656::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:46,656::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:56:46,657::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:46,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:46,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:46,657::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:46,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:46,658::__init__::225::IOProcess::(_processLogs) (273872) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:46,658::__init__::225::IOProcess::(_processLogs) (273872) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:46,658::__init__::225::IOProcess::(_processLogs) (273872) Building response >Thread-18::DEBUG::2014-07-08 16:56:46,659::__init__::225::IOProcess::(_processLogs) (273872) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:46,659::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:56:46,660::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:56:46,661::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:46,661::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:56:46,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:46,662::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:46,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:46,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:46,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:46,663::__init__::225::IOProcess::(_processLogs) (273873) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:46,663::__init__::225::IOProcess::(_processLogs) (273873) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:46,663::__init__::225::IOProcess::(_processLogs) (273873) Building response >Thread-18::DEBUG::2014-07-08 16:56:46,663::__init__::225::IOProcess::(_processLogs) (273873) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:46,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:46,664::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:56:46,665::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:46,665::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:56:46,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:46,666::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:46,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:46,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 16:56:46,667::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:56:46,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 16:56:46,669::task::1191::Storage.TaskManager.Task::(prepare) Task=`afcf969f-ea79-4b0d-a247-5443deda32e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:56:46,670::__init__::225::IOProcess::(_processLogs) (273874) Finding callback 'access'... >Thread-7082::DEBUG::2014-07-08 16:56:46,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`afcf969f-ea79-4b0d-a247-5443deda32e6`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:56:46,671::__init__::225::IOProcess::(_processLogs) (273874) Got request for method 'access' >Thread-7082::DEBUG::2014-07-08 16:56:46,672::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:56:46,673::__init__::225::IOProcess::(_processLogs) (273874) Building response >Thread-7082::DEBUG::2014-07-08 16:56:46,673::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:56:46,675::__init__::225::IOProcess::(_processLogs) (273874) Queuing response >Thread-7082::DEBUG::2014-07-08 16:56:46,675::task::993::Storage.TaskManager.Task::(_decref) Task=`afcf969f-ea79-4b0d-a247-5443deda32e6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:56:46,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:46,679::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:56:46,691::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:56:46,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`326ab335-058c-49db-89b6-56218a85dcbc`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:56:46,692::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:56:46,693::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a8685c0b-d1f2-42b3-bfa1-20d725892487`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:56:46,693::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:56:46,694::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:56:46,694::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a8685c0b-d1f2-42b3-bfa1-20d725892487`::Granted request >Thread-7083::DEBUG::2014-07-08 16:56:46,695::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`326ab335-058c-49db-89b6-56218a85dcbc`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:56:46,695::task::993::Storage.TaskManager.Task::(_decref) Task=`326ab335-058c-49db-89b6-56218a85dcbc`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:56:46,714::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:46,714::task::1191::Storage.TaskManager.Task::(prepare) Task=`326ab335-058c-49db-89b6-56218a85dcbc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:46,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`326ab335-058c-49db-89b6-56218a85dcbc`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:56:46,715::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:56:46,715::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:56:46,715::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:56:46,716::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:56:46,716::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:56:46,716::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:56:46,717::task::993::Storage.TaskManager.Task::(_decref) Task=`326ab335-058c-49db-89b6-56218a85dcbc`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:56:47,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-07-08 16:56:47,426::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:56:47,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174445 s, 58.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:56:48,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`c372f68c-8fb0-440c-be62-296b56818ade`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:56:48,638::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:56:48,639::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:48,640::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:56:48,640::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:48,640::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:48,640::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:48,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:48,641::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:48,641::__init__::225::IOProcess::(_processLogs) (273875) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:56:48,641::__init__::225::IOProcess::(_processLogs) (273875) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:56:48,642::__init__::225::IOProcess::(_processLogs) (273875) Building response >Thread-18::DEBUG::2014-07-08 16:56:48,642::__init__::225::IOProcess::(_processLogs) (273875) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:48,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:48,642::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:56:48,644::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:48,644::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:56:48,645::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:48,645::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:48,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:48,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:48,646::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:48,646::__init__::225::IOProcess::(_processLogs) (273876) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:56:48,646::__init__::225::IOProcess::(_processLogs) (273876) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:56:48,646::__init__::225::IOProcess::(_processLogs) (273876) Building response >Thread-18::DEBUG::2014-07-08 16:56:48,647::__init__::225::IOProcess::(_processLogs) (273876) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:48,647::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:48,647::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:56:48,648::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:56:48,649::task::1191::Storage.TaskManager.Task::(prepare) Task=`c372f68c-8fb0-440c-be62-296b56818ade`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:56:48,649::task::595::Storage.TaskManager.Task::(_updateState) Task=`c372f68c-8fb0-440c-be62-296b56818ade`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:56:48,649::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:56:48,649::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:56:48,650::task::993::Storage.TaskManager.Task::(_decref) Task=`c372f68c-8fb0-440c-be62-296b56818ade`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:56:48,729::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:56:48,729::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:48,740::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:48,742::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:48,743::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:49,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:49,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175543 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:56:51,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:52,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171819 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:53,750::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:53,752::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:53,753::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:54,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:54,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173481 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:56:55,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`3609974a-95a4-4155-ab0a-4a8a79a35567`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:56:55,051::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:56:55,052::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662636', 'lastCheck': '8.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:56:55,052::task::1191::Storage.TaskManager.Task::(prepare) Task=`3609974a-95a4-4155-ab0a-4a8a79a35567`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662636', 'lastCheck': '8.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:56:55,053::task::595::Storage.TaskManager.Task::(_updateState) Task=`3609974a-95a4-4155-ab0a-4a8a79a35567`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:56:55,053::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:56:55,053::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:56:55,053::task::993::Storage.TaskManager.Task::(_decref) Task=`3609974a-95a4-4155-ab0a-4a8a79a35567`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:56:55,084::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:56,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:56:56,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331682 s, 30.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:56:56,683::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:56,684::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:56:56,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:56,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:56,684::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:56,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:56,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:56,685::__init__::225::IOProcess::(_processLogs) (273877) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:56,685::__init__::225::IOProcess::(_processLogs) (273877) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:56,686::__init__::225::IOProcess::(_processLogs) (273877) Building response >Thread-18::DEBUG::2014-07-08 16:56:56,686::__init__::225::IOProcess::(_processLogs) (273877) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:56,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:56,686::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:56:56,688::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:56:56,845::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000474071 s, 975 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:56:56,849::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:56:56,851::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:56,852::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:56:56,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 16:56:56,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3c3d6c8-3db5-4c55-b53f-a98b6fbb369c`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:56:56,855::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::INFO::2014-07-08 16:56:56,857::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:56:56,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:56,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:56,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:56,859::__init__::225::IOProcess::(_processLogs) (273878) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:56:56,859::__init__::225::IOProcess::(_processLogs) (273878) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:56:56,860::__init__::225::IOProcess::(_processLogs) (273878) Building response >Thread-18::DEBUG::2014-07-08 16:56:56,860::__init__::225::IOProcess::(_processLogs) (273878) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:56,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:56,861::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:56:56,863::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:56,863::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:56:56,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:56,864::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:56,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:56,864::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:56,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:56,865::__init__::225::IOProcess::(_processLogs) (273879) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:56,865::__init__::225::IOProcess::(_processLogs) (273879) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:56,872::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(273879) Building response >Thread-18::DEBUG::2014-07-08 16:56:56,872::__init__::225::IOProcess::(_processLogs) (273879) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:56,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:56,873::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::INFO::2014-07-08 16:56:56,875::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:56:56,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3c3d6c8-3db5-4c55-b53f-a98b6fbb369c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:56:56,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3c3d6c8-3db5-4c55-b53f-a98b6fbb369c`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:56:56,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:56:56,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:56:56,878::task::993::Storage.TaskManager.Task::(_decref) Task=`b3c3d6c8-3db5-4c55-b53f-a98b6fbb369c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:56:56,880::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:56:56,880::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:56:56,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:56,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:56,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:56,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:56,881::__init__::225::IOProcess::(_processLogs) (273880) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:56,882::__init__::225::IOProcess::(_processLogs) (273880) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:56,882::__init__::225::IOProcess::(_processLogs) (273880) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:56,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:56,883::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:56:56,884::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:56:56,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:56:56,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:56:56,885::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:56:56,885::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:56:56,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:56:56,886::__init__::225::IOProcess::(_processLogs) (273881) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:56:56,886::__init__::225::IOProcess::(_processLogs) (273881) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:56:56,886::__init__::225::IOProcess::(_processLogs) (273881) Building response >Thread-18::DEBUG::2014-07-08 16:56:56,887::__init__::225::IOProcess::(_processLogs) (273881) Queuing response >Thread-18::DEBUG::2014-07-08 16:56:56,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:56:56,887::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:56:56,891::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:56:56,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4e52ff7-b3c3-4ad0-914f-2c95fed5af47`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:56:56,892::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:56:56,893::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f8ad3ac8-a701-4630-b096-a0a93b1e0965`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:56:56,893::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:56:56,893::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:56:56,894::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f8ad3ac8-a701-4630-b096-a0a93b1e0965`::Granted request >Thread-7083::DEBUG::2014-07-08 16:56:56,894::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e4e52ff7-b3c3-4ad0-914f-2c95fed5af47`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:56:56,895::task::993::Storage.TaskManager.Task::(_decref) Task=`e4e52ff7-b3c3-4ad0-914f-2c95fed5af47`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:56:56,913::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:56,914::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4e52ff7-b3c3-4ad0-914f-2c95fed5af47`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:56:56,914::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4e52ff7-b3c3-4ad0-914f-2c95fed5af47`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:56:56,915::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:56:56,915::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:56:56,915::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:56:56,916::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:56:56,916::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:56:56,916::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:56:56,916::task::993::Storage.TaskManager.Task::(_decref) Task=`e4e52ff7-b3c3-4ad0-914f-2c95fed5af47`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:56:58,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:58,784::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:58,888::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:56:58,896::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:56:59,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.14554 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:57:01,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:01,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0230266 s, 44.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:57:03,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:03,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176993 s, 57.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:03,908::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 16:57:03,909::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:57:03,911::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:03,915::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:03,917::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:05,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:05,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172146 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:57:06,890::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:57:06,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:06,891::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:06,891::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:06,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:06,891::__init__::225::IOProcess::(_processLogs) (273882) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:06,892::__init__::225::IOProcess::(_processLogs) (273882) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:06,892::__init__::225::IOProcess::(_processLogs) (273882) Building response >Thread-18::DEBUG::2014-07-08 16:57:06,892::__init__::225::IOProcess::(_processLogs) (273882) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:06,892::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:06,893::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:57:06,894::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:57:07,050::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000665151 s, 695 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:57:07,052::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:57:07,057::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::DEBUG::2014-07-08 16:57:07,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a6c299b-5994-4ee0-9f78-48917f3f6b6b`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:57:07,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::INFO::2014-07-08 16:57:07,060::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:57:07,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:07,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:07,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:07,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:07,062::__init__::225::IOProcess::(_processLogs) (273883) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:07,063::__init__::225::IOProcess::(_processLogs) (273883) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:07,063::__init__::225::IOProcess::(_processLogs) (273883) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:07,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:07,064::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:57:07,075::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:57:07,076::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:07,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::INFO::2014-07-08 16:57:07,076::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:57:07,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 16:57:07,078::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a6c299b-5994-4ee0-9f78-48917f3f6b6b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:57:07,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a6c299b-5994-4ee0-9f78-48917f3f6b6b`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:57:07,080::__init__::225::IOProcess::(_processLogs) (273884) Finding callback 'access'... >Thread-7082::DEBUG::2014-07-08 16:57:07,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:57:07,081::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:57:07,082::__init__::225::IOProcess::(_processLogs) (273884) Got request for method 'access' >Thread-7082::DEBUG::2014-07-08 16:57:07,083::task::993::Storage.TaskManager.Task::(_decref) Task=`1a6c299b-5994-4ee0-9f78-48917f3f6b6b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:57:07,084::__init__::225::IOProcess::(_processLogs) (273884) Building response >Thread-18::DEBUG::2014-07-08 16:57:07,086::__init__::225::IOProcess::(_processLogs) (273884) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:07,087::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:07,087::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:57:07,089::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:57:07,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:07,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:07,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:07,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:07,090::__init__::225::IOProcess::(_processLogs) (273885) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:07,090::__init__::225::IOProcess::(_processLogs) (273885) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:07,090::__init__::225::IOProcess::(_processLogs) (273885) Building response >Thread-18::DEBUG::2014-07-08 16:57:07,091::__init__::225::IOProcess::(_processLogs) (273885) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:07,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:07,091::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:57:07,092::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:57:07,092::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:07,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:07,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:07,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:07,093::__init__::225::IOProcess::(_processLogs) (273886) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:07,094::__init__::225::IOProcess::(_processLogs) (273886) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:07,094::__init__::225::IOProcess::(_processLogs) (273886) Building response >Thread-18::DEBUG::2014-07-08 16:57:07,094::__init__::225::IOProcess::(_processLogs) (273886) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:07,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:07,094::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:57:07,102::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:57:07,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`d93e7ccb-cff8-4a82-b676-a8c0c744ef5f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:57:07,103::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:57:07,104::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`01fb0609-4354-4489-95ba-06e03c5da7bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:57:07,104::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:57:07,105::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:57:07,105::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`01fb0609-4354-4489-95ba-06e03c5da7bc`::Granted request >Thread-7083::DEBUG::2014-07-08 16:57:07,106::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d93e7ccb-cff8-4a82-b676-a8c0c744ef5f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:57:07,106::task::993::Storage.TaskManager.Task::(_decref) Task=`d93e7ccb-cff8-4a82-b676-a8c0c744ef5f`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:57:07,125::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:57:07,125::task::1191::Storage.TaskManager.Task::(prepare) Task=`d93e7ccb-cff8-4a82-b676-a8c0c744ef5f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:57:07,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`d93e7ccb-cff8-4a82-b676-a8c0c744ef5f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:57:07,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:57:07,126::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:57:07,127::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:57:07,127::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:57:07,127::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:57:07,127::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:57:07,128::task::993::Storage.TaskManager.Task::(_decref) Task=`d93e7ccb-cff8-4a82-b676-a8c0c744ef5f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:57:07,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:08,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175107 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:08,922::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:08,924::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:08,925::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:10,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:10,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177018 s, 57.8 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:57:10,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb781124-f1ed-4b71-ac32-e57f2c20f896`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:57:10,545::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:57:10,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665151', 'lastCheck': '3.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:57:10,545::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb781124-f1ed-4b71-ac32-e57f2c20f896`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665151', 'lastCheck': '3.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:57:10,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb781124-f1ed-4b71-ac32-e57f2c20f896`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:57:10,546::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:57:10,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:57:10,546::task::993::Storage.TaskManager.Task::(_decref) Task=`fb781124-f1ed-4b71-ac32-e57f2c20f896`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:57:10,578::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:12,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:12,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177065 s, 57.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:13,932::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:13,934::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:13,935::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:14,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:15,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.134839 s, 7.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 16:57:17,096::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:57:17,102::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 16:57:17,106::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:17,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:17,108::__init__::225::IOProcess::(_processLogs) (273887) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:57:17,108::__init__::225::IOProcess::(_processLogs) (273887) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:57:17,108::__init__::225::IOProcess::(_processLogs) (273887) Building response >Thread-18::DEBUG::2014-07-08 16:57:17,109::__init__::225::IOProcess::(_processLogs) (273887) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,109::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,109::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 16:57:17,111::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:57:17,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:17,111::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,112::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:17,112::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:17,112::__init__::225::IOProcess::(_processLogs) (273888) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:57:17,113::__init__::225::IOProcess::(_processLogs) (273888) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:57:17,113::__init__::225::IOProcess::(_processLogs) (273888) Building response >Thread-18::DEBUG::2014-07-08 16:57:17,113::__init__::225::IOProcess::(_processLogs) (273888) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,115::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 16:57:17,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:17,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:17,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:17,117::__init__::225::IOProcess::(_processLogs) (273889) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:57:17,118::__init__::225::IOProcess::(_processLogs) (273889) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:57:17,118::__init__::225::IOProcess::(_processLogs) (273889) Building response >Thread-18::DEBUG::2014-07-08 16:57:17,118::__init__::225::IOProcess::(_processLogs) (273889) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,119::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 16:57:17,120::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 16:57:17,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:17,124::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:17,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:17,131::__init__::225::IOProcess::(_processLogs) (273890) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:57:17,133::__init__::225::IOProcess::(_processLogs) (273890) Got request for method 'glob' >Thread-37::DEBUG::2014-07-08 16:57:17,134::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 16:57:17,136::__init__::225::IOProcess::(_processLogs) (273890) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,136::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 16:57:17,137::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 16:57:17,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:17,139::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:17,139::__init__::225::IOProcess::(_processLogs) (273891) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 16:57:17,139::__init__::225::IOProcess::(_processLogs) (273891) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 16:57:17,140::__init__::225::IOProcess::(_processLogs) (273891) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,140::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,140::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 16:57:17,141::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 16:57:17,142::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 16:57:17,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:17,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:17,144::__init__::225::IOProcess::(_processLogs) (273892) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 16:57:17,144::__init__::225::IOProcess::(_processLogs) (273892) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 16:57:17,145::__init__::225::IOProcess::(_processLogs) (273892) Queuing response >Dummy-6860::DEBUG::2014-07-08 16:57:17,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:57:17,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,316::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 16:57:17,323::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 16:57:17,335::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 16:57:17,338::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:17,341::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:17,352::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:17,356::__init__::225::IOProcess::(_processLogs) (273893) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:17,360::__init__::225::IOProcess::(_processLogs) (273893) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:17,363::__init__::225::IOProcess::(_processLogs) (273893) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,370::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 16:57:17,388::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:57:17,389::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-7082::DEBUG::2014-07-08 16:57:17,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`1259ef36-3e41-4595-8fe3-12f5b7e8f506`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:57:17,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::INFO::2014-07-08 16:57:17,403::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:57:17,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,411::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:17,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 16:57:17,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101939 s, 10.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:57:17,482::__init__::225::IOProcess::(_processLogs) (273894) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 16:57:17,487::__init__::225::IOProcess::(_processLogs) (273894) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 16:57:17,489::__init__::225::IOProcess::(_processLogs) (273894) Building response >Thread-18::DEBUG::2014-07-08 16:57:17,493::__init__::225::IOProcess::(_processLogs) (273894) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,499::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 16:57:17,507::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 16:57:17,509::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 16:57:17,511::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 16:57:17,519::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:57:17,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:17,523::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::INFO::2014-07-08 16:57:17,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:57:17,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 16:57:17,535::task::1191::Storage.TaskManager.Task::(prepare) Task=`1259ef36-3e41-4595-8fe3-12f5b7e8f506`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:57:17,539::task::595::Storage.TaskManager.Task::(_updateState) Task=`1259ef36-3e41-4595-8fe3-12f5b7e8f506`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:57:17,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 16:57:17,543::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:57:17,546::__init__::225::IOProcess::(_processLogs) (273895) Finding callback 'statvfs'... >Thread-7082::DEBUG::2014-07-08 16:57:17,548::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:57:17,552::__init__::225::IOProcess::(_processLogs) (273895) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 16:57:17,553::task::993::Storage.TaskManager.Task::(_decref) Task=`1259ef36-3e41-4595-8fe3-12f5b7e8f506`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:57:17,559::__init__::225::IOProcess::(_processLogs) (273895) Building response >Thread-18::DEBUG::2014-07-08 16:57:17,564::__init__::225::IOProcess::(_processLogs) (273895) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,577::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >VM Channels Listener::DEBUG::2014-07-08 16:57:17,591::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7083::DEBUG::2014-07-08 16:57:17,597::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:57:17,603::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8654a63-93a9-4fff-9485-389e0da014b7`::moving from state init -> state preparing >Thread-37::DEBUG::2014-07-08 16:57:17,603::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::INFO::2014-07-08 16:57:17,606::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 16:57:17,768::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000435519 s, 1.1 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 16:57:17,774::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`71be40a5-0d68-4544-a4df-12979d6feb97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:57:17,779::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:57:17,782::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7083::DEBUG::2014-07-08 16:57:17,787::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:57:17,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:57:17,793::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`71be40a5-0d68-4544-a4df-12979d6feb97`::Granted request >Thread-18::DEBUG::2014-07-08 16:57:17,796::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:57:17,806::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b8654a63-93a9-4fff-9485-389e0da014b7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 16:57:17,809::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 16:57:17,812::task::993::Storage.TaskManager.Task::(_decref) Task=`b8654a63-93a9-4fff-9485-389e0da014b7`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:57:17,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:17,821::__init__::225::IOProcess::(_processLogs) (273896) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:17,827::__init__::225::IOProcess::(_processLogs) (273896) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:17,833::__init__::225::IOProcess::(_processLogs) (273896) Building response >Thread-18::DEBUG::2014-07-08 16:57:17,838::__init__::225::IOProcess::(_processLogs) (273896) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,851::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:57:17,880::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:57:17,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:17,892::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,896::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:17,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::INFO::2014-07-08 16:57:17,903::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:57:17,905::__init__::225::IOProcess::(_processLogs) (273897) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 16:57:17,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`b8654a63-93a9-4fff-9485-389e0da014b7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:57:17,909::__init__::225::IOProcess::(_processLogs) (273897) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 16:57:17,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8654a63-93a9-4fff-9485-389e0da014b7`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:57:17,913::__init__::225::IOProcess::(_processLogs) (273897) Building response >Thread-7083::DEBUG::2014-07-08 16:57:17,916::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:57:17,918::__init__::225::IOProcess::(_processLogs) (273897) Queuing response >Thread-7083::DEBUG::2014-07-08 16:57:17,919::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:57:17,922::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,925::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:57:17,927::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:57:17,935::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:57:17,939::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 16:57:17,941::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::DEBUG::2014-07-08 16:57:17,943::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 16:57:17,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:17,950::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 16:57:17,951::task::993::Storage.TaskManager.Task::(_decref) Task=`b8654a63-93a9-4fff-9485-389e0da014b7`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:57:17,954::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:17,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:17,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:17,969::__init__::225::IOProcess::(_processLogs) (273898) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:17,973::__init__::225::IOProcess::(_processLogs) (273898) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:17,976::__init__::225::IOProcess::(_processLogs) (273898) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:17,978::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:17,980::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:57:17,989::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:57:17,992::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:17,995::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:17,998::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:18,001::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:18,006::__init__::225::IOProcess::(_processLogs) (273899) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:18,009::__init__::225::IOProcess::(_processLogs) (273899) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:18,011::__init__::225::IOProcess::(_processLogs) (273899) Building response >Thread-18::DEBUG::2014-07-08 16:57:18,013::__init__::225::IOProcess::(_processLogs) (273899) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:18,016::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:18,019::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:18,942::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:18,944::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:18,945::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 16:57:19,143::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:57:19,143::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:57:20,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:20,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905793 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:57:22,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:22,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173699 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:23,952::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:23,953::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:23,955::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:24,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:25,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173724 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:57:25,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`e06ab7ae-5967-40f1-b307-299f7ed9a048`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:57:25,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:57:25,801::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435519', 'lastCheck': '7.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:57:25,801::task::1191::Storage.TaskManager.Task::(prepare) Task=`e06ab7ae-5967-40f1-b307-299f7ed9a048`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435519', 'lastCheck': '7.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:57:25,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`e06ab7ae-5967-40f1-b307-299f7ed9a048`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:57:25,802::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:57:25,802::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:57:25,802::task::993::Storage.TaskManager.Task::(_decref) Task=`e06ab7ae-5967-40f1-b307-299f7ed9a048`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:57:25,939::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:27,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:27,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.020818 s, 49.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:57:28,007::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:57:28,008::task::595::Storage.TaskManager.Task::(_updateState) Task=`897289bb-c48a-43e4-a143-641344aaf7e8`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:57:28,009::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:57:28,024::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:57:28,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`897289bb-c48a-43e4-a143-641344aaf7e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:57:28,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`897289bb-c48a-43e4-a143-641344aaf7e8`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:57:28,025::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:57:28,025::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:57:28,027::task::993::Storage.TaskManager.Task::(_decref) Task=`897289bb-c48a-43e4-a143-641344aaf7e8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:57:28,029::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:57:28,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:28,032::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:28,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:28,033::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:28,034::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:28,034::__init__::225::IOProcess::(_processLogs) (273900) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:28,034::__init__::225::IOProcess::(_processLogs) (273900) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:28,034::__init__::225::IOProcess::(_processLogs) (273900) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:28,035::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:28,035::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:57:28,036::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:57:28,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000493346 s, 936 kB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 16:57:28,196::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:57:28,204::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:57:28,208::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:57:28,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7ca3302-51d6-4f09-becd-493ed484d6ff`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:57:28,211::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::INFO::2014-07-08 16:57:28,213::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:57:28,214::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:28,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:28,221::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 16:57:28,222::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ec18cab1-8a0e-48bd-b59e-9369d80188d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 16:57:28,223::__init__::225::IOProcess::(_processLogs) (273901) Finding callback 'statvfs'... >Thread-7083::DEBUG::2014-07-08 16:57:28,225::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 16:57:28,226::__init__::225::IOProcess::(_processLogs) (273901) Got request for method 'statvfs' >Thread-7083::DEBUG::2014-07-08 16:57:28,230::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 16:57:28,231::__init__::225::IOProcess::(_processLogs) (273901) Queuing response >Thread-7083::DEBUG::2014-07-08 16:57:28,233::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ec18cab1-8a0e-48bd-b59e-9369d80188d1`::Granted request >Thread-18::DEBUG::2014-07-08 16:57:28,235::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:28,238::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 16:57:28,243::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e7ca3302-51d6-4f09-becd-493ed484d6ff`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:57:28,246::task::993::Storage.TaskManager.Task::(_decref) Task=`e7ca3302-51d6-4f09-becd-493ed484d6ff`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:57:28,262::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:57:28,267::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:28,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:28,277::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:28,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:28,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:28,290::__init__::225::IOProcess::(_processLogs) (273902) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:28,293::__init__::225::IOProcess::(_processLogs) (273902) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:28,294::__init__::225::IOProcess::(_processLogs) (273902) Building response >Thread-18::DEBUG::2014-07-08 16:57:28,296::__init__::225::IOProcess::(_processLogs) (273902) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:28,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:28,298::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:57:28,303::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:57:28,304::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:28,304::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:28,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:28,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:28,305::__init__::225::IOProcess::(_processLogs) (273903) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:28,305::__init__::225::IOProcess::(_processLogs) (273903) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:28,305::__init__::225::IOProcess::(_processLogs) (273903) Building response >Thread-18::DEBUG::2014-07-08 16:57:28,308::__init__::225::IOProcess::(_processLogs) (273903) Queuing response >Thread-7083::INFO::2014-07-08 16:57:28,308::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 16:57:28,310::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:28,311::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:57:28,311::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7ca3302-51d6-4f09-becd-493ed484d6ff`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:57:28,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7ca3302-51d6-4f09-becd-493ed484d6ff`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 16:57:28,317::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:57:28,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 16:57:28,318::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 16:57:28,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:28,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 16:57:28,323::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 16:57:28,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:28,328::__init__::225::IOProcess::(_processLogs) (273904) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:28,330::__init__::225::IOProcess::(_processLogs) (273904) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:28,331::__init__::225::IOProcess::(_processLogs) (273904) Building response >Thread-18::DEBUG::2014-07-08 16:57:28,334::__init__::225::IOProcess::(_processLogs) (273904) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:28,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:28,337::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:57:28,336::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:57:28,343::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:57:28,345::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:57:28,346::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:57:28,348::task::993::Storage.TaskManager.Task::(_decref) Task=`e7ca3302-51d6-4f09-becd-493ed484d6ff`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:28,961::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:28,963::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:28,964::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:29,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:29,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173861 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:57:31,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:31,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175948 s, 58.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:33,971::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:33,973::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:33,974::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:33,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:34,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195092 s, 52.5 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:57:34,238::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:57:34,239::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:57:36,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:36,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0917046 s, 11.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:57:38,344::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:57:38,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:38,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:38,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:38,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:38,346::__init__::225::IOProcess::(_processLogs) (273905) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:38,346::__init__::225::IOProcess::(_processLogs) (273905) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:38,346::__init__::225::IOProcess::(_processLogs) (273905) Building response >Thread-18::DEBUG::2014-07-08 16:57:38,347::__init__::225::IOProcess::(_processLogs) (273905) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:38,347::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:57:38,349::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:57:38,501::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000519047 s, 890 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:57:38,505::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 16:57:38,511::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:57:38,515::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:38,519::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 16:57:38,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc79dc66-5abd-4d1a-bf95-1d26660c2d2f`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 16:57:38,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:38,524::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 16:57:38,524::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 16:57:38,526::__init__::225::IOProcess::(_processLogs) (273906) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:38,529::__init__::225::IOProcess::(_processLogs) (273906) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:38,531::__init__::225::IOProcess::(_processLogs) (273906) Building response >Thread-18::DEBUG::2014-07-08 16:57:38,532::__init__::225::IOProcess::(_processLogs) (273906) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:38,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:38,536::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::INFO::2014-07-08 16:57:38,543::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:57:38,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc79dc66-5abd-4d1a-bf95-1d26660c2d2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 16:57:38,553::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7082::DEBUG::2014-07-08 16:57:38,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc79dc66-5abd-4d1a-bf95-1d26660c2d2f`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:57:38,556::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 16:57:38,556::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 16:57:38,558::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:57:38,561::task::993::Storage.TaskManager.Task::(_decref) Task=`bc79dc66-5abd-4d1a-bf95-1d26660c2d2f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:57:38,561::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:38,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:38,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:38,572::__init__::225::IOProcess::(_processLogs) (273907) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:38,573::__init__::225::IOProcess::(_processLogs) (273907) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:38,574::__init__::225::IOProcess::(_processLogs) (273907) Building response >Thread-18::DEBUG::2014-07-08 16:57:38,576::__init__::225::IOProcess::(_processLogs) (273907) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:38,578::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:38,580::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 16:57:38,582::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:57:38,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d191240-7f3b-4689-9418-754c07fec4fc`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:57:38,586::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:57:38,590::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`efcd9224-b8b3-4850-8ebd-e977074801e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:57:38,591::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:57:38,593::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:57:38,594::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`efcd9224-b8b3-4850-8ebd-e977074801e5`::Granted request >Thread-7083::DEBUG::2014-07-08 16:57:38,597::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9d191240-7f3b-4689-9418-754c07fec4fc`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:57:38,598::task::993::Storage.TaskManager.Task::(_decref) Task=`9d191240-7f3b-4689-9418-754c07fec4fc`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 16:57:38,607::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:57:38,610::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:38,613::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:38,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:38,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:38,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:38,629::__init__::225::IOProcess::(_processLogs) (273908) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:38,632::__init__::225::IOProcess::(_processLogs) (273908) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:38,635::__init__::225::IOProcess::(_processLogs) (273908) Building response >Thread-7083::INFO::2014-07-08 16:57:38,649::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:57:38,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d191240-7f3b-4689-9418-754c07fec4fc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:57:38,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d191240-7f3b-4689-9418-754c07fec4fc`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:57:38,653::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:57:38,654::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:57:38,656::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:57:38,658::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 16:57:38,655::__init__::225::IOProcess::(_processLogs) (273908) Queuing response >Thread-7083::DEBUG::2014-07-08 16:57:38,659::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:57:38,660::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:57:38,663::task::993::Storage.TaskManager.Task::(_decref) Task=`9d191240-7f3b-4689-9418-754c07fec4fc`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:57:38,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:38,671::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:57:38,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 16:57:38,837::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:57:38,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:38,843::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:38,844::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:38,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:38,850::__init__::225::IOProcess::(_processLogs) (273909) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:38,853::__init__::225::IOProcess::(_processLogs) (273909) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:38,857::__init__::225::IOProcess::(_processLogs) (273909) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:38,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:38,864::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:57:38,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.059044 s, 17.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:38,985::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:38,996::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:39,003::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:57:41,062::task::595::Storage.TaskManager.Task::(_updateState) Task=`47b17cb3-7e5f-422b-9209-d42999f87d13`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:57:41,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:57:41,063::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519047', 'lastCheck': '2.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:57:41,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`47b17cb3-7e5f-422b-9209-d42999f87d13`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519047', 'lastCheck': '2.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:57:41,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`47b17cb3-7e5f-422b-9209-d42999f87d13`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:57:41,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:57:41,064::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:57:41,064::task::993::Storage.TaskManager.Task::(_decref) Task=`47b17cb3-7e5f-422b-9209-d42999f87d13`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:57:41,100::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:41,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:41,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172928 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:57:43,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:43,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338674 s, 30.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:44,015::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:44,016::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:44,017::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:45,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:45,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173235 s, 59.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:57:47,920::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 16:57:47,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:48,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176549 s, 58.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:57:48,692::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:57:48,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`51584c29-2363-43e9-97ea-dc2601b6204e`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:57:48,694::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:57:48,709::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:57:48,710::task::1191::Storage.TaskManager.Task::(prepare) Task=`51584c29-2363-43e9-97ea-dc2601b6204e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:57:48,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`51584c29-2363-43e9-97ea-dc2601b6204e`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:57:48,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:57:48,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:57:48,711::task::993::Storage.TaskManager.Task::(_decref) Task=`51584c29-2363-43e9-97ea-dc2601b6204e`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:57:48,743::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:57:48,744::task::595::Storage.TaskManager.Task::(_updateState) Task=`98ddda40-2b7c-4897-af3d-9fbebe354992`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:57:48,745::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:57:48,746::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`10d75681-0639-4d41-b384-f38542b023fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:57:48,746::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:57:48,747::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:57:48,747::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`10d75681-0639-4d41-b384-f38542b023fd`::Granted request >Thread-7083::DEBUG::2014-07-08 16:57:48,747::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`98ddda40-2b7c-4897-af3d-9fbebe354992`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:57:48,748::task::993::Storage.TaskManager.Task::(_decref) Task=`98ddda40-2b7c-4897-af3d-9fbebe354992`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:57:48,767::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:57:48,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`98ddda40-2b7c-4897-af3d-9fbebe354992`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:57:48,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`98ddda40-2b7c-4897-af3d-9fbebe354992`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:57:48,768::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:57:48,768::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:57:48,768::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:57:48,769::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:57:48,769::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:57:48,769::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:57:48,770::task::993::Storage.TaskManager.Task::(_decref) Task=`98ddda40-2b7c-4897-af3d-9fbebe354992`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:57:48,876::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:57:48,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:48,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:48,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:48,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:48,878::__init__::225::IOProcess::(_processLogs) (273910) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:48,878::__init__::225::IOProcess::(_processLogs) (273910) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:48,878::__init__::225::IOProcess::(_processLogs) (273910) Building response >Thread-18::DEBUG::2014-07-08 16:57:48,878::__init__::225::IOProcess::(_processLogs) (273910) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:48,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:48,879::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:57:48,880::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:57:49,031::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000510666 s, 905 kB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:49,033::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:57:49,038::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:57:49,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:49,041::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:49,043::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:57:49,043::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:49,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:49,048::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:57:49,048::__init__::225::IOProcess::(_processLogs) (273911) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:49,051::__init__::225::IOProcess::(_processLogs) (273911) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:49,051::__init__::225::IOProcess::(_processLogs) (273911) Building response >Thread-18::DEBUG::2014-07-08 16:57:49,052::__init__::225::IOProcess::(_processLogs) (273911) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:49,052::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:49,052::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:57:49,055::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:57:49,055::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:49,055::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:49,055::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:49,056::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:49,056::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:49,056::__init__::225::IOProcess::(_processLogs) (273912) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:49,056::__init__::225::IOProcess::(_processLogs) (273912) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:49,057::__init__::225::IOProcess::(_processLogs) (273912) Building response >Thread-18::DEBUG::2014-07-08 16:57:49,057::__init__::225::IOProcess::(_processLogs) (273912) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:49,057::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:49,057::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:57:49,059::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:57:49,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:49,059::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:49,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:49,060::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:49,060::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:49,060::__init__::225::IOProcess::(_processLogs) (273913) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:49,061::__init__::225::IOProcess::(_processLogs) (273913) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:49,061::__init__::225::IOProcess::(_processLogs) (273913) Building response >Thread-18::DEBUG::2014-07-08 16:57:49,061::__init__::225::IOProcess::(_processLogs) (273913) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:49,061::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:49,062::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:57:49,063::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:57:49,063::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:57:49,063::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:49,063::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:49,064::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:49,064::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:49,064::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:49,064::__init__::225::IOProcess::(_processLogs) (273914) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:49,065::__init__::225::IOProcess::(_processLogs) (273914) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:49,065::__init__::225::IOProcess::(_processLogs) (273914) Building response >Thread-18::DEBUG::2014-07-08 16:57:49,065::__init__::225::IOProcess::(_processLogs) (273914) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:49,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:49,066::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 16:57:49,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`24580c02-7e6e-4d23-9caf-9bfe3a737822`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:57:49,357::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:57:49,358::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:57:49,359::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:57:49,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:49,359::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:49,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:49,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:49,360::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:49,360::__init__::225::IOProcess::(_processLogs) (273915) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:57:49,360::__init__::225::IOProcess::(_processLogs) (273915) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:57:49,361::__init__::225::IOProcess::(_processLogs) (273915) Building response >Thread-18::DEBUG::2014-07-08 16:57:49,361::__init__::225::IOProcess::(_processLogs) (273915) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:49,361::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:49,361::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:57:49,363::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:57:49,363::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:57:49,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:49,364::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:49,364::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:49,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:49,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:49,365::__init__::225::IOProcess::(_processLogs) (273916) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:57:49,365::__init__::225::IOProcess::(_processLogs) (273916) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:57:49,365::__init__::225::IOProcess::(_processLogs) (273916) Building response >Thread-18::DEBUG::2014-07-08 16:57:49,366::__init__::225::IOProcess::(_processLogs) (273916) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:49,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:49,366::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:57:49,367::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:57:49,368::task::1191::Storage.TaskManager.Task::(prepare) Task=`24580c02-7e6e-4d23-9caf-9bfe3a737822`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:57:49,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`24580c02-7e6e-4d23-9caf-9bfe3a737822`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:57:49,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:57:49,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:57:49,369::task::993::Storage.TaskManager.Task::(_decref) Task=`24580c02-7e6e-4d23-9caf-9bfe3a737822`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:57:49,448::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:57:49,449::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:57:50,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:50,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172925 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:57:52,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:52,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0958528 s, 10.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:54,057::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:54,059::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:54,060::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:54,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:55,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172699 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:57:56,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcf7c851-ec5a-452f-b536-836f738244fa`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:57:56,239::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:57:56,239::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510666', 'lastCheck': '7.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:57:56,240::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcf7c851-ec5a-452f-b536-836f738244fa`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510666', 'lastCheck': '7.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:57:56,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcf7c851-ec5a-452f-b536-836f738244fa`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:57:56,240::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:57:56,240::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:57:56,241::task::993::Storage.TaskManager.Task::(_decref) Task=`bcf7c851-ec5a-452f-b536-836f738244fa`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:57:56,282::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:57:57,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:57,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176484 s, 58.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:57:58,785::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:57:58,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`e694bb99-7d47-4c80-8cf5-a5a588c5f80a`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:57:58,787::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:57:58,802::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:57:58,803::task::1191::Storage.TaskManager.Task::(prepare) Task=`e694bb99-7d47-4c80-8cf5-a5a588c5f80a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:57:58,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`e694bb99-7d47-4c80-8cf5-a5a588c5f80a`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:57:58,803::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:57:58,804::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:57:58,804::task::993::Storage.TaskManager.Task::(_decref) Task=`e694bb99-7d47-4c80-8cf5-a5a588c5f80a`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:57:58,838::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:57:58,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`087f6556-49bc-4a3a-a63a-0be2803fd126`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:57:58,839::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:57:58,840::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c99d9dd5-828c-4835-998f-d1f2841e3768`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:57:58,840::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:57:58,841::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:57:58,841::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c99d9dd5-828c-4835-998f-d1f2841e3768`::Granted request >Thread-7083::DEBUG::2014-07-08 16:57:58,842::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`087f6556-49bc-4a3a-a63a-0be2803fd126`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:57:58,842::task::993::Storage.TaskManager.Task::(_decref) Task=`087f6556-49bc-4a3a-a63a-0be2803fd126`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:57:58,861::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:57:58,862::task::1191::Storage.TaskManager.Task::(prepare) Task=`087f6556-49bc-4a3a-a63a-0be2803fd126`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:57:58,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`087f6556-49bc-4a3a-a63a-0be2803fd126`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:57:58,863::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:57:58,863::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:57:58,863::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:57:58,864::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:57:58,864::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:57:58,864::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:57:58,865::task::993::Storage.TaskManager.Task::(_decref) Task=`087f6556-49bc-4a3a-a63a-0be2803fd126`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:59,069::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:57:59,071::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:57:59,074::__init__::225::IOProcess::(_processLogs) Message size is 147 >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:59,075::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:57:59,075::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:59,078::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:59,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm1::DEBUG::2014-07-08 16:57:59,080::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:57:59,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:59,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:59,084::__init__::225::IOProcess::(_processLogs) (273917) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:59,084::__init__::225::IOProcess::(_processLogs) (273917) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:59,085::__init__::225::IOProcess::(_processLogs) (273917) Building response >Thread-18::DEBUG::2014-07-08 16:57:59,085::__init__::225::IOProcess::(_processLogs) (273917) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:59,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:59,085::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:57:59,087::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:57:59,240::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000480216 s, 962 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:57:59,246::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:57:59,248::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:57:59,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:59,251::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:59,252::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:59,254::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:59,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:59,257::__init__::225::IOProcess::(_processLogs) (273918) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:57:59,258::__init__::225::IOProcess::(_processLogs) (273918) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:57:59,260::__init__::225::IOProcess::(_processLogs) (273918) Building response >Thread-18::DEBUG::2014-07-08 16:57:59,262::__init__::225::IOProcess::(_processLogs) (273918) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:59,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:59,265::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:57:59,274::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:57:59,276::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:57:59,278::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:59,280::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:59,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:59,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:59,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:59,286::__init__::225::IOProcess::(_processLogs) (273919) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:59,287::__init__::225::IOProcess::(_processLogs) (273919) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:59,288::__init__::225::IOProcess::(_processLogs) (273919) Building response >Thread-18::DEBUG::2014-07-08 16:57:59,290::__init__::225::IOProcess::(_processLogs) (273919) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:59,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:59,294::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:57:59,300::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:57:59,301::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:57:59,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:59,304::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:59,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:59,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:59,309::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:59,311::__init__::225::IOProcess::(_processLogs) (273920) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:59,312::__init__::225::IOProcess::(_processLogs) (273920) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:59,314::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273920) Building response >Thread-18::DEBUG::2014-07-08 16:57:59,315::__init__::225::IOProcess::(_processLogs) (273920) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:59,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:59,318::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:57:59,324::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:57:59,325::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:57:59,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:57:59,333::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:57:59,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:57:59,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:57:59,344::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:57:59,345::__init__::225::IOProcess::(_processLogs) (273921) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:57:59,346::__init__::225::IOProcess::(_processLogs) (273921) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:57:59,352::__init__::225::IOProcess::(_processLogs) (273921) Building response >Thread-18::DEBUG::2014-07-08 16:57:59,354::__init__::225::IOProcess::(_processLogs) (273921) Queuing response >Thread-18::DEBUG::2014-07-08 16:57:59,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:57:59,357::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:57:59,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:57:59,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186871 s, 54.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:58:01,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:01,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360794 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:58:03,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:04,133::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:04,135::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:04,136::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:58:04,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179722 s, 57.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:58:04,605::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:58:04,606::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:58:06,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:06,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173012 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:58:08,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:08,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.092456 s, 11.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:58:08,920::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:58:08,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`04e919f5-45ee-4527-a6c6-86a2f3c7e963`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:08,930::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:58:08,953::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:08,953::task::1191::Storage.TaskManager.Task::(prepare) Task=`04e919f5-45ee-4527-a6c6-86a2f3c7e963`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:08,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`04e919f5-45ee-4527-a6c6-86a2f3c7e963`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:08,954::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:08,954::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:08,954::task::993::Storage.TaskManager.Task::(_decref) Task=`04e919f5-45ee-4527-a6c6-86a2f3c7e963`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:58:08,967::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:58:08,968::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6abc322-65be-497b-8007-c93e727deab1`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:58:08,968::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:58:08,969::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ef6e61e1-953c-4951-ae58-e9a0c007deff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:58:08,970::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:58:08,970::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:58:08,970::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ef6e61e1-953c-4951-ae58-e9a0c007deff`::Granted request >Thread-7083::DEBUG::2014-07-08 16:58:08,971::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d6abc322-65be-497b-8007-c93e727deab1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:58:08,972::task::993::Storage.TaskManager.Task::(_decref) Task=`d6abc322-65be-497b-8007-c93e727deab1`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:58:08,992::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:08,992::task::1191::Storage.TaskManager.Task::(prepare) Task=`d6abc322-65be-497b-8007-c93e727deab1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:08,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6abc322-65be-497b-8007-c93e727deab1`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:58:08,993::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:58:08,993::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:58:08,994::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:58:08,994::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:58:08,994::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:58:08,994::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:58:08,995::task::993::Storage.TaskManager.Task::(_decref) Task=`d6abc322-65be-497b-8007-c93e727deab1`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:09,143::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:09,145::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:09,146::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 16:58:09,407::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:09,407::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:09,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:09,411::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:09,413::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:09,415::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:09,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:09,417::__init__::225::IOProcess::(_processLogs) (273922) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:09,419::__init__::225::IOProcess::(_processLogs) (273922) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:09,421::__init__::225::IOProcess::(_processLogs) (273922) Building response >Thread-18::DEBUG::2014-07-08 16:58:09,422::__init__::225::IOProcess::(_processLogs) (273922) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:09,424::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:09,425::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:58:09,432::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:58:09,594::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00830308 s, 55.6 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:58:09,599::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:09,600::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:09,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:09,604::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:09,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:09,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:09,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:09,608::__init__::225::IOProcess::(_processLogs) (273923) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:09,610::__init__::225::IOProcess::(_processLogs) (273923) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:09,612::__init__::225::IOProcess::(_processLogs) (273923) Building response >Thread-18::DEBUG::2014-07-08 16:58:09,613::__init__::225::IOProcess::(_processLogs) (273923) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:09,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:09,615::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:58:09,621::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:09,623::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:58:09,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:09,626::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:09,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:09,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:09,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:09,630::__init__::225::IOProcess::(_processLogs) (273924) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:09,631::__init__::225::IOProcess::(_processLogs) (273924) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:09,632::__init__::225::IOProcess::(_processLogs) (273924) Building response >Thread-18::DEBUG::2014-07-08 16:58:09,634::__init__::225::IOProcess::(_processLogs) (273924) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:09,635::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:09,636::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:09,639::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:09,641::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:58:09,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:09,645::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:09,646::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:09,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:09,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:09,650::__init__::225::IOProcess::(_processLogs) (273925) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:09,651::__init__::225::IOProcess::(_processLogs) (273925) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:09,653::__init__::225::IOProcess::(_processLogs) (273925) Building response >Thread-18::DEBUG::2014-07-08 16:58:09,654::__init__::225::IOProcess::(_processLogs) (273925) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:09,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:09,656::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:09,662::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:09,663::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:58:09,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:09,666::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:09,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:09,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:09,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:09,672::__init__::225::IOProcess::(_processLogs) (273926) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:09,673::__init__::225::IOProcess::(_processLogs) (273926) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:09,675::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273926) Building response >Thread-18::DEBUG::2014-07-08 16:58:09,676::__init__::225::IOProcess::(_processLogs) (273926) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:09,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:09,683::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:58:10,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:11,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188002 s, 54.5 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:58:11,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc0ec82d-4735-423a-a723-348517933076`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:11,412::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:58:11,413::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00830308', 'lastCheck': '1.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:58:11,413::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc0ec82d-4735-423a-a723-348517933076`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00830308', 'lastCheck': '1.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:58:11,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc0ec82d-4735-423a-a723-348517933076`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:11,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:11,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:11,414::task::993::Storage.TaskManager.Task::(_decref) Task=`cc0ec82d-4735-423a-a723-348517933076`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:58:11,471::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:58:13,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:13,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017121 s, 59.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:14,155::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:14,160::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:14,161::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:58:15,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:15,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017399 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:58:17,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:17,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175627 s, 58.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:58:18,189::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7082::DEBUG::2014-07-08 16:58:19,011::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:58:19,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`086b8836-d0fd-487f-87fb-3cf86a719b85`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:19,012::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:58:19,028::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:19,029::task::1191::Storage.TaskManager.Task::(prepare) Task=`086b8836-d0fd-487f-87fb-3cf86a719b85`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:19,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`086b8836-d0fd-487f-87fb-3cf86a719b85`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:19,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:19,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:19,030::task::993::Storage.TaskManager.Task::(_decref) Task=`086b8836-d0fd-487f-87fb-3cf86a719b85`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:58:19,041::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:58:19,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`22ba6d65-47a0-435f-a567-fafe51848daa`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:58:19,043::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:58:19,043::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`767d5235-ff32-41bb-9fa5-35e5f16de96c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:58:19,044::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:58:19,044::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:58:19,044::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`767d5235-ff32-41bb-9fa5-35e5f16de96c`::Granted request >Thread-7083::DEBUG::2014-07-08 16:58:19,045::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`22ba6d65-47a0-435f-a567-fafe51848daa`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:58:19,045::task::993::Storage.TaskManager.Task::(_decref) Task=`22ba6d65-47a0-435f-a567-fafe51848daa`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:58:19,064::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:19,065::task::1191::Storage.TaskManager.Task::(prepare) Task=`22ba6d65-47a0-435f-a567-fafe51848daa`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:19,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`22ba6d65-47a0-435f-a567-fafe51848daa`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:58:19,065::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:58:19,066::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:58:19,066::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:58:19,066::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:58:19,067::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:58:19,067::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:58:19,067::task::993::Storage.TaskManager.Task::(_decref) Task=`22ba6d65-47a0-435f-a567-fafe51848daa`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:19,168::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:19,170::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:19,171::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 16:58:19,657::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:58:19,662::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 16:58:19,689::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:19,690::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:19,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:19,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:19,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:19,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:19,692::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:19,692::__init__::225::IOProcess::(_processLogs) (273927) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:19,692::__init__::225::IOProcess::(_processLogs) (273927) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:19,692::__init__::225::IOProcess::(_processLogs) (273927) Building response >Thread-18::DEBUG::2014-07-08 16:58:19,692::__init__::225::IOProcess::(_processLogs) (273927) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:19,693::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:19,693::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:58:19,695::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:58:19,849::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000502845 s, 919 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:58:19,855::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:19,857::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:19,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:19,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:19,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:19,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:19,865::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:19,867::__init__::225::IOProcess::(_processLogs) (273928) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:19,868::__init__::225::IOProcess::(_processLogs) (273928) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:19,870::__init__::225::IOProcess::(_processLogs) (273928) Building response >Thread-18::DEBUG::2014-07-08 16:58:19,872::__init__::225::IOProcess::(_processLogs) (273928) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:19,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:19,876::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:58:19,885::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:19,887::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:58:19,888::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:19,890::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:19,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:19,893::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:19,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:19,897::__init__::225::IOProcess::(_processLogs) (273929) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:19,898::__init__::225::IOProcess::(_processLogs) (273929) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:19,900::__init__::225::IOProcess::(_processLogs) (273929) Building response >Thread-18::DEBUG::2014-07-08 16:58:19,902::__init__::225::IOProcess::(_processLogs) (273929) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:19,903::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:19,904::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:19,910::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:19,912::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:58:19,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:19,915::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:19,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:19,918::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:19,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:19,922::__init__::225::IOProcess::(_processLogs) (273930) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:19,923::__init__::225::IOProcess::(_processLogs) (273930) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:19,924::__init__::225::IOProcess::(_processLogs) (273930) Building response >Thread-18::DEBUG::2014-07-08 16:58:19,926::__init__::225::IOProcess::(_processLogs) (273930) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:19,927::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:19,929::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:19,935::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:19,936::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:58:19,937::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:19,939::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:19,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:19,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:19,944::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:19,946::__init__::225::IOProcess::(_processLogs) (273931) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:19,948::__init__::225::IOProcess::(_processLogs) (273931) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:19,949::__init__::225::IOProcess::(_processLogs) (273931) Building response >Thread-18::DEBUG::2014-07-08 16:58:19,950::__init__::225::IOProcess::(_processLogs) (273931) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:19,951::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:19,953::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:58:19,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:20,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0933103 s, 11.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:58:22,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:22,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174135 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:24,178::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:24,179::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:24,181::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:58:24,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:24,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172738 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:58:26,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`7df0670b-8dac-4ab5-8442-22f7556b63bd`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:26,762::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:58:26,763::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502845', 'lastCheck': '6.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:58:26,763::task::1191::Storage.TaskManager.Task::(prepare) Task=`7df0670b-8dac-4ab5-8442-22f7556b63bd`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502845', 'lastCheck': '6.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:58:26,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`7df0670b-8dac-4ab5-8442-22f7556b63bd`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:26,764::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:26,764::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:26,764::task::993::Storage.TaskManager.Task::(_decref) Task=`7df0670b-8dac-4ab5-8442-22f7556b63bd`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:58:26,800::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:58:26,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:27,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173741 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:58:29,090::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:58:29,092::task::595::Storage.TaskManager.Task::(_updateState) Task=`b61a81c1-a0f8-41dd-a715-b7db707fbfbb`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:29,092::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:58:29,107::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:29,107::task::1191::Storage.TaskManager.Task::(prepare) Task=`b61a81c1-a0f8-41dd-a715-b7db707fbfbb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:29,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`b61a81c1-a0f8-41dd-a715-b7db707fbfbb`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:29,108::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:29,108::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:29,108::task::993::Storage.TaskManager.Task::(_decref) Task=`b61a81c1-a0f8-41dd-a715-b7db707fbfbb`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:58:29,122::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:58:29,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`a06e9976-9b72-4fc2-8f25-83da69adccba`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:58:29,123::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:58:29,124::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2d4fc8ff-5e2c-41bf-b5ec-e80dc7eec221`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:58:29,124::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:58:29,125::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:58:29,125::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2d4fc8ff-5e2c-41bf-b5ec-e80dc7eec221`::Granted request >Thread-7083::DEBUG::2014-07-08 16:58:29,126::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a06e9976-9b72-4fc2-8f25-83da69adccba`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:58:29,126::task::993::Storage.TaskManager.Task::(_decref) Task=`a06e9976-9b72-4fc2-8f25-83da69adccba`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:58:29,145::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:29,145::task::1191::Storage.TaskManager.Task::(prepare) Task=`a06e9976-9b72-4fc2-8f25-83da69adccba`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:29,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`a06e9976-9b72-4fc2-8f25-83da69adccba`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:58:29,146::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:58:29,146::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:58:29,147::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:58:29,147::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:58:29,147::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:58:29,148::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:58:29,148::task::993::Storage.TaskManager.Task::(_decref) Task=`a06e9976-9b72-4fc2-8f25-83da69adccba`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:29,188::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:29,190::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:29,191::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:58:29,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:29,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017425 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:58:29,960::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:29,961::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:29,961::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:29,961::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:29,961::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:29,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:29,962::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:29,962::__init__::225::IOProcess::(_processLogs) (273932) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:29,962::__init__::225::IOProcess::(_processLogs) (273932) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:29,963::__init__::225::IOProcess::(_processLogs) (273932) Building response >Thread-18::DEBUG::2014-07-08 16:58:29,963::__init__::225::IOProcess::(_processLogs) (273932) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:29,963::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:29,963::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:58:29,965::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:58:30,116::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000454515 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:58:30,118::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:30,118::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:30,119::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:30,119::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:30,119::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:30,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:30,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:30,120::__init__::225::IOProcess::(_processLogs) (273933) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:30,120::__init__::225::IOProcess::(_processLogs) (273933) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:30,120::__init__::225::IOProcess::(_processLogs) (273933) Building response >Thread-18::DEBUG::2014-07-08 16:58:30,121::__init__::225::IOProcess::(_processLogs) (273933) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:30,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:30,121::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:58:30,123::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:30,124::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:58:30,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:30,124::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:30,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:30,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:30,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:30,125::__init__::225::IOProcess::(_processLogs) (273934) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:30,125::__init__::225::IOProcess::(_processLogs) (273934) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:30,126::__init__::225::IOProcess::(_processLogs) (273934) Building response >Thread-18::DEBUG::2014-07-08 16:58:30,126::__init__::225::IOProcess::(_processLogs) (273934) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:30,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:30,126::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:30,127::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:30,128::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:58:30,128::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:30,128::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:30,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:30,129::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:30,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:30,129::__init__::225::IOProcess::(_processLogs) (273935) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:30,129::__init__::225::IOProcess::(_processLogs) (273935) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:30,130::__init__::225::IOProcess::(_processLogs) (273935) Building response >Thread-18::DEBUG::2014-07-08 16:58:30,130::__init__::225::IOProcess::(_processLogs) (273935) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:30,130::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:30,130::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:30,131::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:30,132::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:58:30,132::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:30,132::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:30,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:30,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:30,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:30,133::__init__::225::IOProcess::(_processLogs) (273936) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:30,133::__init__::225::IOProcess::(_processLogs) (273936) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:30,134::__init__::225::IOProcess::(_processLogs) (273936) Building response >Thread-18::DEBUG::2014-07-08 16:58:30,134::__init__::225::IOProcess::(_processLogs) (273936) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:30,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:30,134::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:58:31,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:31,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174141 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:58:33,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:34,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017663 s, 58.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:34,199::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:34,201::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:34,202::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 16:58:34,698::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:58:34,700::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:58:36,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:36,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174565 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:58:38,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:38,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0227015 s, 45.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:58:39,162::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:58:39,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`e432f68f-ebf9-4b52-ad86-b2d9053579ac`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:39,163::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:58:39,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:39,179::task::1191::Storage.TaskManager.Task::(prepare) Task=`e432f68f-ebf9-4b52-ad86-b2d9053579ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:39,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`e432f68f-ebf9-4b52-ad86-b2d9053579ac`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:39,179::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:39,179::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:39,180::task::993::Storage.TaskManager.Task::(_decref) Task=`e432f68f-ebf9-4b52-ad86-b2d9053579ac`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:58:39,192::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:58:39,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`705b6f87-b942-4e5f-add4-ced5b85ba913`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:58:39,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:58:39,194::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`52cab951-4914-405d-912b-b11971da10af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:58:39,194::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:58:39,195::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:58:39,195::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`52cab951-4914-405d-912b-b11971da10af`::Granted request >Thread-7083::DEBUG::2014-07-08 16:58:39,195::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`705b6f87-b942-4e5f-add4-ced5b85ba913`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:58:39,196::task::993::Storage.TaskManager.Task::(_decref) Task=`705b6f87-b942-4e5f-add4-ced5b85ba913`::ref 1 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:39,208::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:39,210::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:39,211::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7083::INFO::2014-07-08 16:58:39,215::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:39,215::task::1191::Storage.TaskManager.Task::(prepare) Task=`705b6f87-b942-4e5f-add4-ced5b85ba913`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:39,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`705b6f87-b942-4e5f-add4-ced5b85ba913`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:58:39,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:58:39,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:58:39,216::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:58:39,217::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:58:39,217::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:58:39,217::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:58:39,217::task::993::Storage.TaskManager.Task::(_decref) Task=`705b6f87-b942-4e5f-add4-ced5b85ba913`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:58:40,137::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:40,138::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:40,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:40,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:40,138::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:40,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:40,139::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:40,139::__init__::225::IOProcess::(_processLogs) (273937) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:40,139::__init__::225::IOProcess::(_processLogs) (273937) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:40,140::__init__::225::IOProcess::(_processLogs) (273937) Building response >Thread-18::DEBUG::2014-07-08 16:58:40,140::__init__::225::IOProcess::(_processLogs) (273937) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:40,140::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:40,140::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:58:40,142::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:58:40,291::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00267932 s, 172 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:58:40,293::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:40,294::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:40,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:40,294::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:40,295::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:40,295::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:40,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:40,295::__init__::225::IOProcess::(_processLogs) (273938) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:40,296::__init__::225::IOProcess::(_processLogs) (273938) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:40,296::__init__::225::IOProcess::(_processLogs) (273938) Building response >Thread-18::DEBUG::2014-07-08 16:58:40,296::__init__::225::IOProcess::(_processLogs) (273938) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:40,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:40,298::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:58:40,300::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:40,300::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:58:40,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:40,301::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:40,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:40,301::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:40,302::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:40,302::__init__::225::IOProcess::(_processLogs) (273939) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:40,302::__init__::225::IOProcess::(_processLogs) (273939) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:40,302::__init__::225::IOProcess::(_processLogs) (273939) Building response >Thread-18::DEBUG::2014-07-08 16:58:40,303::__init__::225::IOProcess::(_processLogs) (273939) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:40,303::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:40,303::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:40,304::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:40,304::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:58:40,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:40,305::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:40,305::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:40,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:40,306::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:40,306::__init__::225::IOProcess::(_processLogs) (273940) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:40,306::__init__::225::IOProcess::(_processLogs) (273940) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:40,306::__init__::225::IOProcess::(_processLogs) (273940) Building response >Thread-18::DEBUG::2014-07-08 16:58:40,307::__init__::225::IOProcess::(_processLogs) (273940) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:40,307::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:40,307::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:40,308::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:40,308::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:58:40,309::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:40,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:40,309::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:40,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:40,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:40,310::__init__::225::IOProcess::(_processLogs) (273941) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:40,310::__init__::225::IOProcess::(_processLogs) (273941) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:40,310::__init__::225::IOProcess::(_processLogs) (273941) Building response >Thread-18::DEBUG::2014-07-08 16:58:40,311::__init__::225::IOProcess::(_processLogs) (273941) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:40,311::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:40,311::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:58:40,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:40,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0850433 s, 12.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:58:41,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e0f5258-5815-4f88-a65f-6ae5d3f192ed`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:41,926::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:58:41,926::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00267932', 'lastCheck': '1.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:58:41,927::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e0f5258-5815-4f88-a65f-6ae5d3f192ed`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00267932', 'lastCheck': '1.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:58:41,927::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e0f5258-5815-4f88-a65f-6ae5d3f192ed`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:41,927::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:41,927::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:41,928::task::993::Storage.TaskManager.Task::(_decref) Task=`0e0f5258-5815-4f88-a65f-6ae5d3f192ed`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:58:41,960::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:58:43,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:43,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172311 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:44,219::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:44,220::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:44,221::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:58:45,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:45,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172059 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:58:47,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:48,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173068 s, 59.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:58:48,524::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:49,228::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:49,230::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:49,231::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:58:49,237::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:58:49,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a6129d1-3bd8-4a39-a23f-8786d7f033bf`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:49,238::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:58:49,253::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:49,254::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a6129d1-3bd8-4a39-a23f-8786d7f033bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:49,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a6129d1-3bd8-4a39-a23f-8786d7f033bf`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:49,254::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:49,254::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:49,255::task::993::Storage.TaskManager.Task::(_decref) Task=`9a6129d1-3bd8-4a39-a23f-8786d7f033bf`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:58:49,266::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:58:49,267::task::595::Storage.TaskManager.Task::(_updateState) Task=`60db2263-22ab-47a7-9feb-3c31d5cfd974`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:58:49,268::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:58:49,269::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`048843f8-143b-4a88-87c6-0d3bc7476ae0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:58:49,269::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:58:49,269::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:58:49,270::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`048843f8-143b-4a88-87c6-0d3bc7476ae0`::Granted request >Thread-7083::DEBUG::2014-07-08 16:58:49,270::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`60db2263-22ab-47a7-9feb-3c31d5cfd974`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:58:49,271::task::993::Storage.TaskManager.Task::(_decref) Task=`60db2263-22ab-47a7-9feb-3c31d5cfd974`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:58:49,297::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:49,297::task::1191::Storage.TaskManager.Task::(prepare) Task=`60db2263-22ab-47a7-9feb-3c31d5cfd974`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:49,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`60db2263-22ab-47a7-9feb-3c31d5cfd974`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:58:49,298::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:58:49,298::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:58:49,298::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:58:49,299::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:58:49,299::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:58:49,299::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:58:49,300::task::993::Storage.TaskManager.Task::(_decref) Task=`60db2263-22ab-47a7-9feb-3c31d5cfd974`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:58:49,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`4849d8f6-856c-4b63-9785-b5a273f03416`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:58:49,716::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:58:49,717::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:49,717::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:58:49,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:49,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:49,718::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:49,719::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:49,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:49,719::__init__::225::IOProcess::(_processLogs) (273942) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:58:49,719::__init__::225::IOProcess::(_processLogs) (273942) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:58:49,719::__init__::225::IOProcess::(_processLogs) (273942) Building response >Thread-18::DEBUG::2014-07-08 16:58:49,720::__init__::225::IOProcess::(_processLogs) (273942) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:49,720::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:49,720::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:58:49,722::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:49,722::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:58:49,723::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:49,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:49,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:49,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:49,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:49,724::__init__::225::IOProcess::(_processLogs) (273943) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:58:49,724::__init__::225::IOProcess::(_processLogs) (273943) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:58:49,724::__init__::225::IOProcess::(_processLogs) (273943) Building response >Thread-18::DEBUG::2014-07-08 16:58:49,724::__init__::225::IOProcess::(_processLogs) (273943) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:49,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:49,725::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:58:49,726::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:58:49,726::task::1191::Storage.TaskManager.Task::(prepare) Task=`4849d8f6-856c-4b63-9785-b5a273f03416`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:58:49,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`4849d8f6-856c-4b63-9785-b5a273f03416`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:58:49,727::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:58:49,727::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:58:49,727::task::993::Storage.TaskManager.Task::(_decref) Task=`4849d8f6-856c-4b63-9785-b5a273f03416`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:58:49,810::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:58:49,811::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:58:50,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:50,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017818 s, 57.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:58:50,332::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:50,333::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:50,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:50,335::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:50,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:50,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:50,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:50,339::__init__::225::IOProcess::(_processLogs) (273944) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:50,340::__init__::225::IOProcess::(_processLogs) (273944) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:50,341::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(273944) Building response >Thread-18::DEBUG::2014-07-08 16:58:50,342::__init__::225::IOProcess::(_processLogs) (273944) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:50,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:50,344::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:58:50,350::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:58:50,507::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00792539 s, 58.3 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:58:50,511::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:50,511::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:58:50,512::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:50,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:50,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:50,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:50,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:50,514::__init__::225::IOProcess::(_processLogs) (273945) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:58:50,514::__init__::225::IOProcess::(_processLogs) (273945) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:58:50,515::__init__::225::IOProcess::(_processLogs) (273945) Building response >Thread-18::DEBUG::2014-07-08 16:58:50,515::__init__::225::IOProcess::(_processLogs) (273945) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:50,515::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:50,516::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:58:50,520::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:50,521::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:58:50,521::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:50,522::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:50,522::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:50,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:50,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:50,523::__init__::225::IOProcess::(_processLogs) (273946) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:50,524::__init__::225::IOProcess::(_processLogs) (273946) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:50,524::__init__::225::IOProcess::(_processLogs) (273946) Building response >Thread-18::DEBUG::2014-07-08 16:58:50,524::__init__::225::IOProcess::(_processLogs) (273946) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:50,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:50,525::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:50,528::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:50,530::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:58:50,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:50,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:50,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:50,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:50,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:50,536::__init__::225::IOProcess::(_processLogs) (273947) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:50,536::__init__::225::IOProcess::(_processLogs) (273947) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:50,538::__init__::225::IOProcess::(_processLogs) DEBUG|(273947) Building response >Thread-18::DEBUG::2014-07-08 16:58:50,539::__init__::225::IOProcess::(_processLogs) (273947) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:50,540::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:50,541::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:58:50,544::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:58:50,545::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:58:50,547::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:58:50,548::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:58:50,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:58:50,550::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:58:50,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:58:50,552::__init__::225::IOProcess::(_processLogs) (273948) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:58:50,553::__init__::225::IOProcess::(_processLogs) (273948) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:58:50,554::__init__::225::IOProcess::(_processLogs) (273948) Building response >Thread-18::DEBUG::2014-07-08 16:58:50,555::__init__::225::IOProcess::(_processLogs) (273948) Queuing response >Thread-18::DEBUG::2014-07-08 16:58:50,556::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:58:50,557::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:58:52,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:52,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173356 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:54,238::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:54,239::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:54,241::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:58:54,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:55,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040743 s, 25.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:58:57,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`91e40048-1f14-4f7d-a8cb-798ec80c8a9b`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:57,111::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:58:57,111::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00792539', 'lastCheck': '6.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:58:57,111::task::1191::Storage.TaskManager.Task::(prepare) Task=`91e40048-1f14-4f7d-a8cb-798ec80c8a9b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00792539', 'lastCheck': '6.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:58:57,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`91e40048-1f14-4f7d-a8cb-798ec80c8a9b`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:57,112::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:57,112::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:57,112::task::993::Storage.TaskManager.Task::(_decref) Task=`91e40048-1f14-4f7d-a8cb-798ec80c8a9b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:58:57,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:57,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0764751 s, 13.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:58:57,532::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:59,247::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:59,249::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:58:59,250::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:58:59,318::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:58:59,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`557a64a6-62bb-4f54-808a-4dc991974ffc`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:58:59,319::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:58:59,334::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:59,334::task::1191::Storage.TaskManager.Task::(prepare) Task=`557a64a6-62bb-4f54-808a-4dc991974ffc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:58:59,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`557a64a6-62bb-4f54-808a-4dc991974ffc`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:58:59,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:58:59,335::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:58:59,335::task::993::Storage.TaskManager.Task::(_decref) Task=`557a64a6-62bb-4f54-808a-4dc991974ffc`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:58:59,349::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:58:59,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75b9324-1edd-4a3c-bb90-ffc3b74c7b6e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:58:59,350::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:58:59,351::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0796a23f-e221-43a0-90e6-4c6775c03164`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:58:59,351::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:58:59,352::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:58:59,352::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0796a23f-e221-43a0-90e6-4c6775c03164`::Granted request >Thread-7083::DEBUG::2014-07-08 16:58:59,353::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f75b9324-1edd-4a3c-bb90-ffc3b74c7b6e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:58:59,353::task::993::Storage.TaskManager.Task::(_decref) Task=`f75b9324-1edd-4a3c-bb90-ffc3b74c7b6e`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:58:59,372::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:59,372::task::1191::Storage.TaskManager.Task::(prepare) Task=`f75b9324-1edd-4a3c-bb90-ffc3b74c7b6e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:58:59,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75b9324-1edd-4a3c-bb90-ffc3b74c7b6e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:58:59,373::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:58:59,373::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:58:59,373::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:58:59,374::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:58:59,374::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:58:59,374::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:58:59,375::task::993::Storage.TaskManager.Task::(_decref) Task=`f75b9324-1edd-4a3c-bb90-ffc3b74c7b6e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:58:59,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:58:59,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176917 s, 57.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:00,562::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:00,563::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:00,563::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:00,564::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:00,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:00,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:00,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:00,565::__init__::225::IOProcess::(_processLogs) (273949) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:00,565::__init__::225::IOProcess::(_processLogs) (273949) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:00,565::__init__::225::IOProcess::(_processLogs) (273949) Building response >Thread-18::DEBUG::2014-07-08 16:59:00,565::__init__::225::IOProcess::(_processLogs) (273949) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:00,566::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:00,566::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:59:00,567::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:59:00,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00293745 s, 157 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:00,723::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:00,723::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:00,723::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:00,724::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:00,724::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:00,724::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:00,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:00,725::__init__::225::IOProcess::(_processLogs) (273950) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:00,725::__init__::225::IOProcess::(_processLogs) (273950) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:00,725::__init__::225::IOProcess::(_processLogs) (273950) Building response >Thread-18::DEBUG::2014-07-08 16:59:00,726::__init__::225::IOProcess::(_processLogs) (273950) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:00,726::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:00,726::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:59:00,728::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:00,728::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:59:00,729::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:00,729::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:00,729::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:00,730::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:00,730::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:00,730::__init__::225::IOProcess::(_processLogs) (273951) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:00,730::__init__::225::IOProcess::(_processLogs) (273951) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:00,731::__init__::225::IOProcess::(_processLogs) (273951) Building response >Thread-18::DEBUG::2014-07-08 16:59:00,731::__init__::225::IOProcess::(_processLogs) (273951) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:00,731::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:00,731::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:00,732::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:00,733::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:59:00,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:00,733::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:00,734::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:00,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:00,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:00,734::__init__::225::IOProcess::(_processLogs) (273952) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:00,734::__init__::225::IOProcess::(_processLogs) (273952) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:00,735::__init__::225::IOProcess::(_processLogs) (273952) Building response >Thread-18::DEBUG::2014-07-08 16:59:00,735::__init__::225::IOProcess::(_processLogs) (273952) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:00,735::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:00,735::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:00,737::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:00,737::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:59:00,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:00,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:00,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:00,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:00,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:00,739::__init__::225::IOProcess::(_processLogs) (273953) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:00,739::__init__::225::IOProcess::(_processLogs) (273953) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:00,739::__init__::225::IOProcess::(_processLogs) (273953) Building response >Thread-18::DEBUG::2014-07-08 16:59:00,739::__init__::225::IOProcess::(_processLogs) (273953) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:00,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:00,740::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:59:01,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:02,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174766 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:59:04,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:04,265::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:04,267::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:04,269::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:59:04,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178652 s, 57.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:59:05,027::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:59:05,028::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:59:06,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:06,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173012 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:59:08,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:08,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172755 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:09,277::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:09,279::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:09,280::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:59:09,390::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:59:09,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ba2dddf-b519-4e57-aef0-39c9804d82ba`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:09,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:59:09,406::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:09,407::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ba2dddf-b519-4e57-aef0-39c9804d82ba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:09,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ba2dddf-b519-4e57-aef0-39c9804d82ba`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:59:09,407::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:59:09,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:59:09,408::task::993::Storage.TaskManager.Task::(_decref) Task=`8ba2dddf-b519-4e57-aef0-39c9804d82ba`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:59:09,421::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:59:09,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`484e591f-f8fc-40fb-a3de-0170bcbe0a4f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:59:09,422::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:59:09,423::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`37e8ba53-8e92-49c4-9c37-cfee7a75b933`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:59:09,424::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:59:09,424::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:59:09,424::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`37e8ba53-8e92-49c4-9c37-cfee7a75b933`::Granted request >Thread-7083::DEBUG::2014-07-08 16:59:09,425::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`484e591f-f8fc-40fb-a3de-0170bcbe0a4f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:59:09,425::task::993::Storage.TaskManager.Task::(_decref) Task=`484e591f-f8fc-40fb-a3de-0170bcbe0a4f`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:59:09,444::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:09,444::task::1191::Storage.TaskManager.Task::(prepare) Task=`484e591f-f8fc-40fb-a3de-0170bcbe0a4f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:09,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`484e591f-f8fc-40fb-a3de-0170bcbe0a4f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:59:09,445::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:59:09,445::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:59:09,446::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:59:09,446::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:59:09,446::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:59:09,446::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:59:09,447::task::993::Storage.TaskManager.Task::(_decref) Task=`484e591f-f8fc-40fb-a3de-0170bcbe0a4f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:59:10,743::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:10,743::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:10,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:10,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:10,744::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:10,744::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:10,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:10,745::__init__::225::IOProcess::(_processLogs) (273954) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:10,745::__init__::225::IOProcess::(_processLogs) (273954) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:10,745::__init__::225::IOProcess::(_processLogs) (273954) Building response >Thread-18::DEBUG::2014-07-08 16:59:10,745::__init__::225::IOProcess::(_processLogs) (273954) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:10,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:10,746::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:59:10,747::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:10,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 16:59:10,895::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000490832 s, 941 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:11,055::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:11,056::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:11,056::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:11,057::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:11,057::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:11,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:11,057::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:11,058::__init__::225::IOProcess::(_processLogs) (273955) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:11,058::__init__::225::IOProcess::(_processLogs) (273955) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:11,061::__init__::225::IOProcess::(_processLogs) DEBUG|(273955) Building response >Thread-18::DEBUG::2014-07-08 16:59:11,062::__init__::225::IOProcess::(_processLogs) DEBUG|(273955) Building responseDEBUG|(273955) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:11,062::__init__::225::IOProcess::(_processLogs) DEBUG|(273955) Building responseDEBUG|(273955) Queuing responseDEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 16:59:11,063::__init__::225::IOProcess::(_processLogs) DEBUG|(273955) Building responseDEBUG|(273955) Queuing responseDEBUG|Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:59:11,067::__init__::225::IOProcess::(_processLogs) DEBUG|(273955) Building responseDEBUG|(273955) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:11,069::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:59:11,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:11,073::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:11,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:11,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:11,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:11,080::__init__::225::IOProcess::(_processLogs) (273956) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:11,082::__init__::225::IOProcess::(_processLogs) (273956) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:11,083::__init__::225::IOProcess::(_processLogs) (273956) Building response >Thread-18::DEBUG::2014-07-08 16:59:11,085::__init__::225::IOProcess::(_processLogs) (273956) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:11,086::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:11,087::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:11,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:11,093::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:59:11,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:11,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:11,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:11,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:11,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 16:59:11,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408282 s, 25.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:11,159::__init__::225::IOProcess::(_processLogs) (273957) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:11,161::__init__::225::IOProcess::(_processLogs) (273957) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:11,162::__init__::225::IOProcess::(_processLogs) (273957) Building response >Thread-18::DEBUG::2014-07-08 16:59:11,163::__init__::225::IOProcess::(_processLogs) (273957) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:11,164::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:11,165::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:11,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:11,170::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:59:11,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:11,173::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:11,175::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:11,176::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:11,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:11,178::__init__::225::IOProcess::(_processLogs) (273958) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:11,179::__init__::225::IOProcess::(_processLogs) (273958) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:11,180::__init__::225::IOProcess::(_processLogs) (273958) Building response >Thread-18::DEBUG::2014-07-08 16:59:11,181::__init__::225::IOProcess::(_processLogs) (273958) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:11,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:11,183::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 16:59:12,801::task::595::Storage.TaskManager.Task::(_updateState) Task=`07a85f37-0fae-4730-9846-d411ccbc5b84`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:12,802::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:59:12,802::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490832', 'lastCheck': '1.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:59:12,803::task::1191::Storage.TaskManager.Task::(prepare) Task=`07a85f37-0fae-4730-9846-d411ccbc5b84`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490832', 'lastCheck': '1.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:59:12,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`07a85f37-0fae-4730-9846-d411ccbc5b84`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:59:12,803::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:59:12,803::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:59:12,804::task::993::Storage.TaskManager.Task::(_decref) Task=`07a85f37-0fae-4730-9846-d411ccbc5b84`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:59:12,839::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:59:13,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:13,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0943565 s, 10.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:14,288::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:14,289::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:14,290::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:59:15,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:15,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310889 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:59:17,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:18,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017563 s, 58.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:59:18,696::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:19,293::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:19,295::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:19,296::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:59:19,475::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:59:19,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`0836a4ee-de46-443c-8890-3a44c1e4159b`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:19,477::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:59:19,493::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:19,493::task::1191::Storage.TaskManager.Task::(prepare) Task=`0836a4ee-de46-443c-8890-3a44c1e4159b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:19,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`0836a4ee-de46-443c-8890-3a44c1e4159b`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:59:19,494::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:59:19,494::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:59:19,494::task::993::Storage.TaskManager.Task::(_decref) Task=`0836a4ee-de46-443c-8890-3a44c1e4159b`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:59:19,507::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:59:19,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`e774626b-4d3d-44cf-8bed-38af074400a7`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:59:19,508::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:59:19,509::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e7bf5839-845a-412f-86de-44585ca9fe75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:59:19,509::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:59:19,510::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:59:19,510::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e7bf5839-845a-412f-86de-44585ca9fe75`::Granted request >Thread-7083::DEBUG::2014-07-08 16:59:19,511::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e774626b-4d3d-44cf-8bed-38af074400a7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:59:19,511::task::993::Storage.TaskManager.Task::(_decref) Task=`e774626b-4d3d-44cf-8bed-38af074400a7`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:59:19,530::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:19,530::task::1191::Storage.TaskManager.Task::(prepare) Task=`e774626b-4d3d-44cf-8bed-38af074400a7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:19,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`e774626b-4d3d-44cf-8bed-38af074400a7`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:59:19,531::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:59:19,531::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:59:19,531::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:59:19,532::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:59:19,532::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:59:19,532::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:59:19,533::task::993::Storage.TaskManager.Task::(_decref) Task=`e774626b-4d3d-44cf-8bed-38af074400a7`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 16:59:20,107::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:59:20,107::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:59:20,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:20,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211002 s, 48.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:21,188::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:21,189::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:21,189::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:21,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:21,190::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:21,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:21,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:21,190::__init__::225::IOProcess::(_processLogs) (273959) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:21,191::__init__::225::IOProcess::(_processLogs) (273959) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:21,191::__init__::225::IOProcess::(_processLogs) (273959) Building response >Thread-18::DEBUG::2014-07-08 16:59:21,191::__init__::225::IOProcess::(_processLogs) (273959) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:21,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:21,192::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:59:21,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:59:21,346::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00594698 s, 77.7 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:21,348::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:21,348::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:21,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:21,349::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:21,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:21,349::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:21,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:21,350::__init__::225::IOProcess::(_processLogs) (273960) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:21,350::__init__::225::IOProcess::(_processLogs) (273960) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:21,350::__init__::225::IOProcess::(_processLogs) (273960) Building response >Thread-18::DEBUG::2014-07-08 16:59:21,351::__init__::225::IOProcess::(_processLogs) (273960) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:21,351::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:21,351::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:59:21,353::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:21,354::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:59:21,354::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:21,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:21,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:21,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:21,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:21,355::__init__::225::IOProcess::(_processLogs) (273961) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:21,355::__init__::225::IOProcess::(_processLogs) (273961) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:21,356::__init__::225::IOProcess::(_processLogs) (273961) Building response >Thread-18::DEBUG::2014-07-08 16:59:21,356::__init__::225::IOProcess::(_processLogs) (273961) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:21,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:21,356::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:21,357::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:21,358::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:59:21,358::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:21,358::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:21,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:21,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:21,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:21,359::__init__::225::IOProcess::(_processLogs) (273962) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:21,359::__init__::225::IOProcess::(_processLogs) (273962) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:21,360::__init__::225::IOProcess::(_processLogs) (273962) Building response >Thread-18::DEBUG::2014-07-08 16:59:21,360::__init__::225::IOProcess::(_processLogs) (273962) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:21,360::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:21,360::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:21,361::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:21,362::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:59:21,362::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:21,362::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:21,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:21,363::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:21,363::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:21,363::__init__::225::IOProcess::(_processLogs) (273963) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:21,363::__init__::225::IOProcess::(_processLogs) (273963) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:21,364::__init__::225::IOProcess::(_processLogs) (273963) Building response >Thread-18::DEBUG::2014-07-08 16:59:21,364::__init__::225::IOProcess::(_processLogs) (273963) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:21,364::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:21,364::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:59:22,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:22,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173428 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:24,303::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:24,305::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:24,306::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:59:24,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:24,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172973 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:59:26,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:27,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017235 s, 59.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:59:27,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cb58df5-2bbf-4bd9-a285-7c34842d6148`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:27,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:59:27,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00594698', 'lastCheck': '6.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:59:27,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`3cb58df5-2bbf-4bd9-a285-7c34842d6148`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00594698', 'lastCheck': '6.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:59:27,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cb58df5-2bbf-4bd9-a285-7c34842d6148`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:59:27,980::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:59:27,981::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:59:27,981::task::993::Storage.TaskManager.Task::(_decref) Task=`3cb58df5-2bbf-4bd9-a285-7c34842d6148`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:59:28,013::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:59:29,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:29,497::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:29,519::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:29,524::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:59:29,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.140227 s, 7.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:59:29,697::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:59:29,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`36e72078-21ff-426f-b0c0-28a006d098d6`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:29,703::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:59:29,739::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:29,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`36e72078-21ff-426f-b0c0-28a006d098d6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:29,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`36e72078-21ff-426f-b0c0-28a006d098d6`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:59:29,740::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:59:29,740::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:59:29,740::task::993::Storage.TaskManager.Task::(_decref) Task=`36e72078-21ff-426f-b0c0-28a006d098d6`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:59:29,752::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:59:29,753::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2c13ff4-d222-4cb8-8c21-4da3a4f45c6f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:59:29,754::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:59:29,755::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`39479581-db88-43df-a819-e63d7e5ef0a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:59:29,755::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:59:29,756::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:59:29,756::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`39479581-db88-43df-a819-e63d7e5ef0a4`::Granted request >Thread-7083::DEBUG::2014-07-08 16:59:29,757::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b2c13ff4-d222-4cb8-8c21-4da3a4f45c6f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:59:29,757::task::993::Storage.TaskManager.Task::(_decref) Task=`b2c13ff4-d222-4cb8-8c21-4da3a4f45c6f`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:59:29,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:29,787::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2c13ff4-d222-4cb8-8c21-4da3a4f45c6f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:29,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2c13ff4-d222-4cb8-8c21-4da3a4f45c6f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:59:29,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:59:29,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:59:29,789::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:59:29,789::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:59:29,789::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:59:29,790::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:59:29,790::task::993::Storage.TaskManager.Task::(_decref) Task=`b2c13ff4-d222-4cb8-8c21-4da3a4f45c6f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 16:59:31,367::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:31,368::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:31,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:31,368::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:31,368::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:31,369::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:31,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:31,369::__init__::225::IOProcess::(_processLogs) (273964) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:31,370::__init__::225::IOProcess::(_processLogs) (273964) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:31,370::__init__::225::IOProcess::(_processLogs) DEBUG|(273964) Building response >Thread-18::DEBUG::2014-07-08 16:59:31,370::__init__::225::IOProcess::(_processLogs) (273964) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:31,370::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:31,371::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:59:31,372::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:59:31,520::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000450324 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:31,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:31,522::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:31,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:31,523::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:31,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:31,523::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:31,524::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:31,524::__init__::225::IOProcess::(_processLogs) (273965) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:31,524::__init__::225::IOProcess::(_processLogs) (273965) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:31,524::__init__::225::IOProcess::(_processLogs) (273965) Building response >Thread-18::DEBUG::2014-07-08 16:59:31,525::__init__::225::IOProcess::(_processLogs) (273965) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:31,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:31,525::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:59:31,527::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:31,528::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:59:31,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:31,528::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:31,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:31,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:31,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:31,529::__init__::225::IOProcess::(_processLogs) (273966) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:31,530::__init__::225::IOProcess::(_processLogs) (273966) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:31,530::__init__::225::IOProcess::(_processLogs) (273966) Building response >Thread-18::DEBUG::2014-07-08 16:59:31,530::__init__::225::IOProcess::(_processLogs) (273966) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:31,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:31,531::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:31,532::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:31,532::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:59:31,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:31,532::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:31,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:31,533::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:31,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:31,533::__init__::225::IOProcess::(_processLogs) (273967) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:31,534::__init__::225::IOProcess::(_processLogs) (273967) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:31,534::__init__::225::IOProcess::(_processLogs) (273967) Building response >Thread-18::DEBUG::2014-07-08 16:59:31,534::__init__::225::IOProcess::(_processLogs) (273967) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:31,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:31,535::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:31,536::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:31,536::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:59:31,536::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:31,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:31,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:31,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:31,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:31,538::__init__::225::IOProcess::(_processLogs) (273968) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:31,538::__init__::225::IOProcess::(_processLogs) (273968) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:31,538::__init__::225::IOProcess::(_processLogs) (273968) Building response >Thread-18::DEBUG::2014-07-08 16:59:31,538::__init__::225::IOProcess::(_processLogs) (273968) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:31,539::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:31,539::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:59:31,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:31,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188583 s, 54.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:59:34,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:34,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296131 s, 34.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:34,537::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:34,543::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:34,547::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 16:59:35,224::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:59:35,226::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 16:59:36,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:36,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173135 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:59:38,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:38,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172238 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:39,557::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:39,559::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:39,560::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:59:39,805::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:59:39,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`cee8669e-0f76-49db-ad56-faa8aea7c880`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:39,806::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:59:39,821::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:39,822::task::1191::Storage.TaskManager.Task::(prepare) Task=`cee8669e-0f76-49db-ad56-faa8aea7c880`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:39,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`cee8669e-0f76-49db-ad56-faa8aea7c880`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:59:39,822::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:59:39,822::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:59:39,823::task::993::Storage.TaskManager.Task::(_decref) Task=`cee8669e-0f76-49db-ad56-faa8aea7c880`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:59:39,834::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:59:39,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`a80f1c83-ba9a-4d2f-b1c5-910872fdc9cd`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:59:39,836::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:59:39,837::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d9737524-7609-442f-ad52-2b36bac6da84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:59:39,837::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:59:39,837::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:59:39,838::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d9737524-7609-442f-ad52-2b36bac6da84`::Granted request >Thread-7083::DEBUG::2014-07-08 16:59:39,838::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a80f1c83-ba9a-4d2f-b1c5-910872fdc9cd`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:59:39,839::task::993::Storage.TaskManager.Task::(_decref) Task=`a80f1c83-ba9a-4d2f-b1c5-910872fdc9cd`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:59:39,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:39,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`a80f1c83-ba9a-4d2f-b1c5-910872fdc9cd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:39,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`a80f1c83-ba9a-4d2f-b1c5-910872fdc9cd`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:59:39,859::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:59:39,859::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:59:39,860::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:59:39,860::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:59:39,860::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:59:39,860::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:59:39,861::task::993::Storage.TaskManager.Task::(_decref) Task=`a80f1c83-ba9a-4d2f-b1c5-910872fdc9cd`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:59:40,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:41,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173749 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:41,542::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 16:59:41,542::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:41,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:41,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:41,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:41,543::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:41,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:41,544::__init__::225::IOProcess::(_processLogs) (273969) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:41,544::__init__::225::IOProcess::(_processLogs) (273969) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:41,544::__init__::225::IOProcess::(_processLogs) (273969) Building response >Thread-18::DEBUG::2014-07-08 16:59:41,544::__init__::225::IOProcess::(_processLogs) (273969) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:41,545::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:41,545::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:59:41,546::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:59:41,698::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000495303 s, 933 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:41,704::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:41,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:41,707::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:41,708::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:41,709::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:41,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:41,713::__init__::225::IOProcess::(_processLogs) (273970) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:41,714::__init__::225::IOProcess::(_processLogs) (273970) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:41,716::__init__::225::IOProcess::(_processLogs) (273970) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:41,718::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:41,719::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:59:41,728::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:59:41,729::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:41,731::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:41,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:41,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:41,736::__init__::225::IOProcess::(_processLogs) (273971) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:41,737::__init__::225::IOProcess::(_processLogs) (273971) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:41,739::__init__::225::IOProcess::(_processLogs) (273971) Building response >Thread-18::DEBUG::2014-07-08 16:59:41,740::__init__::225::IOProcess::(_processLogs) (273971) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:41,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:41,743::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:41,748::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:59:41,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:41,751::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:41,752::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:41,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:41,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:41,755::__init__::225::IOProcess::(_processLogs) (273972) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:41,757::__init__::225::IOProcess::(_processLogs) (273972) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:41,759::__init__::225::IOProcess::(_processLogs) (273972) Building response >Thread-18::DEBUG::2014-07-08 16:59:41,760::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:41,761::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:41,767::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:59:41,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:41,770::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:41,771::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:41,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:41,774::__init__::225::IOProcess::(_processLogs) (273973) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:41,775::__init__::225::IOProcess::(_processLogs) (273973) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:41,776::__init__::225::IOProcess::(_processLogs) (273973) Building response >Thread-18::DEBUG::2014-07-08 16:59:41,778::__init__::225::IOProcess::(_processLogs) (273973) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:41,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:41,781::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:59:43,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 16:59:43,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a96d2d5-4e8d-4712-89c2-d869df25781d`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:43,275::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:59:43,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495303', 'lastCheck': '1.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:59:43,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a96d2d5-4e8d-4712-89c2-d869df25781d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495303', 'lastCheck': '1.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:59:43,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a96d2d5-4e8d-4712-89c2-d869df25781d`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:59:43,282::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:59:43,283::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:59:43,284::task::993::Storage.TaskManager.Task::(_decref) Task=`1a96d2d5-4e8d-4712-89c2-d869df25781d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:59:43,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461131 s, 22.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:59:43,406::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:44,567::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:44,568::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:44,569::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:59:45,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:45,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901678 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:59:47,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:48,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174118 s, 58.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 16:59:48,871::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:49,576::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:49,577::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:49,578::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:59:49,885::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:59:49,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebc1880c-e911-495f-827f-4594687b181f`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:49,887::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 16:59:49,902::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:49,902::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebc1880c-e911-495f-827f-4594687b181f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 16:59:49,902::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebc1880c-e911-495f-827f-4594687b181f`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:59:49,903::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:59:49,903::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:59:49,903::task::993::Storage.TaskManager.Task::(_decref) Task=`ebc1880c-e911-495f-827f-4594687b181f`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 16:59:49,925::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 16:59:49,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`a55f4405-0e05-420d-ad2c-30a2b6508454`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 16:59:49,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 16:59:49,928::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cdd168ac-3f17-4270-ac80-0363dcf52447`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 16:59:49,928::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 16:59:49,928::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 16:59:49,929::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cdd168ac-3f17-4270-ac80-0363dcf52447`::Granted request >Thread-7083::DEBUG::2014-07-08 16:59:49,929::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a55f4405-0e05-420d-ad2c-30a2b6508454`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 16:59:49,930::task::993::Storage.TaskManager.Task::(_decref) Task=`a55f4405-0e05-420d-ad2c-30a2b6508454`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 16:59:49,949::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:49,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`a55f4405-0e05-420d-ad2c-30a2b6508454`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 16:59:49,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`a55f4405-0e05-420d-ad2c-30a2b6508454`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 16:59:49,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 16:59:49,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 16:59:49,950::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 16:59:49,951::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 16:59:49,951::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 16:59:49,951::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 16:59:49,952::task::993::Storage.TaskManager.Task::(_decref) Task=`a55f4405-0e05-420d-ad2c-30a2b6508454`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:59:50,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7086::DEBUG::2014-07-08 16:59:50,325::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6887abe-ef71-4bac-8fdc-6cfd7c5f647b`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 16:59:50,326::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 16:59:50,328::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:59:50,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:50,328::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:50,328::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:50,336::__init__::225::IOProcess::(_processLogs) (273974) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:50,337::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 16:59:50,345::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 16:59:50,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:50,348::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:50,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:50,351::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:50,353::__init__::225::IOProcess::(_processLogs) (273975) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 16:59:50,354::__init__::225::IOProcess::(_processLogs) (273975) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 16:59:50,355::__init__::225::IOProcess::(_processLogs) (273975) Building response >Thread-18::DEBUG::2014-07-08 16:59:50,356::__init__::225::IOProcess::(_processLogs) (273975) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:50,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:50,359::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 16:59:50,364::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:59:50,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6887abe-ef71-4bac-8fdc-6cfd7c5f647b`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 16:59:50,375::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6887abe-ef71-4bac-8fdc-6cfd7c5f647b`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 16:59:50,380::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 16:59:50,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 16:59:50,457::task::993::Storage.TaskManager.Task::(_decref) Task=`b6887abe-ef71-4bac-8fdc-6cfd7c5f647b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 16:59:50,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0613333 s, 16.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 16:59:50,554::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 16:59:50,555::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 16:59:51,786::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:51,787::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:51,787::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:51,787::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:51,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:51,788::__init__::225::IOProcess::(_processLogs) (273976) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:51,788::__init__::225::IOProcess::(_processLogs) (273976) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:51,788::__init__::225::IOProcess::(_processLogs) (273976) Building response >Thread-18::DEBUG::2014-07-08 16:59:51,789::__init__::225::IOProcess::(_processLogs) (273976) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:51,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:51,789::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 16:59:51,791::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 16:59:51,943::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000526869 s, 877 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 16:59:51,949::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 16:59:51,951::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:51,952::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:51,954::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:51,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:51,956::__init__::225::IOProcess::(_processLogs) (273977) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 16:59:51,957::__init__::225::IOProcess::(_processLogs) (273977) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 16:59:51,958::__init__::225::IOProcess::(_processLogs) (273977) Building response >Thread-18::DEBUG::2014-07-08 16:59:51,960::__init__::225::IOProcess::(_processLogs) (273977) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:51,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:51,962::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 16:59:51,971::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 16:59:51,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:51,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:51,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:51,976::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:51,978::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:51,979::__init__::225::IOProcess::(_processLogs) (273978) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:51,981::__init__::225::IOProcess::(_processLogs) (273978) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:51,982::__init__::225::IOProcess::(_processLogs) (273978) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:51,983::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:51,984::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:51,990::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 16:59:51,991::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:51,993::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:51,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:51,995::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:51,997::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 16:59:51,998::__init__::225::IOProcess::(_processLogs) (273979) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:52,000::__init__::225::IOProcess::(_processLogs) (273979) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:52,001::__init__::225::IOProcess::(_processLogs) (273979) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:52,002::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:52,004::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 16:59:52,009::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 16:59:52,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 16:59:52,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 16:59:52,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 16:59:52,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 16:59:52,016::__init__::225::IOProcess::(_processLogs) (273980) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 16:59:52,017::__init__::225::IOProcess::(_processLogs) (273980) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 16:59:52,018::__init__::225::IOProcess::(_processLogs) (273980) Building response >Thread-18::DEBUG::2014-07-08 16:59:52,020::__init__::225::IOProcess::(_processLogs) (273980) Queuing response >Thread-18::DEBUG::2014-07-08 16:59:52,021::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 16:59:52,022::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 16:59:52,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:52,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172403 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:54,585::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:54,587::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:54,588::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:59:54,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:55,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174258 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 16:59:57,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:57,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172842 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 16:59:58,557::task::595::Storage.TaskManager.Task::(_updateState) Task=`47a11063-9f3a-4d7e-93da-5caf50ee5011`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:58,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 16:59:58,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526869', 'lastCheck': '6.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:59:58,558::task::1191::Storage.TaskManager.Task::(prepare) Task=`47a11063-9f3a-4d7e-93da-5caf50ee5011`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526869', 'lastCheck': '6.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 16:59:58,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`47a11063-9f3a-4d7e-93da-5caf50ee5011`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 16:59:58,559::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 16:59:58,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 16:59:58,559::task::993::Storage.TaskManager.Task::(_decref) Task=`47a11063-9f3a-4d7e-93da-5caf50ee5011`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 16:59:58,592::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 16:59:59,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 16:59:59,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182535 s, 56.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:59,595::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:59,597::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 16:59:59,598::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 16:59:59,992::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 16:59:59,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`43d90cbc-59bf-4e52-b359-f867c0eec28c`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 16:59:59,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:00:00,012::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:00,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`43d90cbc-59bf-4e52-b359-f867c0eec28c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:00,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`43d90cbc-59bf-4e52-b359-f867c0eec28c`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:00:00,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:00:00,013::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:00:00,014::task::993::Storage.TaskManager.Task::(_decref) Task=`43d90cbc-59bf-4e52-b359-f867c0eec28c`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:00:00,025::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:00:00,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`9841527e-8b08-441a-9042-a629f4507762`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:00:00,027::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:00:00,028::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bd8037a0-3504-454a-b69e-282ca1a39b88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:00:00,028::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:00:00,028::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:00:00,029::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bd8037a0-3504-454a-b69e-282ca1a39b88`::Granted request >Thread-7083::DEBUG::2014-07-08 17:00:00,029::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9841527e-8b08-441a-9042-a629f4507762`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:00:00,029::task::993::Storage.TaskManager.Task::(_decref) Task=`9841527e-8b08-441a-9042-a629f4507762`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:00:00,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:00,051::task::1191::Storage.TaskManager.Task::(prepare) Task=`9841527e-8b08-441a-9042-a629f4507762`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:00,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`9841527e-8b08-441a-9042-a629f4507762`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:00:00,052::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:00:00,052::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:00:00,053::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:00:00,053::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:00:00,053::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:00:00,053::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:00:00,054::task::993::Storage.TaskManager.Task::(_decref) Task=`9841527e-8b08-441a-9042-a629f4507762`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:00:01,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:01,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103457 s, 9.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:02,052::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:02,074::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:02,074::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:02,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:02,075::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:02,075::__init__::225::IOProcess::(_processLogs) (273981) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:02,078::__init__::225::IOProcess::(_processLogs) (273981) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:02,079::__init__::225::IOProcess::(_processLogs) (273981) Building response >Thread-18::DEBUG::2014-07-08 17:00:02,079::__init__::225::IOProcess::(_processLogs) (273981) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:02,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:02,080::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:00:02,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:00:02,368::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000494743 s, 934 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:02,373::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:02,374::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:02,376::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:02,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:02,378::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:02,380::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:02,381::__init__::225::IOProcess::(_processLogs) (273982) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:02,382::__init__::225::IOProcess::(_processLogs) (273982) Building response >Thread-18::DEBUG::2014-07-08 17:00:02,383::__init__::225::IOProcess::(_processLogs) (273982) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:02,384::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:02,386::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:00:02,394::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:00:02,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:02,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:02,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:02,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:02,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:02,402::__init__::225::IOProcess::(_processLogs) (273983) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:02,403::__init__::225::IOProcess::(_processLogs) (273983) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:02,405::__init__::225::IOProcess::(_processLogs) (273983) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:02,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:02,408::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:02,414::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:00:02,416::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:02,418::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:02,419::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:02,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:02,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:02,423::__init__::225::IOProcess::(_processLogs) (273984) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:02,425::__init__::225::IOProcess::(_processLogs) (273984) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:02,427::__init__::225::IOProcess::(_processLogs) (273984) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:02,429::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:02,430::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:02,436::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:00:02,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:02,439::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:02,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:02,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:02,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:02,445::__init__::225::IOProcess::(_processLogs) (273985) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:02,447::__init__::225::IOProcess::(_processLogs) (273985) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:02,448::__init__::225::IOProcess::(_processLogs) (273985) Building response >Thread-18::DEBUG::2014-07-08 17:00:02,449::__init__::225::IOProcess::(_processLogs) (273985) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:02,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:02,452::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:00:03,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:04,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177202 s, 57.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:04,608::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:04,613::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:04,616::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:00:05,723::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:00:05,723::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:00:06,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:06,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174585 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:00:08,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:08,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173699 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:09,621::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:09,623::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:09,624::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:00:10,070::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:00:10,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e172070-1f8e-470b-91ee-f0e6731ee85f`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:00:10,071::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:00:10,086::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:10,087::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e172070-1f8e-470b-91ee-f0e6731ee85f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:10,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e172070-1f8e-470b-91ee-f0e6731ee85f`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:00:10,087::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:00:10,087::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:00:10,088::task::993::Storage.TaskManager.Task::(_decref) Task=`9e172070-1f8e-470b-91ee-f0e6731ee85f`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:00:10,101::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:00:10,102::task::595::Storage.TaskManager.Task::(_updateState) Task=`72ed8c01-05bb-4772-b6f1-b30e2029b365`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:00:10,103::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:00:10,104::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`324af5d0-27d0-47c8-8f4c-0a60c42704e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:00:10,104::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:00:10,104::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:00:10,105::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`324af5d0-27d0-47c8-8f4c-0a60c42704e8`::Granted request >Thread-7083::DEBUG::2014-07-08 17:00:10,105::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`72ed8c01-05bb-4772-b6f1-b30e2029b365`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:00:10,106::task::993::Storage.TaskManager.Task::(_decref) Task=`72ed8c01-05bb-4772-b6f1-b30e2029b365`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:00:10,125::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:10,126::task::1191::Storage.TaskManager.Task::(prepare) Task=`72ed8c01-05bb-4772-b6f1-b30e2029b365`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:10,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`72ed8c01-05bb-4772-b6f1-b30e2029b365`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:00:10,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:00:10,126::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:00:10,127::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:00:10,127::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:00:10,127::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:00:10,128::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:00:10,128::task::993::Storage.TaskManager.Task::(_decref) Task=`72ed8c01-05bb-4772-b6f1-b30e2029b365`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:00:10,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:11,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493816 s, 20.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:12,461::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:12,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:12,462::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:12,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:12,462::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:12,463::__init__::225::IOProcess::(_processLogs) (273986) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:12,463::__init__::225::IOProcess::(_processLogs) (273986) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:12,463::__init__::225::IOProcess::(_processLogs) (273986) Building response >Thread-18::DEBUG::2014-07-08 17:00:12,463::__init__::225::IOProcess::(_processLogs) (273986) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:12,463::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:12,464::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:00:12,465::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:00:12,618::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00047882 s, 965 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:12,624::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:12,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:12,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:12,629::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:12,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:12,632::__init__::225::IOProcess::(_processLogs) (273987) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:12,633::__init__::225::IOProcess::(_processLogs) (273987) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:12,634::__init__::225::IOProcess::(_processLogs) (273987) Building response >Thread-18::DEBUG::2014-07-08 17:00:12,635::__init__::225::IOProcess::(_processLogs) (273987) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:12,636::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:12,638::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:00:12,650::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:00:12,651::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:12,653::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:12,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:12,656::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:12,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:12,659::__init__::225::IOProcess::(_processLogs) (273988) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:12,660::__init__::225::IOProcess::(_processLogs) (273988) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:12,662::__init__::225::IOProcess::(_processLogs) (273988) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:12,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:12,665::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:12,671::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:00:12,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:12,675::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:12,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:12,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:12,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:12,681::__init__::225::IOProcess::(_processLogs) (273989) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:12,683::__init__::225::IOProcess::(_processLogs) (273989) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:12,685::__init__::225::IOProcess::(_processLogs) (273989) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:12,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:12,688::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:12,693::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:00:12,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:12,697::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:12,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:12,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:12,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:12,704::__init__::225::IOProcess::(_processLogs) (273990) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:12,705::__init__::225::IOProcess::(_processLogs) (273990) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:12,707::__init__::225::IOProcess::(_processLogs) (273990) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:12,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:12,710::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:00:13,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:13,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0236063 s, 43.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:00:13,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`4511dde7-79f7-4773-baf9-9f729fdcd6f0`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:00:13,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:00:13,963::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047882', 'lastCheck': '1.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:00:13,963::task::1191::Storage.TaskManager.Task::(prepare) Task=`4511dde7-79f7-4773-baf9-9f729fdcd6f0`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047882', 'lastCheck': '1.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:00:13,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`4511dde7-79f7-4773-baf9-9f729fdcd6f0`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:00:13,963::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:00:13,964::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:00:13,964::task::993::Storage.TaskManager.Task::(_decref) Task=`4511dde7-79f7-4773-baf9-9f729fdcd6f0`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:00:14,039::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:14,630::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:14,631::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:14,632::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:00:15,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:15,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245612 s, 41.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:00:17,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:17,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0218947 s, 46.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:00:19,361::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:19,640::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:19,641::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:19,642::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:00:20,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:00:20,170::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:00:20,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c5ad02d-21bf-4afa-95a6-b2e992120be5`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:00:20,182::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Dummy-6860::DEBUG::2014-07-08 17:00:20,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02367 s, 43.3 MB/s\n'; <rc> = 0 >Thread-7082::INFO::2014-07-08 17:00:20,265::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:20,267::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c5ad02d-21bf-4afa-95a6-b2e992120be5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:20,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c5ad02d-21bf-4afa-95a6-b2e992120be5`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:00:20,269::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:00:20,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:00:20,271::task::993::Storage.TaskManager.Task::(_decref) Task=`6c5ad02d-21bf-4afa-95a6-b2e992120be5`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:00:20,295::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:00:20,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4871563-9a42-4a47-91b4-f2d91aff7f18`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:00:20,296::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:00:20,297::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f13f6579-7357-4643-9466-97b02234e049`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:00:20,297::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:00:20,298::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:00:20,298::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f13f6579-7357-4643-9466-97b02234e049`::Granted request >Thread-7083::DEBUG::2014-07-08 17:00:20,299::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c4871563-9a42-4a47-91b4-f2d91aff7f18`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:00:20,299::task::993::Storage.TaskManager.Task::(_decref) Task=`c4871563-9a42-4a47-91b4-f2d91aff7f18`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:00:20,318::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:20,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4871563-9a42-4a47-91b4-f2d91aff7f18`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576297472', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:20,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4871563-9a42-4a47-91b4-f2d91aff7f18`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:00:20,319::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:00:20,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:00:20,320::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:00:20,320::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:00:20,321::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:00:20,321::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:00:20,321::task::993::Storage.TaskManager.Task::(_decref) Task=`c4871563-9a42-4a47-91b4-f2d91aff7f18`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:00:20,836::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:00:20,836::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:00:22,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:22,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193888 s, 52.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:22,716::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:22,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:22,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:22,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:22,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:22,718::__init__::225::IOProcess::(_processLogs) (273991) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:22,718::__init__::225::IOProcess::(_processLogs) (273991) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:22,718::__init__::225::IOProcess::(_processLogs) (273991) Building response >Thread-18::DEBUG::2014-07-08 17:00:22,718::__init__::225::IOProcess::(_processLogs) (273991) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:22,719::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:22,719::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:00:22,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:00:22,873::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00507007 s, 91.1 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:22,878::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:22,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:22,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:22,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:22,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:22,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:22,886::__init__::225::IOProcess::(_processLogs) (273992) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:22,887::__init__::225::IOProcess::(_processLogs) (273992) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:22,888::__init__::225::IOProcess::(_processLogs) (273992) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:22,890::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:22,891::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:00:22,900::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:00:22,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:22,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:22,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:22,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:22,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:22,909::__init__::225::IOProcess::(_processLogs) (273993) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:22,911::__init__::225::IOProcess::(_processLogs) (273993) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:22,913::__init__::225::IOProcess::(_processLogs) (273993) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:22,914::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:22,915::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:22,921::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:00:22,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:22,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:22,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:22,927::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:22,928::__init__::225::IOProcess::(_processLogs) (273994) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:22,930::__init__::225::IOProcess::(_processLogs) (273994) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:22,935::__init__::225::IOProcess::(_processLogs) (273994) Building response >Thread-18::DEBUG::2014-07-08 17:00:22,937::__init__::225::IOProcess::(_processLogs) (273994) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:22,939::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:22,940::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:22,946::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:00:22,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:22,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:22,952::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:22,953::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:22,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:22,955::__init__::225::IOProcess::(_processLogs) (273995) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:22,957::__init__::225::IOProcess::(_processLogs) (273995) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:22,958::__init__::225::IOProcess::(_processLogs) (273995) Building response >Thread-18::DEBUG::2014-07-08 17:00:22,960::__init__::225::IOProcess::(_processLogs) (273995) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:22,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:22,962::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:00:24,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:24,713::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:24,715::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:24,716::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:00:24,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174361 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:00:26,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:27,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0202387 s, 50.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:00:29,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:00:29,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`e26cf908-964c-4b35-9eb9-3d1960f39665`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:00:29,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:00:29,473::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00507007', 'lastCheck': '6.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:00:29,473::task::1191::Storage.TaskManager.Task::(prepare) Task=`e26cf908-964c-4b35-9eb9-3d1960f39665`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00507007', 'lastCheck': '6.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:00:29,473::task::595::Storage.TaskManager.Task::(_updateState) Task=`e26cf908-964c-4b35-9eb9-3d1960f39665`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:00:29,473::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:00:29,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:00:29,474::task::993::Storage.TaskManager.Task::(_decref) Task=`e26cf908-964c-4b35-9eb9-3d1960f39665`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:00:29,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0916518 s, 11.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:00:29,552::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:29,720::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:29,722::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:29,723::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:00:30,362::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:00:30,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a511257-8d7b-4534-868c-e1e3140de1b1`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:00:30,363::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:00:30,381::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:30,381::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a511257-8d7b-4534-868c-e1e3140de1b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:30,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a511257-8d7b-4534-868c-e1e3140de1b1`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:00:30,382::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:00:30,382::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:00:30,382::task::993::Storage.TaskManager.Task::(_decref) Task=`3a511257-8d7b-4534-868c-e1e3140de1b1`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:00:30,396::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:00:30,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`1378a6e5-3c6b-4777-89c1-b21da9a1327e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:00:30,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:00:30,398::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`69ced065-c4f8-4b9e-b3d3-48d04354dbab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:00:30,399::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:00:30,399::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:00:30,399::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`69ced065-c4f8-4b9e-b3d3-48d04354dbab`::Granted request >Thread-7083::DEBUG::2014-07-08 17:00:30,400::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1378a6e5-3c6b-4777-89c1-b21da9a1327e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:00:30,400::task::993::Storage.TaskManager.Task::(_decref) Task=`1378a6e5-3c6b-4777-89c1-b21da9a1327e`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:00:30,426::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:30,427::task::1191::Storage.TaskManager.Task::(prepare) Task=`1378a6e5-3c6b-4777-89c1-b21da9a1327e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:30,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`1378a6e5-3c6b-4777-89c1-b21da9a1327e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:00:30,428::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:00:30,428::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:00:30,428::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:00:30,429::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:00:30,429::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:00:30,429::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:00:30,429::task::993::Storage.TaskManager.Task::(_decref) Task=`1378a6e5-3c6b-4777-89c1-b21da9a1327e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:00:31,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:31,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017466 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:32,968::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:32,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:32,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:32,969::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:32,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:32,970::__init__::225::IOProcess::(_processLogs) (273996) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:32,970::__init__::225::IOProcess::(_processLogs) (273996) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:32,970::__init__::225::IOProcess::(_processLogs) (273996) Building response >Thread-18::DEBUG::2014-07-08 17:00:32,971::__init__::225::IOProcess::(_processLogs) (273996) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:32,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:32,971::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:00:32,973::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:00:33,127::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000584417 s, 791 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:33,133::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:33,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:33,137::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:33,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:33,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:33,141::__init__::225::IOProcess::(_processLogs) (273997) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:33,143::__init__::225::IOProcess::(_processLogs) (273997) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:33,144::__init__::225::IOProcess::(_processLogs) (273997) Building response >Thread-18::DEBUG::2014-07-08 17:00:33,146::__init__::225::IOProcess::(_processLogs) (273997) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:33,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:33,148::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:00:33,157::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:00:33,159::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:33,160::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:33,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:33,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:33,165::__init__::225::IOProcess::(_processLogs) (273998) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:33,167::__init__::225::IOProcess::(_processLogs) (273998) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:33,168::__init__::225::IOProcess::(_processLogs) (273998) Building response >Thread-18::DEBUG::2014-07-08 17:00:33,169::__init__::225::IOProcess::(_processLogs) (273998) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:33,170::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:33,172::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:33,177::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:00:33,178::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:33,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:33,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:33,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:33,184::__init__::225::IOProcess::(_processLogs) (273999) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:33,185::__init__::225::IOProcess::(_processLogs) (273999) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:33,186::__init__::225::IOProcess::(_processLogs) (273999) Building response >Thread-18::DEBUG::2014-07-08 17:00:33,188::__init__::225::IOProcess::(_processLogs) (273999) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:33,190::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:33,191::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:33,196::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:00:33,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:33,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:33,201::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:33,202::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:33,203::__init__::225::IOProcess::(_processLogs) (274000) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:33,205::__init__::225::IOProcess::(_processLogs) (274000) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:33,206::__init__::225::IOProcess::(_processLogs) (274000) Building response >Thread-18::DEBUG::2014-07-08 17:00:33,208::__init__::225::IOProcess::(_processLogs) (274000) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:33,209::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:33,211::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:00:33,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:34,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176188 s, 58.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:34,753::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:34,764::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:34,770::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:00:36,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:36,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0203518 s, 50.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:00:36,374::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:00:36,375::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:00:38,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:38,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0201914 s, 50.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:39,782::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:39,783::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:39,784::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:00:40,445::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:00:40,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ab63ad9-bc81-4f76-8ce7-2b2c0834f18a`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:00:40,447::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:00:40,462::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:40,463::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ab63ad9-bc81-4f76-8ce7-2b2c0834f18a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:40,463::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ab63ad9-bc81-4f76-8ce7-2b2c0834f18a`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:00:40,463::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:00:40,464::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:00:40,464::task::993::Storage.TaskManager.Task::(_decref) Task=`5ab63ad9-bc81-4f76-8ce7-2b2c0834f18a`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:00:40,477::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:00:40,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`dfd4688e-c039-45a2-8807-6c967c22e86b`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:00:40,478::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:00:40,479::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3304c656-79a2-4033-9ef9-3a9629996911`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:00:40,479::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:00:40,480::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:00:40,480::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3304c656-79a2-4033-9ef9-3a9629996911`::Granted request >Thread-7083::DEBUG::2014-07-08 17:00:40,481::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dfd4688e-c039-45a2-8807-6c967c22e86b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:00:40,481::task::993::Storage.TaskManager.Task::(_decref) Task=`dfd4688e-c039-45a2-8807-6c967c22e86b`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:00:40,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:40,500::task::1191::Storage.TaskManager.Task::(prepare) Task=`dfd4688e-c039-45a2-8807-6c967c22e86b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:40,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`dfd4688e-c039-45a2-8807-6c967c22e86b`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:00:40,501::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:00:40,501::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:00:40,501::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:00:40,502::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:00:40,502::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:00:40,502::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:00:40,502::task::993::Storage.TaskManager.Task::(_decref) Task=`dfd4688e-c039-45a2-8807-6c967c22e86b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:00:40,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:40,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177898 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:00:42,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:43,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173456 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:43,217::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:43,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:43,218::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:43,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:43,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:43,219::__init__::225::IOProcess::(_processLogs) (274001) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:43,219::__init__::225::IOProcess::(_processLogs) (274001) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:43,219::__init__::225::IOProcess::(_processLogs) (274001) Building response >Thread-18::DEBUG::2014-07-08 17:00:43,220::__init__::225::IOProcess::(_processLogs) (274001) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:43,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:43,220::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:00:43,222::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:00:43,371::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000745327 s, 620 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:43,375::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:43,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:43,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:43,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:43,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:43,377::__init__::225::IOProcess::(_processLogs) (274002) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:43,378::__init__::225::IOProcess::(_processLogs) (274002) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:43,378::__init__::225::IOProcess::(_processLogs) (274002) Building response >Thread-18::DEBUG::2014-07-08 17:00:43,379::__init__::225::IOProcess::(_processLogs) (274002) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:43,380::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:43,383::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:00:43,397::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:00:43,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:43,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:43,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:43,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:43,399::__init__::225::IOProcess::(_processLogs) (274003) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:43,399::__init__::225::IOProcess::(_processLogs) (274003) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:43,400::__init__::225::IOProcess::(_processLogs) (274003) Building response >Thread-18::DEBUG::2014-07-08 17:00:43,400::__init__::225::IOProcess::(_processLogs) (274003) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:43,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:43,401::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:43,412::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:00:43,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:43,415::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:43,416::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:43,418::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:43,419::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:43,420::__init__::225::IOProcess::(_processLogs) (274004) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:43,421::__init__::225::IOProcess::(_processLogs) (274004) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:43,423::__init__::225::IOProcess::(_processLogs) (274004) Building response >Thread-18::DEBUG::2014-07-08 17:00:43,424::__init__::225::IOProcess::(_processLogs) (274004) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:43,425::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:43,426::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:43,432::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:00:43,432::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:00:43,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:43,433::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:43,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:43,436::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:43,437::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:43,439::__init__::225::IOProcess::(_processLogs) (274005) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:43,440::__init__::225::IOProcess::(_processLogs) (274005) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:43,442::__init__::225::IOProcess::(_processLogs) (274005) Building response >Thread-18::DEBUG::2014-07-08 17:00:43,443::__init__::225::IOProcess::(_processLogs) (274005) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:43,444::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:43,446::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:44,791::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:44,793::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:44,794::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:00:44,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9b5ff52-f442-46b0-afe8-ee45eb97965f`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:00:44,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:00:44,844::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745327', 'lastCheck': '1.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:00:44,845::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9b5ff52-f442-46b0-afe8-ee45eb97965f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745327', 'lastCheck': '1.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:00:44,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9b5ff52-f442-46b0-afe8-ee45eb97965f`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:00:44,845::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:00:44,845::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:00:44,846::task::993::Storage.TaskManager.Task::(_decref) Task=`a9b5ff52-f442-46b0-afe8-ee45eb97965f`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:00:44,880::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:00:45,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:45,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904187 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:00:47,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:47,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178716 s, 57.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:00:49,601::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:49,801::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:49,802::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:49,803::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:00:49,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:50,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340641 s, 30.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:00:50,520::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:00:50,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`800608c6-d335-4605-985f-162048299475`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:00:50,521::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:00:50,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:50,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`800608c6-d335-4605-985f-162048299475`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:00:50,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`800608c6-d335-4605-985f-162048299475`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:00:50,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:00:50,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:00:50,538::task::993::Storage.TaskManager.Task::(_decref) Task=`800608c6-d335-4605-985f-162048299475`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:00:50,550::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:00:50,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eaedf70-cc96-437e-8c0a-d4aaa881b0c5`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:00:50,551::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:00:50,552::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`92ad28e9-1540-412b-a712-c507888d6e0f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:00:50,552::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:00:50,553::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:00:50,561::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`92ad28e9-1540-412b-a712-c507888d6e0f`::Granted request >Thread-7083::DEBUG::2014-07-08 17:00:50,562::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6eaedf70-cc96-437e-8c0a-d4aaa881b0c5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:00:50,562::task::993::Storage.TaskManager.Task::(_decref) Task=`6eaedf70-cc96-437e-8c0a-d4aaa881b0c5`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:00:50,582::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:50,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`6eaedf70-cc96-437e-8c0a-d4aaa881b0c5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:00:50,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eaedf70-cc96-437e-8c0a-d4aaa881b0c5`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:00:50,583::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:00:50,583::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:00:50,583::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:00:50,584::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:00:50,584::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:00:50,584::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:00:50,585::task::993::Storage.TaskManager.Task::(_decref) Task=`6eaedf70-cc96-437e-8c0a-d4aaa881b0c5`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:00:51,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`79d9bb75-d8b2-4356-8c56-e0cabb968566`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:00:51,522::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:00:51,523::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:00:51,524::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:00:51,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:51,524::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:51,524::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:51,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:51,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:51,525::__init__::225::IOProcess::(_processLogs) (274006) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:00:51,525::__init__::225::IOProcess::(_processLogs) (274006) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:00:51,526::__init__::225::IOProcess::(_processLogs) (274006) Building response >Thread-18::DEBUG::2014-07-08 17:00:51,526::__init__::225::IOProcess::(_processLogs) (274006) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:51,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:51,526::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:00:51,528::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:00:51,529::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:00:51,529::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:51,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:51,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:51,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:51,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:51,530::__init__::225::IOProcess::(_processLogs) (274007) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:00:51,530::__init__::225::IOProcess::(_processLogs) (274007) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:00:51,531::__init__::225::IOProcess::(_processLogs) (274007) Building response >Thread-18::DEBUG::2014-07-08 17:00:51,531::__init__::225::IOProcess::(_processLogs) (274007) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:51,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:51,531::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:00:51,532::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:00:51,533::task::1191::Storage.TaskManager.Task::(prepare) Task=`79d9bb75-d8b2-4356-8c56-e0cabb968566`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:00:51,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`79d9bb75-d8b2-4356-8c56-e0cabb968566`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:00:51,533::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:00:51,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:00:51,534::task::993::Storage.TaskManager.Task::(_decref) Task=`79d9bb75-d8b2-4356-8c56-e0cabb968566`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:00:51,627::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:00:51,627::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:00:52,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:52,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017342 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:53,452::__init__::225::IOProcess::(_processLogs) Message size is 168DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:00:53,452::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:53,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:53,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:53,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:53,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:53,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:53,454::__init__::225::IOProcess::(_processLogs) (274008) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:53,454::__init__::225::IOProcess::(_processLogs) (274008) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:53,454::__init__::225::IOProcess::(_processLogs) (274008) Building response >Thread-18::DEBUG::2014-07-08 17:00:53,455::__init__::225::IOProcess::(_processLogs) (274008) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:53,455::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:53,455::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:00:53,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:00:53,620::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000527428 s, 876 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:00:53,627::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:00:53,630::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:00:53,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:53,634::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:53,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:53,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:53,638::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:53,639::__init__::225::IOProcess::(_processLogs) (274009) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:00:53,641::__init__::225::IOProcess::(_processLogs) (274009) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:00:53,642::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274009) Building response >Thread-18::DEBUG::2014-07-08 17:00:53,644::__init__::225::IOProcess::(_processLogs) (274009) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:53,645::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:53,646::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:00:53,655::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:00:53,657::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:00:53,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:53,660::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:53,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:53,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:53,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:53,666::__init__::225::IOProcess::(_processLogs) (274010) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:53,667::__init__::225::IOProcess::(_processLogs) (274010) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:53,669::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274010) Building response >Thread-18::DEBUG::2014-07-08 17:00:53,671::__init__::225::IOProcess::(_processLogs) (274010) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:53,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:53,674::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:53,680::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:00:53,682::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:00:53,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:53,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:53,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:53,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:53,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:53,691::__init__::225::IOProcess::(_processLogs) (274011) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:53,693::__init__::225::IOProcess::(_processLogs) (274011) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:53,695::__init__::225::IOProcess::(_processLogs) (274011) Building response >Thread-18::DEBUG::2014-07-08 17:00:53,697::__init__::225::IOProcess::(_processLogs) (274011) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:53,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:53,699::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:00:53,704::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:00:53,706::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:00:53,708::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:00:53,709::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:00:53,711::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:00:53,712::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:00:53,714::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:00:53,715::__init__::225::IOProcess::(_processLogs) (274012) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:00:53,716::__init__::225::IOProcess::(_processLogs) (274012) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:00:53,717::__init__::225::IOProcess::(_processLogs) (274012) Building response >Thread-18::DEBUG::2014-07-08 17:00:53,719::__init__::225::IOProcess::(_processLogs) (274012) Queuing response >Thread-18::DEBUG::2014-07-08 17:00:53,720::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:00:53,722::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:00:54,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:54,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186583 s, 54.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:54,811::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:54,812::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:54,813::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:00:56,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:56,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173392 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:00:58,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:00:59,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175434 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:59,819::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:59,820::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:00:59,821::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:01:00,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`436ef26d-2daf-47e5-9822-baaff387f3ba`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:00,088::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:01:00,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527428', 'lastCheck': '6.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:01:00,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`436ef26d-2daf-47e5-9822-baaff387f3ba`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527428', 'lastCheck': '6.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:01:00,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`436ef26d-2daf-47e5-9822-baaff387f3ba`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:00,089::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:00,090::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:00,090::task::993::Storage.TaskManager.Task::(_decref) Task=`436ef26d-2daf-47e5-9822-baaff387f3ba`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:01:00,121::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:01:00,599::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:01:00,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`508423e6-e966-4dd1-bcc7-538d3d60a12a`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:00,600::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:01:00,618::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:00,619::task::1191::Storage.TaskManager.Task::(prepare) Task=`508423e6-e966-4dd1-bcc7-538d3d60a12a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:00,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`508423e6-e966-4dd1-bcc7-538d3d60a12a`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:00,619::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:00,620::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:00,620::task::993::Storage.TaskManager.Task::(_decref) Task=`508423e6-e966-4dd1-bcc7-538d3d60a12a`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:01:00,635::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:01:00,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`166c0db4-55b7-4573-a7d6-8a2302d95498`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:01:00,636::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:01:00,637::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7e20e786-8fd1-4821-8cc2-0fe37bed972a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:01:00,637::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:01:00,638::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:01:00,638::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7e20e786-8fd1-4821-8cc2-0fe37bed972a`::Granted request >Thread-7083::DEBUG::2014-07-08 17:01:00,639::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`166c0db4-55b7-4573-a7d6-8a2302d95498`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:01:00,639::task::993::Storage.TaskManager.Task::(_decref) Task=`166c0db4-55b7-4573-a7d6-8a2302d95498`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:01:00,658::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:00,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`166c0db4-55b7-4573-a7d6-8a2302d95498`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:00,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`166c0db4-55b7-4573-a7d6-8a2302d95498`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:01:00,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:01:00,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:01:00,659::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:01:00,660::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:01:00,660::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:01:00,660::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:01:00,661::task::993::Storage.TaskManager.Task::(_decref) Task=`166c0db4-55b7-4573-a7d6-8a2302d95498`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:01:01,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:01,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0910478 s, 11.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:03,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:01:03,815::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:03,817::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:03,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:03,820::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:03,823::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:03,828::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:03,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:03,836::__init__::225::IOProcess::(_processLogs) (274013) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:03,840::__init__::225::IOProcess::(_processLogs) (274013) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:03,843::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274013) Building response >Thread-18::DEBUG::2014-07-08 17:01:03,846::__init__::225::IOProcess::(_processLogs) (274013) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:03,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:03,852::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:01:03,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:01:04,027::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000584416 s, 791 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:04,042::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:04,046::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:04,048::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:04,051::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:04,054::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:04,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-6860::DEBUG::2014-07-08 17:01:04,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.246081 s, 4.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:04,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:04,133::__init__::225::IOProcess::(_processLogs) (274014) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:04,137::__init__::225::IOProcess::(_processLogs) (274014) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:04,141::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274014) Building response >Thread-18::DEBUG::2014-07-08 17:01:04,143::__init__::225::IOProcess::(_processLogs) (274014) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:04,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:04,149::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:01:04,164::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:04,167::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:01:04,171::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:04,174::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:04,177::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:04,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:04,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:04,185::__init__::225::IOProcess::(_processLogs) (274015) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:04,188::__init__::225::IOProcess::(_processLogs) (274015) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:04,191::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274015) Building response >Thread-18::DEBUG::2014-07-08 17:01:04,193::__init__::225::IOProcess::(_processLogs) (274015) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:04,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:04,197::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:04,216::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:04,223::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:01:04,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:04,235::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:04,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:04,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:04,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:04,257::__init__::225::IOProcess::(_processLogs) (274016) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:04,263::__init__::225::IOProcess::(_processLogs) (274016) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:04,270::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274016) Building response >Thread-18::DEBUG::2014-07-08 17:01:04,275::__init__::225::IOProcess::(_processLogs) (274016) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:04,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:04,284::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:04,306::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:04,311::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:01:04,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:04,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:04,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:04,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:04,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:04,341::__init__::225::IOProcess::(_processLogs) (274017) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:04,344::__init__::225::IOProcess::(_processLogs) (274017) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:04,348::__init__::225::IOProcess::(_processLogs) (274017) Building response >Thread-18::DEBUG::2014-07-08 17:01:04,351::__init__::225::IOProcess::(_processLogs) (274017) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:04,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:04,357::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:04,829::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:04,834::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:04,839::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:01:06,678::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:01:06,678::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:01:06,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:07,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0918683 s, 11.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:09,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:09,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204183 s, 50.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:09,848::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:09,849::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:09,850::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:01:10,706::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:01:10,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`163ff4a2-60c1-4d41-b02d-9abb08781b89`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:10,708::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:01:10,723::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:10,723::task::1191::Storage.TaskManager.Task::(prepare) Task=`163ff4a2-60c1-4d41-b02d-9abb08781b89`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:10,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`163ff4a2-60c1-4d41-b02d-9abb08781b89`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:10,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:10,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:10,724::task::993::Storage.TaskManager.Task::(_decref) Task=`163ff4a2-60c1-4d41-b02d-9abb08781b89`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:01:10,736::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:01:10,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`a26d04f5-3a1a-4b02-8fd0-50c8389e9840`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:01:10,738::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:01:10,739::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7bbc8a67-2c9b-4180-ab0b-78ac2cd2ec6d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:01:10,739::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:01:10,739::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:01:10,740::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7bbc8a67-2c9b-4180-ab0b-78ac2cd2ec6d`::Granted request >Thread-7083::DEBUG::2014-07-08 17:01:10,740::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a26d04f5-3a1a-4b02-8fd0-50c8389e9840`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:01:10,741::task::993::Storage.TaskManager.Task::(_decref) Task=`a26d04f5-3a1a-4b02-8fd0-50c8389e9840`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:01:10,760::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:10,760::task::1191::Storage.TaskManager.Task::(prepare) Task=`a26d04f5-3a1a-4b02-8fd0-50c8389e9840`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:10,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`a26d04f5-3a1a-4b02-8fd0-50c8389e9840`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:01:10,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:01:10,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:01:10,762::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:01:10,762::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:01:10,762::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:01:10,762::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:01:10,763::task::993::Storage.TaskManager.Task::(_decref) Task=`a26d04f5-3a1a-4b02-8fd0-50c8389e9840`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:01:11,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:11,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172875 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:13,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:13,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017202 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:14,368::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:14,369::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:14,369::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:14,369::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:14,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:14,370::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:14,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:14,370::__init__::225::IOProcess::(_processLogs) (274018) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:14,371::__init__::225::IOProcess::(_processLogs) (274018) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:14,371::__init__::225::IOProcess::(_processLogs) (274018) Building response >Thread-18::DEBUG::2014-07-08 17:01:14,371::__init__::225::IOProcess::(_processLogs) (274018) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:14,371::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:14,372::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:01:14,373::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:01:14,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00053553 s, 863 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:14,532::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:14,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:14,536::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:14,538::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:14,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:14,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:14,543::__init__::225::IOProcess::(_processLogs) (274019) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:14,546::__init__::225::IOProcess::(_processLogs) (274019) Building response >Thread-18::DEBUG::2014-07-08 17:01:14,547::__init__::225::IOProcess::(_processLogs) (274019) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:14,548::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:14,550::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:01:14,557::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:01:14,558::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:14,559::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:14,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:14,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:14,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:14,563::__init__::225::IOProcess::(_processLogs) (274020) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:14,565::__init__::225::IOProcess::(_processLogs) (274020) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:14,566::__init__::225::IOProcess::(_processLogs) (274020) Building response >Thread-18::DEBUG::2014-07-08 17:01:14,568::__init__::225::IOProcess::(_processLogs) (274020) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:14,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:14,571::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:14,576::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:14,578::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:01:14,580::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:14,580::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:14,580::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:14,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:14,581::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:14,581::__init__::225::IOProcess::(_processLogs) (274021) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:14,581::__init__::225::IOProcess::(_processLogs) (274021) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:14,582::__init__::225::IOProcess::(_processLogs) (274021) Building response >Thread-18::DEBUG::2014-07-08 17:01:14,582::__init__::225::IOProcess::(_processLogs) (274021) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:14,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:14,582::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:14,584::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:14,584::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:01:14,584::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:14,585::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:14,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:14,585::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:14,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:14,586::__init__::225::IOProcess::(_processLogs) (274022) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:14,586::__init__::225::IOProcess::(_processLogs) (274022) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:14,586::__init__::225::IOProcess::(_processLogs) (274022) Building response >Thread-18::DEBUG::2014-07-08 17:01:14,586::__init__::225::IOProcess::(_processLogs) (274022) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:14,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:14,587::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:14,856::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:14,863::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:14,864::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:01:15,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b39d1f3-3968-4497-bde4-4240b5cab8c1`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:15,340::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:01:15,340::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053553', 'lastCheck': '0.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:01:15,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b39d1f3-3968-4497-bde4-4240b5cab8c1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053553', 'lastCheck': '0.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:01:15,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b39d1f3-3968-4497-bde4-4240b5cab8c1`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:15,341::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:15,341::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:15,342::task::993::Storage.TaskManager.Task::(_decref) Task=`1b39d1f3-3968-4497-bde4-4240b5cab8c1`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:01:15,374::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:01:15,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:16,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173993 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:18,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:18,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175616 s, 58.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:19,871::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:19,873::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:19,874::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:01:19,885::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:01:20,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:20,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174574 s, 58.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:01:20,801::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:01:20,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`470ab0b2-4367-466d-93ff-0e63f1908a4e`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:20,802::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:01:20,818::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:20,819::task::1191::Storage.TaskManager.Task::(prepare) Task=`470ab0b2-4367-466d-93ff-0e63f1908a4e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:20,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`470ab0b2-4367-466d-93ff-0e63f1908a4e`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:20,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:20,820::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:20,820::task::993::Storage.TaskManager.Task::(_decref) Task=`470ab0b2-4367-466d-93ff-0e63f1908a4e`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:01:20,832::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:01:20,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec254b41-aea0-4d9f-92b4-d8d28a9350b0`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:01:20,833::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:01:20,834::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`33e6e925-801c-42d2-8f82-a4b276798e58`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:01:20,834::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:01:20,835::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:01:20,835::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`33e6e925-801c-42d2-8f82-a4b276798e58`::Granted request >Thread-7083::DEBUG::2014-07-08 17:01:20,836::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ec254b41-aea0-4d9f-92b4-d8d28a9350b0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:01:20,836::task::993::Storage.TaskManager.Task::(_decref) Task=`ec254b41-aea0-4d9f-92b4-d8d28a9350b0`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:01:20,855::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:20,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec254b41-aea0-4d9f-92b4-d8d28a9350b0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:20,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec254b41-aea0-4d9f-92b4-d8d28a9350b0`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:01:20,856::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:01:20,856::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:01:20,856::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:01:20,857::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:01:20,857::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:01:20,857::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:01:20,858::task::993::Storage.TaskManager.Task::(_decref) Task=`ec254b41-aea0-4d9f-92b4-d8d28a9350b0`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:01:21,829::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:01:21,830::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:01:22,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:23,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.11 s, 9.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:24,590::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:24,590::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:24,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:24,591::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:24,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:24,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:24,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:24,592::__init__::225::IOProcess::(_processLogs) (274023) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:24,592::__init__::225::IOProcess::(_processLogs) (274023) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:24,592::__init__::225::IOProcess::(_processLogs) (274023) Building response >Thread-18::DEBUG::2014-07-08 17:01:24,592::__init__::225::IOProcess::(_processLogs) (274023) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:24,593::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:24,593::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:01:24,594::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:01:24,745::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000463456 s, 997 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:24,747::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:24,748::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:24,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:24,748::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:24,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:24,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:24,749::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:24,749::__init__::225::IOProcess::(_processLogs) (274024) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:24,750::__init__::225::IOProcess::(_processLogs) (274024) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:24,750::__init__::225::IOProcess::(_processLogs) (274024) Building response >Thread-18::DEBUG::2014-07-08 17:01:24,750::__init__::225::IOProcess::(_processLogs) (274024) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:24,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:24,751::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:01:24,753::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:24,753::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:01:24,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:24,754::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:24,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:24,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:24,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:24,755::__init__::225::IOProcess::(_processLogs) (274025) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:24,755::__init__::225::IOProcess::(_processLogs) (274025) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:24,755::__init__::225::IOProcess::(_processLogs) (274025) Building response >Thread-18::DEBUG::2014-07-08 17:01:24,755::__init__::225::IOProcess::(_processLogs) (274025) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:24,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:24,756::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:24,757::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:24,757::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:01:24,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:24,758::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:24,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:24,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:24,758::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:24,759::__init__::225::IOProcess::(_processLogs) (274026) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:24,759::__init__::225::IOProcess::(_processLogs) (274026) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:24,759::__init__::225::IOProcess::(_processLogs) (274026) Building response >Thread-18::DEBUG::2014-07-08 17:01:24,759::__init__::225::IOProcess::(_processLogs) (274026) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:24,760::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:24,760::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:24,761::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:24,761::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:01:24,761::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:24,762::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:24,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:24,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:24,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:24,763::__init__::225::IOProcess::(_processLogs) (274027) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:24,763::__init__::225::IOProcess::(_processLogs) (274027) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:24,763::__init__::225::IOProcess::(_processLogs) (274027) Building response >Thread-18::DEBUG::2014-07-08 17:01:24,763::__init__::225::IOProcess::(_processLogs) (274027) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:24,764::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:24,764::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:24,878::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:24,880::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:24,881::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:01:25,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:25,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173783 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:27,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:27,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017342 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:29,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:29,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0216977 s, 47.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:29,941::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:29,946::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:29,950::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:01:30,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfeff440-6cbb-4066-bfcc-7f4f23bd5add`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:30,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:01:30,610::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463456', 'lastCheck': '5.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:01:30,610::task::1191::Storage.TaskManager.Task::(prepare) Task=`cfeff440-6cbb-4066-bfcc-7f4f23bd5add`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463456', 'lastCheck': '5.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:01:30,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfeff440-6cbb-4066-bfcc-7f4f23bd5add`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:30,610::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:30,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:30,611::task::993::Storage.TaskManager.Task::(_decref) Task=`cfeff440-6cbb-4066-bfcc-7f4f23bd5add`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:01:30,644::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:01:30,877::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:01:30,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`9999e61a-59b5-4cb4-8dba-3da5689e14e1`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:30,878::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:01:30,893::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:30,894::task::1191::Storage.TaskManager.Task::(prepare) Task=`9999e61a-59b5-4cb4-8dba-3da5689e14e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:30,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`9999e61a-59b5-4cb4-8dba-3da5689e14e1`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:30,894::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:30,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:30,895::task::993::Storage.TaskManager.Task::(_decref) Task=`9999e61a-59b5-4cb4-8dba-3da5689e14e1`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:01:30,907::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:01:30,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`34275eeb-7883-40d4-ab22-30e681bba35b`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:01:30,908::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:01:30,909::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e8df59f2-8d95-46fa-bf34-cfa88da22ea7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:01:30,909::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:01:30,910::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:01:30,910::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e8df59f2-8d95-46fa-bf34-cfa88da22ea7`::Granted request >Thread-7083::DEBUG::2014-07-08 17:01:30,911::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`34275eeb-7883-40d4-ab22-30e681bba35b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:01:30,911::task::993::Storage.TaskManager.Task::(_decref) Task=`34275eeb-7883-40d4-ab22-30e681bba35b`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:01:30,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:30,930::task::1191::Storage.TaskManager.Task::(prepare) Task=`34275eeb-7883-40d4-ab22-30e681bba35b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:30,931::task::595::Storage.TaskManager.Task::(_updateState) Task=`34275eeb-7883-40d4-ab22-30e681bba35b`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:01:30,931::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:01:30,931::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:01:30,932::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:01:30,932::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:01:30,932::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:01:30,932::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:01:30,933::task::993::Storage.TaskManager.Task::(_decref) Task=`34275eeb-7883-40d4-ab22-30e681bba35b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:01:31,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:32,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172883 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:34,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:34,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026068 s, 39.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:34,769::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:34,770::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:34,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:34,773::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:34,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:34,776::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:34,777::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:34,779::__init__::225::IOProcess::(_processLogs) (274028) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:34,780::__init__::225::IOProcess::(_processLogs) (274028) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:34,782::__init__::225::IOProcess::(_processLogs) (274028) Building response >Thread-18::DEBUG::2014-07-08 17:01:34,783::__init__::225::IOProcess::(_processLogs) (274028) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:34,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:34,786::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:01:34,793::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:01:34,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000505638 s, 914 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:34,952::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:34,955::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:34,961::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:34,965::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:01:34,966::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:34,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:34,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:34,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:34,980::__init__::225::IOProcess::(_processLogs) (274029) Finding callback 'statvfs'... >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:34,984::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:01:34,985::__init__::225::IOProcess::(_processLogs) (274029) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:34,991::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274029) Building response >Thread-18::DEBUG::2014-07-08 17:01:34,997::__init__::225::IOProcess::(_processLogs) (274029) Queuing response >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:35,002::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:01:35,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:35,012::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:01:35,030::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:35,032::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:01:35,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:35,038::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:35,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:35,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:35,049::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:35,052::__init__::225::IOProcess::(_processLogs) (274030) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:35,055::__init__::225::IOProcess::(_processLogs) (274030) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:35,059::__init__::225::IOProcess::(_processLogs) (274030) Building response >Thread-18::DEBUG::2014-07-08 17:01:35,062::__init__::225::IOProcess::(_processLogs) (274030) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:35,066::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:01:35,069::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:35,080::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:35,082::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:01:35,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:35,088::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:35,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:35,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:35,099::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:35,105::__init__::225::IOProcess::(_processLogs) (274031) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:35,111::__init__::225::IOProcess::(_processLogs) (274031) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:35,117::__init__::225::IOProcess::(_processLogs) (274031) Building response >Thread-18::DEBUG::2014-07-08 17:01:35,124::__init__::225::IOProcess::(_processLogs) (274031) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:35,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:35,137::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:35,156::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:35,164::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:01:35,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:35,176::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:35,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:35,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:35,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:35,202::__init__::225::IOProcess::(_processLogs) (274032) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:35,207::__init__::225::IOProcess::(_processLogs) (274032) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:35,215::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274032) Building response >Thread-18::DEBUG::2014-07-08 17:01:35,220::__init__::225::IOProcess::(_processLogs) (274032) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:35,224::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:35,226::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:01:36,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:36,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0209801 s, 48.8 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:01:36,955::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:01:36,956::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:01:39,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:39,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.123133 s, 8.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:40,019::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:40,021::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:40,022::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:01:40,946::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:01:40,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f8a8375-760e-4d8a-a70a-58efd6689bd0`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:40,947::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:01:40,962::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:40,963::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f8a8375-760e-4d8a-a70a-58efd6689bd0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:40,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f8a8375-760e-4d8a-a70a-58efd6689bd0`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:40,963::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:40,964::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:40,964::task::993::Storage.TaskManager.Task::(_decref) Task=`1f8a8375-760e-4d8a-a70a-58efd6689bd0`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:01:40,976::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:01:40,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`edc08e61-b1ad-4584-a8e3-f3622b60f6e3`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:01:40,978::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:01:40,979::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a6ed39d6-2ce1-4524-ab31-decc73641e8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:01:40,979::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:01:40,979::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:01:40,980::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a6ed39d6-2ce1-4524-ab31-decc73641e8c`::Granted request >Thread-7083::DEBUG::2014-07-08 17:01:40,984::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`edc08e61-b1ad-4584-a8e3-f3622b60f6e3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:01:40,984::task::993::Storage.TaskManager.Task::(_decref) Task=`edc08e61-b1ad-4584-a8e3-f3622b60f6e3`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:01:41,004::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:41,005::task::1191::Storage.TaskManager.Task::(prepare) Task=`edc08e61-b1ad-4584-a8e3-f3622b60f6e3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:41,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`edc08e61-b1ad-4584-a8e3-f3622b60f6e3`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:01:41,005::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:01:41,005::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:01:41,006::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:01:41,006::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:01:41,006::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:01:41,007::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:01:41,007::task::993::Storage.TaskManager.Task::(_decref) Task=`edc08e61-b1ad-4584-a8e3-f3622b60f6e3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:01:41,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:41,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172735 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:43,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:43,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017273 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:45,029::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:45,031::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:45,032::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:01:45,236::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:45,237::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:45,237::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:45,237::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:45,237::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:45,238::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:45,238::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:45,238::__init__::225::IOProcess::(_processLogs) (274033) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:45,238::__init__::225::IOProcess::(_processLogs) (274033) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:45,239::__init__::225::IOProcess::(_processLogs) (274033) Building response >Thread-18::DEBUG::2014-07-08 17:01:45,239::__init__::225::IOProcess::(_processLogs) (274033) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:45,239::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:45,239::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:01:45,241::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:01:45,389::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00041373 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:45,396::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:45,398::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:45,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:45,402::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:45,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:45,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:45,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:45,410::__init__::225::IOProcess::(_processLogs) (274034) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:45,411::__init__::225::IOProcess::(_processLogs) (274034) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:45,413::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274034) Building response >Thread-18::DEBUG::2014-07-08 17:01:45,414::__init__::225::IOProcess::(_processLogs) (274034) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:45,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:45,416::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:01:45,438::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:45,441::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:01:45,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:45,450::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:45,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:45,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:45,464::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:45,465::__init__::225::IOProcess::(_processLogs) (274035) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:45,467::__init__::225::IOProcess::(_processLogs) (274035) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:45,469::__init__::225::IOProcess::(_processLogs) (274035) Building response >Thread-18::DEBUG::2014-07-08 17:01:45,470::__init__::225::IOProcess::(_processLogs) (274035) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:45,472::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:45,473::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:45,478::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:45,480::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:01:45,481::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:45,483::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:45,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:45,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:45,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:45,490::__init__::225::IOProcess::(_processLogs) (274036) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:45,492::__init__::225::IOProcess::(_processLogs) (274036) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:45,494::__init__::225::IOProcess::(_processLogs) (274036) Building response >Thread-18::DEBUG::2014-07-08 17:01:45,496::__init__::225::IOProcess::(_processLogs) (274036) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:45,497::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:45,499::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:45,505::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:45,506::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:01:45,508::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:45,509::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:45,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:45,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:45,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:45,515::__init__::225::IOProcess::(_processLogs) (274037) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:45,517::__init__::225::IOProcess::(_processLogs) (274037) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:45,518::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274037) Building response >Thread-18::DEBUG::2014-07-08 17:01:45,519::__init__::225::IOProcess::(_processLogs) (274037) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:45,521::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:45,522::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:01:45,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`52da9daf-2c21-4f0b-9f34-b16e5190ce18`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:45,912::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:01:45,912::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041373', 'lastCheck': '0.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:01:45,913::task::1191::Storage.TaskManager.Task::(prepare) Task=`52da9daf-2c21-4f0b-9f34-b16e5190ce18`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041373', 'lastCheck': '0.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:01:45,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`52da9daf-2c21-4f0b-9f34-b16e5190ce18`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:45,913::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:45,913::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:45,914::task::993::Storage.TaskManager.Task::(_decref) Task=`52da9daf-2c21-4f0b-9f34-b16e5190ce18`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:01:45,946::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:01:45,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:46,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173224 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:48,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:48,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186687 s, 54.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:50,043::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:50,049::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:50,050::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:01:50,139::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:01:50,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:50,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173956 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:01:51,042::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:01:51,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0242d7c-7a4d-4659-b004-d954b6831dc4`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:01:51,044::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:01:51,058::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:51,059::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0242d7c-7a4d-4659-b004-d954b6831dc4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:01:51,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0242d7c-7a4d-4659-b004-d954b6831dc4`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:01:51,059::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:01:51,060::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:01:51,060::task::993::Storage.TaskManager.Task::(_decref) Task=`d0242d7c-7a4d-4659-b004-d954b6831dc4`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:01:51,073::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:01:51,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce1f8e03-1571-4daa-b914-b3fd2301b3fc`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:01:51,074::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:01:51,075::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0964809f-561f-4ffa-93f7-7a32441f6af9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:01:51,076::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:01:51,076::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:01:51,076::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0964809f-561f-4ffa-93f7-7a32441f6af9`::Granted request >Thread-7083::DEBUG::2014-07-08 17:01:51,077::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce1f8e03-1571-4daa-b914-b3fd2301b3fc`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:01:51,077::task::993::Storage.TaskManager.Task::(_decref) Task=`ce1f8e03-1571-4daa-b914-b3fd2301b3fc`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:01:51,096::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:51,097::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce1f8e03-1571-4daa-b914-b3fd2301b3fc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:01:51,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce1f8e03-1571-4daa-b914-b3fd2301b3fc`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:01:51,097::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:01:51,097::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:01:51,098::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:01:51,098::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:01:51,098::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:01:51,099::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:01:51,099::task::993::Storage.TaskManager.Task::(_decref) Task=`ce1f8e03-1571-4daa-b914-b3fd2301b3fc`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:01:52,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc1aa0c6-3534-47ba-8080-92ff82af3dfb`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:01:52,027::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:01:52,029::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:52,029::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:01:52,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:52,030::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:52,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:52,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:52,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:52,031::__init__::225::IOProcess::(_processLogs) (274038) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:01:52,031::__init__::225::IOProcess::(_processLogs) (274038) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:01:52,031::__init__::225::IOProcess::(_processLogs) (274038) Building response >Thread-18::DEBUG::2014-07-08 17:01:52,031::__init__::225::IOProcess::(_processLogs) (274038) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:52,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:52,032::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:01:52,038::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:52,040::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:01:52,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:52,041::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:52,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:52,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:52,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:52,042::__init__::225::IOProcess::(_processLogs) (274039) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:01:52,043::__init__::225::IOProcess::(_processLogs) (274039) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:01:52,043::__init__::225::IOProcess::(_processLogs) (274039) Building response >Thread-18::DEBUG::2014-07-08 17:01:52,043::__init__::225::IOProcess::(_processLogs) (274039) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:52,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:52,044::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:01:52,045::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:01:52,045::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc1aa0c6-3534-47ba-8080-92ff82af3dfb`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:01:52,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc1aa0c6-3534-47ba-8080-92ff82af3dfb`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:01:52,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:01:52,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:01:52,046::task::993::Storage.TaskManager.Task::(_decref) Task=`fc1aa0c6-3534-47ba-8080-92ff82af3dfb`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:01:52,127::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:01:52,127::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:01:52,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:53,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175096 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:55,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:55,300::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:55,328::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:01:55,334::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:01:55,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.136234 s, 7.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:55,532::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:55,533::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:55,533::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:55,533::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:55,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:55,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:55,534::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:55,534::__init__::225::IOProcess::(_processLogs) (274040) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:55,534::__init__::225::IOProcess::(_processLogs) (274040) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:55,535::__init__::225::IOProcess::(_processLogs) (274040) Building response >Thread-18::DEBUG::2014-07-08 17:01:55,535::__init__::225::IOProcess::(_processLogs) (274040) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:55,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:55,535::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:01:55,537::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:01:55,836::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000615704 s, 750 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:01:55,849::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:55,857::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:01:55,864::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:55,869::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:55,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:55,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:55,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:55,895::__init__::225::IOProcess::(_processLogs) (274041) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:01:55,899::__init__::225::IOProcess::(_processLogs) (274041) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:01:55,904::__init__::225::IOProcess::(_processLogs) (274041) Building response >Thread-18::DEBUG::2014-07-08 17:01:55,908::__init__::225::IOProcess::(_processLogs) (274041) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:55,912::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:55,918::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:01:55,935::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:01:55,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:55,938::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:55,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:55,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:55,943::__init__::225::IOProcess::(_processLogs) (274042) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:55,944::__init__::225::IOProcess::(_processLogs) (274042) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:55,946::__init__::225::IOProcess::(_processLogs) (274042) Building response >Thread-18::DEBUG::2014-07-08 17:01:55,948::__init__::225::IOProcess::(_processLogs) (274042) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:55,949::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:55,951::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:55,957::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:01:55,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:55,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:55,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:55,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:55,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:55,967::__init__::225::IOProcess::(_processLogs) (274043) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:55,969::__init__::225::IOProcess::(_processLogs) (274043) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:55,971::__init__::225::IOProcess::(_processLogs) (274043) Building response >Thread-18::DEBUG::2014-07-08 17:01:55,972::__init__::225::IOProcess::(_processLogs) (274043) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:55,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:55,975::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:01:55,979::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:01:55,981::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:01:55,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:01:55,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:01:55,985::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:01:55,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:01:55,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:01:55,989::__init__::225::IOProcess::(_processLogs) (274044) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:01:55,990::__init__::225::IOProcess::(_processLogs) (274044) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:01:55,992::__init__::225::IOProcess::(_processLogs) (274044) Building response >Thread-18::DEBUG::2014-07-08 17:01:55,994::__init__::225::IOProcess::(_processLogs) (274044) Queuing response >Thread-18::DEBUG::2014-07-08 17:01:55,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:01:55,996::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:01:57,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:01:57,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175381 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:01:59,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:00,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342163 s, 29.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:00,344::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:00,346::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:00,347::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:02:01,123::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:02:01,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0ec9546-875d-4ee6-aa33-fe4e2e7ebe73`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:02:01,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:02:01,164::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:01,165::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0ec9546-875d-4ee6-aa33-fe4e2e7ebe73`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:01,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0ec9546-875d-4ee6-aa33-fe4e2e7ebe73`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:02:01,166::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:02:01,166::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:02:01,166::task::993::Storage.TaskManager.Task::(_decref) Task=`b0ec9546-875d-4ee6-aa33-fe4e2e7ebe73`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:02:01,178::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:02:01,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`9116ad7a-6de7-45ac-903e-2f604e984368`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:02:01,180::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:02:01,181::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5bb48257-43cb-4496-8c48-b7ac163fa963`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:02:01,181::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:02:01,182::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:02:01,182::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5bb48257-43cb-4496-8c48-b7ac163fa963`::Granted request >Thread-7083::DEBUG::2014-07-08 17:02:01,183::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9116ad7a-6de7-45ac-903e-2f604e984368`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:02:01,183::task::993::Storage.TaskManager.Task::(_decref) Task=`9116ad7a-6de7-45ac-903e-2f604e984368`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:02:01,209::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:01,210::task::1191::Storage.TaskManager.Task::(prepare) Task=`9116ad7a-6de7-45ac-903e-2f604e984368`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:01,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`9116ad7a-6de7-45ac-903e-2f604e984368`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:02:01,211::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:02:01,211::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:02:01,211::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:02:01,212::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:02:01,212::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:02:01,212::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:02:01,212::task::993::Storage.TaskManager.Task::(_decref) Task=`9116ad7a-6de7-45ac-903e-2f604e984368`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:02:01,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`67786084-46b7-4da1-afdc-1d086f1eca10`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:02:01,379::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:02:01,379::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615704', 'lastCheck': '5.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:02:01,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`67786084-46b7-4da1-afdc-1d086f1eca10`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615704', 'lastCheck': '5.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:02:01,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`67786084-46b7-4da1-afdc-1d086f1eca10`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:02:01,380::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:02:01,380::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:02:01,380::task::993::Storage.TaskManager.Task::(_decref) Task=`67786084-46b7-4da1-afdc-1d086f1eca10`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:02:01,413::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:02:02,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:02,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174822 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:02:04,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:04,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448219 s, 22.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:05,356::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:05,362::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:05,367::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:02:06,002::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:06,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:06,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:06,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:06,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:06,004::__init__::225::IOProcess::(_processLogs) (274045) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:06,004::__init__::225::IOProcess::(_processLogs) (274045) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:06,004::__init__::225::IOProcess::(_processLogs) (274045) Building response >Thread-18::DEBUG::2014-07-08 17:02:06,004::__init__::225::IOProcess::(_processLogs) (274045) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:06,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:06,005::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:02:06,006::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:02:06,162::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000499212 s, 925 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:02:06,176::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:06,182::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:06,187::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:06,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:06,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:06,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:06,294::__init__::225::IOProcess::(_processLogs) (274046) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:06,310::__init__::225::IOProcess::(_processLogs) (274046) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:06,315::__init__::225::IOProcess::(_processLogs) (274046) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:06,322::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:06,324::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:02:06,346::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:02:06,351::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:06,356::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:06,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:06,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:06,376::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:06,381::__init__::225::IOProcess::(_processLogs) (274047) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:06,382::__init__::225::IOProcess::(_processLogs) (274047) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:06,384::__init__::225::IOProcess::(_processLogs) (274047) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:06,386::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:06,474::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:06,487::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:02:06,489::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:06,492::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:06,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:06,496::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:06,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:06,501::__init__::225::IOProcess::(_processLogs) (274048) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:06,503::__init__::225::IOProcess::(_processLogs) (274048) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:06,517::__init__::225::IOProcess::(_processLogs) (274048) Building response >Thread-18::DEBUG::2014-07-08 17:02:06,519::__init__::225::IOProcess::(_processLogs) (274048) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:06,521::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:06,523::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:06,534::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:02:06,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:06,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:06,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:06,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:06,543::__init__::225::IOProcess::(_processLogs) (274049) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:06,545::__init__::225::IOProcess::(_processLogs) (274049) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:06,547::__init__::225::IOProcess::(_processLogs) (274049) Building response >Thread-18::DEBUG::2014-07-08 17:02:06,549::__init__::225::IOProcess::(_processLogs) (274049) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:06,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:06,552::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:02:06,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:07,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172473 s, 59.4 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:02:07,337::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:02:07,338::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:02:09,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:09,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195629 s, 52.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:10,377::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:10,378::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:10,379::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:02:11,228::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:02:11,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c5bbaa5-23c9-4ee0-8be5-8e22cf4b8e33`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:02:11,230::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:02:11,248::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:11,248::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c5bbaa5-23c9-4ee0-8be5-8e22cf4b8e33`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:11,249::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c5bbaa5-23c9-4ee0-8be5-8e22cf4b8e33`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:02:11,249::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:02:11,249::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:02:11,249::task::993::Storage.TaskManager.Task::(_decref) Task=`0c5bbaa5-23c9-4ee0-8be5-8e22cf4b8e33`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:02:11,269::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:02:11,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`92d8490d-eb85-454c-b7af-b685a7960dde`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:02:11,270::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:02:11,271::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b307f421-2c5a-4d67-8161-8f88ec5820a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:02:11,271::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:02:11,272::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:02:11,272::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b307f421-2c5a-4d67-8161-8f88ec5820a2`::Granted request >Thread-7083::DEBUG::2014-07-08 17:02:11,273::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`92d8490d-eb85-454c-b7af-b685a7960dde`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:02:11,273::task::993::Storage.TaskManager.Task::(_decref) Task=`92d8490d-eb85-454c-b7af-b685a7960dde`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:02:11,292::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:11,292::task::1191::Storage.TaskManager.Task::(prepare) Task=`92d8490d-eb85-454c-b7af-b685a7960dde`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:11,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`92d8490d-eb85-454c-b7af-b685a7960dde`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:02:11,292::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:02:11,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:02:11,293::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:02:11,293::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:02:11,294::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:02:11,294::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:02:11,294::task::993::Storage.TaskManager.Task::(_decref) Task=`92d8490d-eb85-454c-b7af-b685a7960dde`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:02:11,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:11,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171744 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:02:13,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:13,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171777 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:15,387::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:15,388::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:15,389::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:02:15,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:16,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173032 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:02:16,559::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:16,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:16,560::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:16,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:16,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:16,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:16,561::__init__::225::IOProcess::(_processLogs) (274050) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:16,561::__init__::225::IOProcess::(_processLogs) (274050) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:16,561::__init__::225::IOProcess::(_processLogs) (274050) Building response >Thread-18::DEBUG::2014-07-08 17:02:16,561::__init__::225::IOProcess::(_processLogs) (274050) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:16,562::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:16,562::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:02:16,563::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:02:16,718::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000491391 s, 940 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:02:16,732::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:16,734::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:16,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 17:02:16,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`3039bc40-ba0b-4ce3-b0ad-02bc6519484e`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:02:16,741::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::INFO::2014-07-08 17:02:16,744::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::DEBUG::2014-07-08 17:02:16,745::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::INFO::2014-07-08 17:02:16,748::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499212', 'lastCheck': '10.2', 'valid': True}} >Thread-18::DEBUG::2014-07-08 17:02:16,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 17:02:16,751::task::1191::Storage.TaskManager.Task::(prepare) Task=`3039bc40-ba0b-4ce3-b0ad-02bc6519484e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499212', 'lastCheck': '10.2', 'valid': True}} >Thread-18::DEBUG::2014-07-08 17:02:16,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 17:02:16,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`3039bc40-ba0b-4ce3-b0ad-02bc6519484e`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:02:16,756::__init__::225::IOProcess::(_processLogs) (274051) Finding callback 'statvfs'... >Thread-7082::DEBUG::2014-07-08 17:02:16,757::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:02:16,759::__init__::225::IOProcess::(_processLogs) (274051) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 17:02:16,759::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:02:16,761::__init__::225::IOProcess::(_processLogs) (274051) Building response >Thread-7082::DEBUG::2014-07-08 17:02:16,763::task::993::Storage.TaskManager.Task::(_decref) Task=`3039bc40-ba0b-4ce3-b0ad-02bc6519484e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:02:16,764::__init__::225::IOProcess::(_processLogs) (274051) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:16,767::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:16,770::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:02:16,791::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:16,794::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:02:16,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:16,799::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:16,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:16,805::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:16,807::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:16,810::__init__::225::IOProcess::(_processLogs) (274052) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:16,812::__init__::225::IOProcess::(_processLogs) (274052) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:16,814::__init__::225::IOProcess::(_processLogs) (274052) Building response >Thread-18::DEBUG::2014-07-08 17:02:16,817::__init__::225::IOProcess::(_processLogs) (274052) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:16,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:16,821::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:16,832::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:16,835::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:02:16,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:16,839::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:16,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:16,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:16,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:16,850::__init__::225::IOProcess::(_processLogs) (274053) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:16,853::__init__::225::IOProcess::(_processLogs) (274053) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:16,855::__init__::225::IOProcess::(_processLogs) (274053) Building response >Thread-18::DEBUG::2014-07-08 17:02:16,857::__init__::225::IOProcess::(_processLogs) (274053) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:16,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:16,859::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:16,865::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:16,866::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:02:16,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:16,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:16,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:16,872::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:16,874::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:16,875::__init__::225::IOProcess::(_processLogs) (274054) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:16,877::__init__::225::IOProcess::(_processLogs) (274054) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:16,878::__init__::225::IOProcess::(_processLogs) (274054) Building response >Thread-18::DEBUG::2014-07-08 17:02:16,881::__init__::225::IOProcess::(_processLogs) (274054) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:16,885::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 17:02:16,889::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:02:16,890::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:02:18,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:18,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158614 s, 64.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:02:20,387::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:20,396::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:20,398::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:20,399::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:02:20,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:20,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405636 s, 25.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:02:21,314::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:02:21,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbf93eb3-8074-4ead-a254-6bc9162f3e31`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:02:21,316::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:02:21,332::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:21,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`fbf93eb3-8074-4ead-a254-6bc9162f3e31`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:21,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbf93eb3-8074-4ead-a254-6bc9162f3e31`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:02:21,333::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:02:21,333::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:02:21,333::task::993::Storage.TaskManager.Task::(_decref) Task=`fbf93eb3-8074-4ead-a254-6bc9162f3e31`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:02:21,348::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:02:21,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`65236d6a-e581-4d90-8bb7-7e6795d7a194`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:02:21,349::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:02:21,350::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e2b211d5-6382-4128-ba14-9cbe53505e16`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:02:21,350::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:02:21,351::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:02:21,351::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e2b211d5-6382-4128-ba14-9cbe53505e16`::Granted request >Thread-7083::DEBUG::2014-07-08 17:02:21,352::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`65236d6a-e581-4d90-8bb7-7e6795d7a194`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:02:21,352::task::993::Storage.TaskManager.Task::(_decref) Task=`65236d6a-e581-4d90-8bb7-7e6795d7a194`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:02:21,371::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:21,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`65236d6a-e581-4d90-8bb7-7e6795d7a194`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:21,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`65236d6a-e581-4d90-8bb7-7e6795d7a194`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:02:21,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:02:21,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:02:21,373::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:02:21,373::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:02:21,373::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:02:21,373::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:02:21,374::task::993::Storage.TaskManager.Task::(_decref) Task=`65236d6a-e581-4d90-8bb7-7e6795d7a194`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:02:22,424::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:02:22,425::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:02:22,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:23,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174515 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:02:25,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:25,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173629 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:25,406::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:25,408::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:25,409::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-37::DEBUG::2014-07-08 17:02:26,901::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:02:26,907::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:26,911::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 17:02:26,912::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:26,912::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:26,913::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:26,913::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:26,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:26,913::__init__::225::IOProcess::(_processLogs) (274055) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:02:26,914::__init__::225::IOProcess::(_processLogs) (274055) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:02:26,914::__init__::225::IOProcess::(_processLogs) (274055) Building response >Thread-18::DEBUG::2014-07-08 17:02:26,914::__init__::225::IOProcess::(_processLogs) (274055) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:26,914::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:26,915::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:02:26,916::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:26,917::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:02:26,917::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:26,917::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:26,918::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:26,918::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:26,918::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:26,918::__init__::225::IOProcess::(_processLogs) (274056) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:02:26,919::__init__::225::IOProcess::(_processLogs) (274056) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:02:26,919::__init__::225::IOProcess::(_processLogs) (274056) Building response >Thread-18::DEBUG::2014-07-08 17:02:26,919::__init__::225::IOProcess::(_processLogs) (274056) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:26,919::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:26,920::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:02:26,920::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:26,921::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:02:26,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:26,922::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:26,922::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:26,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:26,923::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:26,923::__init__::225::IOProcess::(_processLogs) (274057) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:02:26,923::__init__::225::IOProcess::(_processLogs) (274057) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:02:26,923::__init__::225::IOProcess::(_processLogs) (274057) Building response >Thread-18::DEBUG::2014-07-08 17:02:26,923::__init__::225::IOProcess::(_processLogs) (274057) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:26,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:26,924::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 17:02:26,925::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:26,927::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 17:02:26,929::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:26,931::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:26,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:26,935::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:26,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:26,938::__init__::225::IOProcess::(_processLogs) (274058) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:02:26,940::__init__::225::IOProcess::(_processLogs) (274058) Got request for method 'glob' >Thread-37::DEBUG::2014-07-08 17:02:26,941::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:02:26,941::__init__::225::IOProcess::(_processLogs) (274058) Building response >Thread-18::DEBUG::2014-07-08 17:02:26,943::__init__::225::IOProcess::(_processLogs) (274058) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:26,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:26,943::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 17:02:26,945::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 17:02:26,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:26,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:26,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:26,946::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:26,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:26,946::__init__::225::IOProcess::(_processLogs) (274059) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 17:02:26,946::__init__::225::IOProcess::(_processLogs) (274059) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 17:02:26,947::__init__::225::IOProcess::(_processLogs) (274059) Building response >Thread-18::DEBUG::2014-07-08 17:02:26,947::__init__::225::IOProcess::(_processLogs) (274059) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:26,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:26,947::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 17:02:26,948::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 17:02:26,949::__init__::225::IOProcess::(_processLogs) (274059) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:26,950::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 17:02:26,950::__init__::225::IOProcess::(_processLogs) (274059) Finding callback 'touch'...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:26,950::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:26,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:26,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:26,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:26,951::__init__::225::IOProcess::(_processLogs) (274060) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 17:02:26,951::__init__::225::IOProcess::(_processLogs) (274060) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 17:02:26,952::__init__::225::IOProcess::(_processLogs) (274059) Finding callback 'touch'...DEBUG|(274060) Building response >Thread-18::DEBUG::2014-07-08 17:02:26,952::__init__::225::IOProcess::(_processLogs) (274060) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:26,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:26,952::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 17:02:26,954::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 17:02:26,955::__init__::225::IOProcess::(_processLogs) (274059) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:26,956::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 17:02:26,956::__init__::225::IOProcess::(_processLogs) (274059) Finding callback 'touch'...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:26,956::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:26,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:26,957::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:26,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:26,957::__init__::225::IOProcess::(_processLogs) (274061) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:26,957::__init__::225::IOProcess::(_processLogs) (274061) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:26,958::__init__::225::IOProcess::(_processLogs) (274061) Building response >Thread-18::DEBUG::2014-07-08 17:02:26,958::__init__::225::IOProcess::(_processLogs) (274061) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:26,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:26,958::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:26,959::__init__::225::IOProcess::(_processLogs) (274059) Finding callback 'touch'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:26,960::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 17:02:26,960::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:26,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:26,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:26,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:26,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:26,965::__init__::225::IOProcess::(_processLogs) (274062) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:02:26,965::__init__::225::IOProcess::(_processLogs) (274062) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:02:26,965::__init__::225::IOProcess::(_processLogs) (274062) Building response >Thread-18::DEBUG::2014-07-08 17:02:26,966::__init__::225::IOProcess::(_processLogs) (274062) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:26,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:26,966::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 17:02:26,967::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 17:02:26,967::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 17:02:26,967::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 17:02:26,968::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:26,969::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:26,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:26,969::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:26,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:26,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:26,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:26,970::__init__::225::IOProcess::(_processLogs) (274063) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:26,970::__init__::225::IOProcess::(_processLogs) (274063) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:26,971::__init__::225::IOProcess::(_processLogs) (274063) Building response >Thread-18::DEBUG::2014-07-08 17:02:26,971::__init__::225::IOProcess::(_processLogs) (274063) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:26,971::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:02:26,972::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:02:27,130::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000466807 s, 990 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:02:27,134::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:27,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:27,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:27,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:27,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:27,142::__init__::225::IOProcess::(_processLogs) (274064) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:27,143::__init__::225::IOProcess::(_processLogs) (274064) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:27,144::__init__::225::IOProcess::(_processLogs) (274064) Building response >Thread-18::DEBUG::2014-07-08 17:02:27,145::__init__::225::IOProcess::(_processLogs) (274064) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:27,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:27,148::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:02:27,156::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:02:27,158::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:27,159::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:27,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:27,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:27,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:27,166::__init__::225::IOProcess::(_processLogs) (274065) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:27,168::__init__::225::IOProcess::(_processLogs) (274065) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:27,169::__init__::225::IOProcess::(_processLogs) (274065) Building response >Thread-18::DEBUG::2014-07-08 17:02:27,171::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:27,172::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:27,177::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:02:27,179::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:27,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:27,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:27,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:27,185::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:27,186::__init__::225::IOProcess::(_processLogs) (274066) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:27,188::__init__::225::IOProcess::(_processLogs) (274066) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:27,189::__init__::225::IOProcess::(_processLogs) (274066) Building response >Thread-18::DEBUG::2014-07-08 17:02:27,190::__init__::225::IOProcess::(_processLogs) (274066) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:27,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:27,194::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:27,198::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:27,200::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:02:27,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:27,204::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:27,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:27,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:27,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:27,209::__init__::225::IOProcess::(_processLogs) (274067) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:27,211::__init__::225::IOProcess::(_processLogs) (274067) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:27,212::__init__::225::IOProcess::(_processLogs) (274067) Building response >Thread-18::DEBUG::2014-07-08 17:02:27,213::__init__::225::IOProcess::(_processLogs) (274067) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:27,215::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:27,216::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:02:27,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:27,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172009 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:02:29,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:29,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175568 s, 58.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:30,417::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:30,418::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:30,419::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:02:31,388::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:02:31,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`d517ff8b-b7ea-4882-b459-12aa5cf0c064`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:02:31,390::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:02:31,405::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:31,405::task::1191::Storage.TaskManager.Task::(prepare) Task=`d517ff8b-b7ea-4882-b459-12aa5cf0c064`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:31,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`d517ff8b-b7ea-4882-b459-12aa5cf0c064`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:02:31,406::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:02:31,406::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:02:31,406::task::993::Storage.TaskManager.Task::(_decref) Task=`d517ff8b-b7ea-4882-b459-12aa5cf0c064`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:02:31,422::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:02:31,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`02ee8aea-bef0-4ebd-8720-e382dad7f6d9`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:02:31,423::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:02:31,424::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`49aec732-c88c-4d42-b637-b361da64deb6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:02:31,425::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:02:31,425::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:02:31,425::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`49aec732-c88c-4d42-b637-b361da64deb6`::Granted request >Thread-7083::DEBUG::2014-07-08 17:02:31,426::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`02ee8aea-bef0-4ebd-8720-e382dad7f6d9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:02:31,426::task::993::Storage.TaskManager.Task::(_decref) Task=`02ee8aea-bef0-4ebd-8720-e382dad7f6d9`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:02:31,445::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:31,446::task::1191::Storage.TaskManager.Task::(prepare) Task=`02ee8aea-bef0-4ebd-8720-e382dad7f6d9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576231936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:31,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`02ee8aea-bef0-4ebd-8720-e382dad7f6d9`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:02:31,446::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:02:31,447::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:02:31,447::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:02:31,447::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:02:31,448::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:02:31,448::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:02:31,448::task::993::Storage.TaskManager.Task::(_decref) Task=`02ee8aea-bef0-4ebd-8720-e382dad7f6d9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:02:31,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:32,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176169 s, 58.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:02:32,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`563fa788-7a4d-4f89-a906-02fbceded63c`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:02:32,125::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:02:32,127::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466807', 'lastCheck': '4.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:02:32,129::task::1191::Storage.TaskManager.Task::(prepare) Task=`563fa788-7a4d-4f89-a906-02fbceded63c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466807', 'lastCheck': '4.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:02:32,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`563fa788-7a4d-4f89-a906-02fbceded63c`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:02:32,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:02:32,132::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:02:32,133::task::993::Storage.TaskManager.Task::(_decref) Task=`563fa788-7a4d-4f89-a906-02fbceded63c`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:02:32,197::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:02:34,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:34,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017525 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:35,427::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:35,428::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:35,429::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:02:36,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:36,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172342 s, 59.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:02:37,234::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:37,234::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:37,234::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:37,235::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:37,235::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:37,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:37,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:37,236::__init__::225::IOProcess::(_processLogs) (274068) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:37,236::__init__::225::IOProcess::(_processLogs) (274068) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:37,236::__init__::225::IOProcess::(_processLogs) (274068) Building response >Thread-18::DEBUG::2014-07-08 17:02:37,236::__init__::225::IOProcess::(_processLogs) (274068) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:37,236::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:37,237::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:02:37,238::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:02:37,387::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000676606 s, 683 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:02:37,393::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:37,394::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:37,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:37,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:37,399::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:37,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:37,402::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:37,404::__init__::225::IOProcess::(_processLogs) (274069) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:37,405::__init__::225::IOProcess::(_processLogs) (274069) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:37,407::__init__::225::IOProcess::(_processLogs) (274069) Building response >Thread-18::DEBUG::2014-07-08 17:02:37,408::__init__::225::IOProcess::(_processLogs) (274069) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:37,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:37,411::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:02:37,421::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:37,423::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:02:37,424::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:37,426::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:37,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:37,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:37,431::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:37,432::__init__::225::IOProcess::(_processLogs) (274070) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:37,434::__init__::225::IOProcess::(_processLogs) (274070) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:37,436::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274070) Building response >Thread-18::DEBUG::2014-07-08 17:02:37,438::__init__::225::IOProcess::(_processLogs) (274070) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:37,439::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:37,441::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:37,447::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:37,449::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:02:37,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:37,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:37,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:37,456::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:37,459::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:37,461::__init__::225::IOProcess::(_processLogs) (274071) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:37,462::__init__::225::IOProcess::(_processLogs) (274071) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:37,463::__init__::225::IOProcess::(_processLogs) (274071) Building response >Thread-18::DEBUG::2014-07-08 17:02:37,465::__init__::225::IOProcess::(_processLogs) (274071) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:37,467::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:37,469::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:02:37,470::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:02:37,473::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:02:37,481::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:37,483::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:02:37,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:37,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:37,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:37,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:37,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:37,493::__init__::225::IOProcess::(_processLogs) (274072) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:37,495::__init__::225::IOProcess::(_processLogs) (274072) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:37,496::__init__::225::IOProcess::(_processLogs) (274072) Building response >Thread-18::DEBUG::2014-07-08 17:02:37,498::__init__::225::IOProcess::(_processLogs) (274072) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:37,499::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:37,501::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:02:38,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:39,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454733 s, 22.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:40,437::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:40,438::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:40,439::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:02:41,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:41,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173621 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:02:41,477::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:02:41,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`34afa44b-30a9-4ec3-a293-b7f347bb1639`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:02:41,482::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:02:41,498::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:41,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`34afa44b-30a9-4ec3-a293-b7f347bb1639`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:41,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`34afa44b-30a9-4ec3-a293-b7f347bb1639`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:02:41,501::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:02:41,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:02:41,504::task::993::Storage.TaskManager.Task::(_decref) Task=`34afa44b-30a9-4ec3-a293-b7f347bb1639`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:02:41,521::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:02:41,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2d60759-2056-4d88-9b8e-e8bf85ec7025`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:02:41,523::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:02:41,524::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`387bf5ef-fb48-49e8-876c-8d7effe16c78`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:02:41,524::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:02:41,524::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:02:41,525::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`387bf5ef-fb48-49e8-876c-8d7effe16c78`::Granted request >Thread-7083::DEBUG::2014-07-08 17:02:41,525::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a2d60759-2056-4d88-9b8e-e8bf85ec7025`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:02:41,526::task::993::Storage.TaskManager.Task::(_decref) Task=`a2d60759-2056-4d88-9b8e-e8bf85ec7025`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:02:41,545::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:41,545::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2d60759-2056-4d88-9b8e-e8bf85ec7025`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:41,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2d60759-2056-4d88-9b8e-e8bf85ec7025`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:02:41,546::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:02:41,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:02:41,546::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:02:41,547::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:02:41,547::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:02:41,547::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:02:41,547::task::993::Storage.TaskManager.Task::(_decref) Task=`a2d60759-2056-4d88-9b8e-e8bf85ec7025`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:02:43,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:43,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0914344 s, 11.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:45,446::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:45,449::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:45,450::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:02:45,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:46,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170397 s, 60.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:02:47,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdefd8bc-3e62-451f-9e1c-860dbb45a6f7`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:02:47,436::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:02:47,437::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676606', 'lastCheck': '9.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:02:47,437::task::1191::Storage.TaskManager.Task::(prepare) Task=`cdefd8bc-3e62-451f-9e1c-860dbb45a6f7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676606', 'lastCheck': '9.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:02:47,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdefd8bc-3e62-451f-9e1c-860dbb45a6f7`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:02:47,437::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:02:47,438::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:02:47,438::task::993::Storage.TaskManager.Task::(_decref) Task=`cdefd8bc-3e62-451f-9e1c-860dbb45a6f7`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:02:47,469::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:02:47,507::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:47,508::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:47,508::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:47,508::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:47,508::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:47,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:47,509::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:47,509::__init__::225::IOProcess::(_processLogs) (274073) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:47,509::__init__::225::IOProcess::(_processLogs) (274073) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:47,510::__init__::225::IOProcess::(_processLogs) (274073) Building response >Thread-18::DEBUG::2014-07-08 17:02:47,510::__init__::225::IOProcess::(_processLogs) (274073) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:47,510::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:47,510::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:02:47,512::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:02:47,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000701747 s, 658 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:02:47,676::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:47,678::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:47,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:47,680::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:47,682::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:47,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:47,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:47,685::__init__::225::IOProcess::(_processLogs) (274074) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:47,686::__init__::225::IOProcess::(_processLogs) (274074) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:47,687::__init__::225::IOProcess::(_processLogs) (274074) Building response >Thread-18::DEBUG::2014-07-08 17:02:47,688::__init__::225::IOProcess::(_processLogs) (274074) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:47,689::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:47,690::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:02:47,697::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:02:47,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:47,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:47,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:47,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:47,702::__init__::225::IOProcess::(_processLogs) (274075) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:47,704::__init__::225::IOProcess::(_processLogs) (274075) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:47,705::__init__::225::IOProcess::(_processLogs) (274075) Building response >Thread-18::DEBUG::2014-07-08 17:02:47,707::__init__::225::IOProcess::(_processLogs) (274075) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:47,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:47,710::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:47,715::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:02:47,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:47,719::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:47,720::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:47,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:47,723::__init__::225::IOProcess::(_processLogs) (274076) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:47,725::__init__::225::IOProcess::(_processLogs) (274076) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:47,727::__init__::225::IOProcess::(_processLogs) (274076) Building response >Thread-18::DEBUG::2014-07-08 17:02:47,728::__init__::225::IOProcess::(_processLogs) (274076) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:47,729::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:47,731::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:47,737::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:02:47,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:47,740::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:47,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:47,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:47,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:47,746::__init__::225::IOProcess::(_processLogs) (274077) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:47,748::__init__::225::IOProcess::(_processLogs) (274077) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:47,749::__init__::225::IOProcess::(_processLogs) (274077) Building response >Thread-18::DEBUG::2014-07-08 17:02:47,751::__init__::225::IOProcess::(_processLogs) (274077) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:47,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:47,754::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:02:48,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:48,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172157 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:02:50,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:50,617::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:50,625::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:50,632::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:02:50,705::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:02:50,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263546 s, 38.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:02:51,561::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:02:51,562::task::595::Storage.TaskManager.Task::(_updateState) Task=`c908c53c-0728-46a0-8e7c-93a5af1e3058`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:02:51,562::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:02:51,577::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:51,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`c908c53c-0728-46a0-8e7c-93a5af1e3058`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:02:51,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`c908c53c-0728-46a0-8e7c-93a5af1e3058`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:02:51,578::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:02:51,578::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:02:51,579::task::993::Storage.TaskManager.Task::(_decref) Task=`c908c53c-0728-46a0-8e7c-93a5af1e3058`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:02:51,590::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:02:51,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`46402539-ce73-477b-a564-41fd882e96a1`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:02:51,592::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:02:51,593::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5b6936c3-503f-410e-82e6-034d72d6a235`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:02:51,593::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:02:51,593::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:02:51,594::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5b6936c3-503f-410e-82e6-034d72d6a235`::Granted request >Thread-7083::DEBUG::2014-07-08 17:02:51,594::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`46402539-ce73-477b-a564-41fd882e96a1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:02:51,595::task::993::Storage.TaskManager.Task::(_decref) Task=`46402539-ce73-477b-a564-41fd882e96a1`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:02:51,613::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:51,614::task::1191::Storage.TaskManager.Task::(prepare) Task=`46402539-ce73-477b-a564-41fd882e96a1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:02:51,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`46402539-ce73-477b-a564-41fd882e96a1`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:02:51,614::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:02:51,615::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:02:51,615::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:02:51,615::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:02:51,616::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:02:51,616::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:02:51,616::task::993::Storage.TaskManager.Task::(_decref) Task=`46402539-ce73-477b-a564-41fd882e96a1`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:02:52,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`50e2b1bc-edd0-412f-a897-2b4dfd2f2b6d`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:02:52,620::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:02:52,622::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:52,622::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:02:52,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:52,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:52,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:52,624::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:52,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:52,624::__init__::225::IOProcess::(_processLogs) (274078) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:02:52,624::__init__::225::IOProcess::(_processLogs) (274078) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:02:52,624::__init__::225::IOProcess::(_processLogs) (274078) Building response >Thread-18::DEBUG::2014-07-08 17:02:52,625::__init__::225::IOProcess::(_processLogs) (274078) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:52,625::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:52,625::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:02:52,627::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:52,627::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:02:52,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:52,628::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:52,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:52,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:52,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:52,629::__init__::225::IOProcess::(_processLogs) (274079) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:02:52,629::__init__::225::IOProcess::(_processLogs) (274079) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:02:52,629::__init__::225::IOProcess::(_processLogs) (274079) Building response >Thread-18::DEBUG::2014-07-08 17:02:52,630::__init__::225::IOProcess::(_processLogs) (274079) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:52,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:52,630::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:02:52,631::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:02:52,632::task::1191::Storage.TaskManager.Task::(prepare) Task=`50e2b1bc-edd0-412f-a897-2b4dfd2f2b6d`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:02:52,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`50e2b1bc-edd0-412f-a897-2b4dfd2f2b6d`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:02:52,632::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:02:52,632::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:02:52,632::task::993::Storage.TaskManager.Task::(_decref) Task=`50e2b1bc-edd0-412f-a897-2b4dfd2f2b6d`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:02:52,712::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:02:52,712::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:02:52,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:52,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173853 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:02:54,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:55,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175604 s, 58.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:55,642::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:55,644::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:02:55,645::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:02:57,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:57,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365534 s, 28.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:02:57,760::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:57,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:57,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:57,761::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:57,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:57,761::__init__::225::IOProcess::(_processLogs) (274080) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:57,761::__init__::225::IOProcess::(_processLogs) (274080) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:57,762::__init__::225::IOProcess::(_processLogs) (274080) Building response >Thread-18::DEBUG::2014-07-08 17:02:57,762::__init__::225::IOProcess::(_processLogs) (274080) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:57,762::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:57,762::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:02:57,764::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:02:57,912::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000511783 s, 903 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:02:57,918::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:02:57,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:57,922::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:57,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:57,924::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:57,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:57,927::__init__::225::IOProcess::(_processLogs) (274081) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:02:57,929::__init__::225::IOProcess::(_processLogs) (274081) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:02:57,931::__init__::225::IOProcess::(_processLogs) (274081) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:57,932::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:57,933::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:02:57,942::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:02:57,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:57,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:57,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:57,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:57,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:57,951::__init__::225::IOProcess::(_processLogs) (274082) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:57,953::__init__::225::IOProcess::(_processLogs) (274082) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:57,954::__init__::225::IOProcess::(_processLogs) (274082) Building response >Thread-18::DEBUG::2014-07-08 17:02:57,956::__init__::225::IOProcess::(_processLogs) (274082) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:57,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:57,959::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:57,964::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:57,966::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:02:57,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:57,969::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:57,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:57,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:57,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:57,976::__init__::225::IOProcess::(_processLogs) (274083) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:57,981::__init__::225::IOProcess::(_processLogs) (274083) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:57,983::__init__::225::IOProcess::(_processLogs) (274083) Building response >Thread-18::DEBUG::2014-07-08 17:02:57,984::__init__::225::IOProcess::(_processLogs) (274083) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:57,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:57,986::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:02:57,992::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:02:57,993::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:02:57,994::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:02:57,996::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:02:57,998::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:02:57,999::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:02:58,001::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:02:58,002::__init__::225::IOProcess::(_processLogs) (274084) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:02:58,003::__init__::225::IOProcess::(_processLogs) (274084) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:02:58,006::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274084) Building response >Thread-18::DEBUG::2014-07-08 17:02:58,007::__init__::225::IOProcess::(_processLogs) (274084) Queuing response >Thread-18::DEBUG::2014-07-08 17:02:58,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:02:58,010::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:02:59,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:02:59,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112547 s, 9.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:00,648::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:00,650::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:00,651::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:03:01,633::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:03:01,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`24929ae1-6bed-4380-8686-384ea4231d4b`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:03:01,634::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:03:01,649::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:03:01,650::task::1191::Storage.TaskManager.Task::(prepare) Task=`24929ae1-6bed-4380-8686-384ea4231d4b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:03:01,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`24929ae1-6bed-4380-8686-384ea4231d4b`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:03:01,650::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:03:01,651::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:03:01,651::task::993::Storage.TaskManager.Task::(_decref) Task=`24929ae1-6bed-4380-8686-384ea4231d4b`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:03:01,666::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:03:01,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`f22f3694-a1a6-4dcf-8f11-a632b9994001`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:03:01,667::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:03:01,668::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`da729382-35a3-487a-82f5-7f6831433499`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:03:01,668::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:03:01,669::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:03:01,669::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`da729382-35a3-487a-82f5-7f6831433499`::Granted request >Thread-7083::DEBUG::2014-07-08 17:03:01,670::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f22f3694-a1a6-4dcf-8f11-a632b9994001`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:03:01,670::task::993::Storage.TaskManager.Task::(_decref) Task=`f22f3694-a1a6-4dcf-8f11-a632b9994001`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:03:01,689::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:01,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`f22f3694-a1a6-4dcf-8f11-a632b9994001`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:01,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`f22f3694-a1a6-4dcf-8f11-a632b9994001`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:03:01,690::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:03:01,690::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:03:01,691::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:03:01,691::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:03:01,691::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:03:01,692::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:03:01,692::task::993::Storage.TaskManager.Task::(_decref) Task=`f22f3694-a1a6-4dcf-8f11-a632b9994001`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:03:01,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:02,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017435 s, 58.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:03:02,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`98def4f9-1b3f-41ea-8ae8-1bed8bc2624b`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:03:02,732::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:03:02,733::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511783', 'lastCheck': '4.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:03:02,733::task::1191::Storage.TaskManager.Task::(prepare) Task=`98def4f9-1b3f-41ea-8ae8-1bed8bc2624b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511783', 'lastCheck': '4.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:03:02,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`98def4f9-1b3f-41ea-8ae8-1bed8bc2624b`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:03:02,734::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:03:02,734::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:03:02,734::task::993::Storage.TaskManager.Task::(_decref) Task=`98def4f9-1b3f-41ea-8ae8-1bed8bc2624b`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:03:02,767::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:03:04,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:04,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422224 s, 24.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:05,659::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:05,660::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:05,661::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:03:06,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:06,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171311 s, 59.8 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:03:07,744::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:03:07,744::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:03:08,016::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:08,016::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:08,017::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:08,017::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:08,017::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:08,017::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:08,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:08,018::__init__::225::IOProcess::(_processLogs) (274085) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:08,018::__init__::225::IOProcess::(_processLogs) (274085) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:08,018::__init__::225::IOProcess::(_processLogs) (274085) Building response >Thread-18::DEBUG::2014-07-08 17:03:08,018::__init__::225::IOProcess::(_processLogs) (274085) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:08,019::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:08,019::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:03:08,021::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:03:08,171::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000697278 s, 663 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:03:08,176::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:08,178::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:08,180::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:08,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:08,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:08,184::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:08,185::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:08,187::__init__::225::IOProcess::(_processLogs) (274086) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:08,188::__init__::225::IOProcess::(_processLogs) (274086) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:08,190::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274086) Building response >Thread-18::DEBUG::2014-07-08 17:03:08,191::__init__::225::IOProcess::(_processLogs) (274086) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:08,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:08,194::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:03:08,201::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:08,203::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:03:08,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:08,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:08,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:08,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:08,210::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:08,211::__init__::225::IOProcess::(_processLogs) (274087) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:08,212::__init__::225::IOProcess::(_processLogs) (274087) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:08,213::__init__::225::IOProcess::(_processLogs) (274087) Building response >Thread-18::DEBUG::2014-07-08 17:03:08,214::__init__::225::IOProcess::(_processLogs) (274087) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:08,216::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:08,217::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:08,222::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:08,224::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:03:08,225::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:08,227::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:08,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:08,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:08,231::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:08,233::__init__::225::IOProcess::(_processLogs) (274088) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:08,234::__init__::225::IOProcess::(_processLogs) (274088) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:08,235::__init__::225::IOProcess::(_processLogs) (274088) Building response >Thread-18::DEBUG::2014-07-08 17:03:08,237::__init__::225::IOProcess::(_processLogs) (274088) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:08,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:08,240::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:08,244::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:08,246::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:03:08,248::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:08,249::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:08,251::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:08,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:08,253::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:08,255::__init__::225::IOProcess::(_processLogs) (274089) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:08,256::__init__::225::IOProcess::(_processLogs) (274089) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:08,257::__init__::225::IOProcess::(_processLogs) (274089) Building response >Thread-18::DEBUG::2014-07-08 17:03:08,259::__init__::225::IOProcess::(_processLogs) (274089) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:08,260::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:08,261::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:03:12,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:12,024::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:03:12,110::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:03:12,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b046f68-6a14-4cff-8814-678031c128d5`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:03:12,414::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:12,429::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::INFO::2014-07-08 17:03:12,442::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:12,449::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b046f68-6a14-4cff-8814-678031c128d5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:12,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b046f68-6a14-4cff-8814-678031c128d5`::moving from state preparing -> state finished >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:12,459::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:03:12,462::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:03:12,472::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:03:12,479::task::993::Storage.TaskManager.Task::(_decref) Task=`5b046f68-6a14-4cff-8814-678031c128d5`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:03:12,524::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:03:12,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1185b4f-dfe7-498b-9ba3-32cbe7beb33a`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:03:12,543::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Dummy-6860::DEBUG::2014-07-08 17:03:12,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.270089 s, 3.8 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:03:12,623::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fd13a7a7-af8f-4e7c-b430-1179de551e8d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:03:12,626::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:03:12,630::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:03:12,631::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fd13a7a7-af8f-4e7c-b430-1179de551e8d`::Granted request >Thread-7083::DEBUG::2014-07-08 17:03:12,637::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c1185b4f-dfe7-498b-9ba3-32cbe7beb33a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:03:12,640::task::993::Storage.TaskManager.Task::(_decref) Task=`c1185b4f-dfe7-498b-9ba3-32cbe7beb33a`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:03:12,687::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:12,689::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1185b4f-dfe7-498b-9ba3-32cbe7beb33a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:12,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1185b4f-dfe7-498b-9ba3-32cbe7beb33a`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:03:12,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:03:12,693::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:03:12,695::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:03:12,697::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:03:12,698::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:03:12,699::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:03:12,701::task::993::Storage.TaskManager.Task::(_decref) Task=`c1185b4f-dfe7-498b-9ba3-32cbe7beb33a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:03:14,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:15,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018272 s, 56.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:03:17,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:17,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173093 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:17,561::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:17,564::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:17,565::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:03:18,267::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:18,268::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:18,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:18,268::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:18,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:18,269::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:18,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:18,269::__init__::225::IOProcess::(_processLogs) (274090) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:18,269::__init__::225::IOProcess::(_processLogs) (274090) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:18,270::__init__::225::IOProcess::(_processLogs) (274090) Building response >Thread-18::DEBUG::2014-07-08 17:03:18,270::__init__::225::IOProcess::(_processLogs) (274090) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:18,270::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:18,270::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:03:18,272::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:03:18,419::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000476864 s, 969 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:03:18,421::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:18,421::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:18,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:18,422::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:18,422::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:18,422::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:18,423::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:18,423::__init__::225::IOProcess::(_processLogs) (274091) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:18,423::__init__::225::IOProcess::(_processLogs) (274091) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:18,424::__init__::225::IOProcess::(_processLogs) DEBUG|(274091) Building response >Thread-18::DEBUG::2014-07-08 17:03:18,424::__init__::225::IOProcess::(_processLogs) (274091) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:18,424::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:03:18,425::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:03:18,427::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:18,427::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:03:18,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:18,428::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:18,428::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:18,428::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:18,429::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:18,429::__init__::225::IOProcess::(_processLogs) (274092) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:18,429::__init__::225::IOProcess::(_processLogs) (274092) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:18,429::__init__::225::IOProcess::(_processLogs) DEBUG|(274092) Building response >Thread-18::DEBUG::2014-07-08 17:03:18,430::__init__::225::IOProcess::(_processLogs) (274092) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:18,430::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:03:18,430::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:18,431::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:18,432::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:03:18,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:18,432::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:18,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:18,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:18,433::__init__::225::IOProcess::(_processLogs) (274093) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:18,434::__init__::225::IOProcess::(_processLogs) (274093) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:18,434::__init__::225::IOProcess::(_processLogs) (274093) Building response >Thread-18::DEBUG::2014-07-08 17:03:18,434::__init__::225::IOProcess::(_processLogs) (274093) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:18,434::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:18,436::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:03:18,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:18,436::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:18,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:18,437::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:18,437::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:18,437::__init__::225::IOProcess::(_processLogs) (274094) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:18,438::__init__::225::IOProcess::(_processLogs) (274094) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:18,438::__init__::225::IOProcess::(_processLogs) DEBUG|(274094) Building response >Thread-18::DEBUG::2014-07-08 17:03:18,438::__init__::225::IOProcess::(_processLogs) (274094) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:18,438::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:18,439::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:03:19,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:19,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172786 s, 59.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:03:20,999::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7087::DEBUG::2014-07-08 17:03:21,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`3106354a-347d-4156-8758-53b60ed5139b`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:03:21,471::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:03:21,472::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476864', 'lastCheck': '3.0', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:03:21,472::task::1191::Storage.TaskManager.Task::(prepare) Task=`3106354a-347d-4156-8758-53b60ed5139b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476864', 'lastCheck': '3.0', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:03:21,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`3106354a-347d-4156-8758-53b60ed5139b`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:03:21,473::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:03:21,473::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:03:21,473::task::993::Storage.TaskManager.Task::(_decref) Task=`3106354a-347d-4156-8758-53b60ed5139b`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:03:21,505::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:03:21,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:21,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176202 s, 58.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:22,571::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:22,573::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:22,574::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:03:22,722::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:03:22,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a3b4d3c-4a52-41f7-a4b0-0e64a1a67a8f`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:03:22,725::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:03:22,741::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:22,742::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a3b4d3c-4a52-41f7-a4b0-0e64a1a67a8f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:22,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a3b4d3c-4a52-41f7-a4b0-0e64a1a67a8f`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:03:22,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:03:22,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:03:22,743::task::993::Storage.TaskManager.Task::(_decref) Task=`2a3b4d3c-4a52-41f7-a4b0-0e64a1a67a8f`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:03:22,754::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:03:22,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccf9e24e-b61e-4792-b928-0833cde1ea60`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:03:22,756::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:03:22,756::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`966946fb-bbbe-499c-83e1-26468653fa1d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:03:22,757::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:03:22,757::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:03:22,758::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`966946fb-bbbe-499c-83e1-26468653fa1d`::Granted request >Thread-7083::DEBUG::2014-07-08 17:03:22,758::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ccf9e24e-b61e-4792-b928-0833cde1ea60`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:03:22,758::task::993::Storage.TaskManager.Task::(_decref) Task=`ccf9e24e-b61e-4792-b928-0833cde1ea60`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:03:22,777::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:22,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`ccf9e24e-b61e-4792-b928-0833cde1ea60`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:22,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccf9e24e-b61e-4792-b928-0833cde1ea60`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:03:22,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:03:22,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:03:22,779::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:03:22,779::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:03:22,780::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:03:22,780::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:03:22,780::task::993::Storage.TaskManager.Task::(_decref) Task=`ccf9e24e-b61e-4792-b928-0833cde1ea60`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:03:23,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:24,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0183304 s, 55.9 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:03:26,077::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:03:26,077::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:03:26,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:26,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174202 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:27,581::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:27,582::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:27,584::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:03:28,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:03:28,604::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:28,604::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:28,605::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:28,607::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:28,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:28,610::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:28,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:28,613::__init__::225::IOProcess::(_processLogs) (274095) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:28,615::__init__::225::IOProcess::(_processLogs) (274095) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:28,616::__init__::225::IOProcess::(_processLogs) (274095) Building response >Thread-18::DEBUG::2014-07-08 17:03:28,618::__init__::225::IOProcess::(_processLogs) (274095) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:28,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:28,620::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:03:28,627::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:28,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.187272 s, 5.5 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 17:03:28,853::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000593914 s, 778 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:03:28,858::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:28,861::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:28,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:28,865::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:28,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:28,869::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:28,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:28,874::__init__::225::IOProcess::(_processLogs) (274096) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:28,877::__init__::225::IOProcess::(_processLogs) (274096) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:28,879::__init__::225::IOProcess::(_processLogs) (274096) Building response >Thread-18::DEBUG::2014-07-08 17:03:28,881::__init__::225::IOProcess::(_processLogs) (274096) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:28,884::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:28,887::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:03:28,903::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:28,905::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:03:28,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:28,911::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:28,913::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:28,914::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:28,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:28,916::__init__::225::IOProcess::(_processLogs) (274097) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:28,917::__init__::225::IOProcess::(_processLogs) (274097) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:28,918::__init__::225::IOProcess::(_processLogs) (274097) Building response >Thread-18::DEBUG::2014-07-08 17:03:28,919::__init__::225::IOProcess::(_processLogs) (274097) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:28,919::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:28,920::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:28,925::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:28,926::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:03:28,927::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:28,928::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:28,929::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:28,930::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:28,931::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:28,932::__init__::225::IOProcess::(_processLogs) (274098) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:28,933::__init__::225::IOProcess::(_processLogs) (274098) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:28,935::__init__::225::IOProcess::(_processLogs) DEBUG|(274098) Building response >Thread-18::DEBUG::2014-07-08 17:03:28,936::__init__::225::IOProcess::(_processLogs) (274098) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:28,937::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:28,938::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:28,942::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:28,943::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:03:28,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:28,945::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:28,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:28,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:28,949::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:28,949::__init__::225::IOProcess::(_processLogs) (274099) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:28,950::__init__::225::IOProcess::(_processLogs) (274099) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:28,951::__init__::225::IOProcess::(_processLogs) (274099) Building response >Thread-18::DEBUG::2014-07-08 17:03:28,952::__init__::225::IOProcess::(_processLogs) (274099) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:28,953::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:28,954::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:03:30,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:31,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172481 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:32,587::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:32,589::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:32,590::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:03:32,794::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:03:32,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`38810972-83e9-4502-a795-f67d164a3d67`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:03:32,796::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:03:32,811::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:32,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`38810972-83e9-4502-a795-f67d164a3d67`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:32,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`38810972-83e9-4502-a795-f67d164a3d67`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:03:32,812::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:03:32,812::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:03:32,812::task::993::Storage.TaskManager.Task::(_decref) Task=`38810972-83e9-4502-a795-f67d164a3d67`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:03:32,827::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:03:32,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`60814c05-c0df-47ce-a04f-d4dadf858dcd`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:03:32,828::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:03:32,829::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0ba613b2-5e92-4209-b1d9-2794a6a43aef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:03:32,829::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:03:32,830::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:03:32,830::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0ba613b2-5e92-4209-b1d9-2794a6a43aef`::Granted request >Thread-7083::DEBUG::2014-07-08 17:03:32,831::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`60814c05-c0df-47ce-a04f-d4dadf858dcd`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:03:32,831::task::993::Storage.TaskManager.Task::(_decref) Task=`60814c05-c0df-47ce-a04f-d4dadf858dcd`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:03:32,850::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:32,850::task::1191::Storage.TaskManager.Task::(prepare) Task=`60814c05-c0df-47ce-a04f-d4dadf858dcd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:32,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`60814c05-c0df-47ce-a04f-d4dadf858dcd`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:03:32,851::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:03:32,851::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:03:32,852::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:03:32,852::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:03:32,852::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:03:32,853::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:03:32,853::task::993::Storage.TaskManager.Task::(_decref) Task=`60814c05-c0df-47ce-a04f-d4dadf858dcd`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:03:33,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:33,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177624 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:03:35,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:35,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171344 s, 59.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:03:36,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`50b5f458-6bf4-4eda-8701-6b468e73a3ef`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:03:36,720::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:03:36,721::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593914', 'lastCheck': '7.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:03:36,721::task::1191::Storage.TaskManager.Task::(prepare) Task=`50b5f458-6bf4-4eda-8701-6b468e73a3ef`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593914', 'lastCheck': '7.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:03:36,721::task::595::Storage.TaskManager.Task::(_updateState) Task=`50b5f458-6bf4-4eda-8701-6b468e73a3ef`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:03:36,721::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:03:36,722::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:03:36,722::task::993::Storage.TaskManager.Task::(_decref) Task=`50b5f458-6bf4-4eda-8701-6b468e73a3ef`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:03:36,753::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:37,597::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:37,598::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:37,599::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:03:37,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:38,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171596 s, 59.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:03:39,050::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:39,068::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:39,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:39,072::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:39,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:39,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:39,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:39,081::__init__::225::IOProcess::(_processLogs) (274100) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:39,083::__init__::225::IOProcess::(_processLogs) (274100) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:39,085::__init__::225::IOProcess::(_processLogs) (274100) Building response >Thread-18::DEBUG::2014-07-08 17:03:39,087::__init__::225::IOProcess::(_processLogs) (274100) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:39,087::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:39,088::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:03:39,095::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:03:39,338::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000445856 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:03:39,358::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:39,360::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:39,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:39,362::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:39,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:39,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:39,366::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:39,371::__init__::225::IOProcess::(_processLogs) (274101) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:39,372::__init__::225::IOProcess::(_processLogs) (274101) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:39,374::__init__::225::IOProcess::(_processLogs) (274101) Building response >Thread-18::DEBUG::2014-07-08 17:03:39,375::__init__::225::IOProcess::(_processLogs) (274101) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:39,376::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:39,377::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:03:39,387::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:39,388::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:03:39,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:39,388::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:39,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:39,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:39,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:39,392::__init__::225::IOProcess::(_processLogs) (274102) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:39,393::__init__::225::IOProcess::(_processLogs) (274102) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:39,393::__init__::225::IOProcess::(_processLogs) (274102) Building response >Thread-18::DEBUG::2014-07-08 17:03:39,393::__init__::225::IOProcess::(_processLogs) (274102) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:39,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:39,394::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:39,395::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:39,396::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:03:39,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:39,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:39,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:39,397::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:39,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:39,397::__init__::225::IOProcess::(_processLogs) (274103) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:39,398::__init__::225::IOProcess::(_processLogs) (274103) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:39,398::__init__::225::IOProcess::(_processLogs) (274103) Building response >Thread-18::DEBUG::2014-07-08 17:03:39,398::__init__::225::IOProcess::(_processLogs) (274103) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:39,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:39,398::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:39,400::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:39,400::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:03:39,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:39,400::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:39,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:39,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:39,401::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:39,401::__init__::225::IOProcess::(_processLogs) (274104) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:39,402::__init__::225::IOProcess::(_processLogs) (274104) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:39,402::__init__::225::IOProcess::(_processLogs) (274104) Building response >Thread-18::DEBUG::2014-07-08 17:03:39,402::__init__::225::IOProcess::(_processLogs) (274104) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:39,402::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:39,403::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:03:40,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:40,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173255 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:03:41,213::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:03:41,213::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:03:42,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:42,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175604 s, 58.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:42,607::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:42,608::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:42,609::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:03:42,888::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:03:42,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`261e6b76-a791-4e5a-a765-766421844832`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:03:42,890::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:03:42,904::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:42,905::task::1191::Storage.TaskManager.Task::(prepare) Task=`261e6b76-a791-4e5a-a765-766421844832`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:42,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`261e6b76-a791-4e5a-a765-766421844832`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:03:42,905::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:03:42,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:03:42,906::task::993::Storage.TaskManager.Task::(_decref) Task=`261e6b76-a791-4e5a-a765-766421844832`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:03:42,960::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:03:42,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`56f6674a-5956-4895-9a4f-ea43575c77d0`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:03:42,961::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:03:42,962::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55f2a5af-63ad-4abb-b6d0-7b3e906da14f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:03:42,962::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:03:42,963::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:03:42,963::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55f2a5af-63ad-4abb-b6d0-7b3e906da14f`::Granted request >Thread-7083::DEBUG::2014-07-08 17:03:42,964::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`56f6674a-5956-4895-9a4f-ea43575c77d0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:03:42,964::task::993::Storage.TaskManager.Task::(_decref) Task=`56f6674a-5956-4895-9a4f-ea43575c77d0`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:03:42,983::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:42,984::task::1191::Storage.TaskManager.Task::(prepare) Task=`56f6674a-5956-4895-9a4f-ea43575c77d0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:42,984::task::595::Storage.TaskManager.Task::(_updateState) Task=`56f6674a-5956-4895-9a4f-ea43575c77d0`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:03:42,984::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:03:42,984::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:03:42,985::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:03:42,985::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:03:42,985::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:03:42,986::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:03:42,986::task::993::Storage.TaskManager.Task::(_decref) Task=`56f6674a-5956-4895-9a4f-ea43575c77d0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:03:44,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:44,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902125 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:03:46,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:47,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173844 s, 58.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:47,617::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:47,618::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:47,619::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:03:49,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:03:49,409::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:49,411::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:49,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:49,414::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:49,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:49,416::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:49,417::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:49,418::__init__::225::IOProcess::(_processLogs) (274105) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:49,420::__init__::225::IOProcess::(_processLogs) (274105) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:49,421::__init__::225::IOProcess::(_processLogs) DEBUG|(274105) Building response >Thread-18::DEBUG::2014-07-08 17:03:49,422::__init__::225::IOProcess::(_processLogs) (274105) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:49,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:49,425::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:03:49,431::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:03:49,583::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000596987 s, 774 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:03:49,657::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Dummy-6860::DEBUG::2014-07-08 17:03:49,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.184564 s, 5.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:03:49,663::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:49,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:49,670::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:49,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:49,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:49,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:49,685::__init__::225::IOProcess::(_processLogs) (274106) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:49,689::__init__::225::IOProcess::(_processLogs) (274106) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:49,692::__init__::225::IOProcess::(_processLogs) (274106) Building response >Thread-18::DEBUG::2014-07-08 17:03:49,696::__init__::225::IOProcess::(_processLogs) (274106) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:49,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:49,702::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:03:49,722::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:49,726::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:03:49,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:49,729::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:49,730::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:49,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:49,732::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:49,733::__init__::225::IOProcess::(_processLogs) (274107) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:49,735::__init__::225::IOProcess::(_processLogs) (274107) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:49,736::__init__::225::IOProcess::(_processLogs) (274107) Building response >Thread-18::DEBUG::2014-07-08 17:03:49,737::__init__::225::IOProcess::(_processLogs) (274107) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:49,738::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:49,739::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:49,743::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:49,744::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:03:49,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:49,747::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:49,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:49,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:49,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:49,752::__init__::225::IOProcess::(_processLogs) (274108) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:49,753::__init__::225::IOProcess::(_processLogs) (274108) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:49,755::__init__::225::IOProcess::(_processLogs) (274108) Building response >Thread-18::DEBUG::2014-07-08 17:03:49,756::__init__::225::IOProcess::(_processLogs) (274108) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:49,757::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:49,758::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:49,763::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:49,763::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:03:49,765::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:49,766::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:49,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:49,768::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:49,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:49,771::__init__::225::IOProcess::(_processLogs) (274109) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:49,772::__init__::225::IOProcess::(_processLogs) (274109) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:49,773::__init__::225::IOProcess::(_processLogs) (274109) Building response >Thread-18::DEBUG::2014-07-08 17:03:49,774::__init__::225::IOProcess::(_processLogs) (274109) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:49,775::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:49,776::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >VM Channels Listener::DEBUG::2014-07-08 17:03:51,394::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:03:51,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:03:51,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e3d5463-c046-4fe4-b8dd-dd07803094c7`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:03:51,956::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:03:51,956::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596987', 'lastCheck': '2.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:03:51,957::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e3d5463-c046-4fe4-b8dd-dd07803094c7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596987', 'lastCheck': '2.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:03:51,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e3d5463-c046-4fe4-b8dd-dd07803094c7`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:03:51,957::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:03:51,957::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:03:51,958::task::993::Storage.TaskManager.Task::(_decref) Task=`0e3d5463-c046-4fe4-b8dd-dd07803094c7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:03:52,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338926 s, 30.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:03:52,054::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:52,625::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:52,626::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:52,627::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:03:53,001::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [30742acc] >Thread-7087::DEBUG::2014-07-08 17:03:53,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7f31bf0-c04b-4da2-a97a-3c3d59e9816a`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:03:53,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:03:53,017::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:53,017::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7f31bf0-c04b-4da2-a97a-3c3d59e9816a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:03:53,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7f31bf0-c04b-4da2-a97a-3c3d59e9816a`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:03:53,018::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:03:53,018::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:03:53,018::task::993::Storage.TaskManager.Task::(_decref) Task=`d7f31bf0-c04b-4da2-a97a-3c3d59e9816a`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:03:53,030::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [30742acc] >Thread-7083::DEBUG::2014-07-08 17:03:53,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`9510bde4-603d-4f34-8102-6292837a17d7`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:03:53,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:03:53,032::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`efaf2763-0b94-4a23-a6ea-2a2118d77cd3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:03:53,032::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:03:53,033::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:03:53,033::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`efaf2763-0b94-4a23-a6ea-2a2118d77cd3`::Granted request >Thread-7083::DEBUG::2014-07-08 17:03:53,038::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9510bde4-603d-4f34-8102-6292837a17d7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:03:53,038::task::993::Storage.TaskManager.Task::(_decref) Task=`9510bde4-603d-4f34-8102-6292837a17d7`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:03:53,057::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:53,057::task::1191::Storage.TaskManager.Task::(prepare) Task=`9510bde4-603d-4f34-8102-6292837a17d7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:03:53,057::task::595::Storage.TaskManager.Task::(_updateState) Task=`9510bde4-603d-4f34-8102-6292837a17d7`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:03:53,058::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:03:53,058::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:03:53,058::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:03:53,059::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:03:53,059::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:03:53,059::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:03:53,060::task::993::Storage.TaskManager.Task::(_decref) Task=`9510bde4-603d-4f34-8102-6292837a17d7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:03:54,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:54,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0232683 s, 44.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:03:56,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`0862c30e-f52c-43c0-aa8f-5852bb974341`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:03:56,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:03:56,253::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:56,254::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:03:56,254::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:56,254::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:56,255::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:56,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:56,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:56,256::__init__::225::IOProcess::(_processLogs) (274110) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:03:56,256::__init__::225::IOProcess::(_processLogs) (274110) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:03:56,256::__init__::225::IOProcess::(_processLogs) (274110) Building response >Thread-18::DEBUG::2014-07-08 17:03:56,256::__init__::225::IOProcess::(_processLogs) (274110) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:56,257::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:56,257::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:03:56,259::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:03:56,259::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:03:56,259::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:56,259::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:56,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:56,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:56,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:56,260::__init__::225::IOProcess::(_processLogs) (274111) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:03:56,261::__init__::225::IOProcess::(_processLogs) (274111) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:03:56,261::__init__::225::IOProcess::(_processLogs) (274111) Building response >Thread-18::DEBUG::2014-07-08 17:03:56,261::__init__::225::IOProcess::(_processLogs) (274111) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:56,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:56,262::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:03:56,263::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:03:56,263::task::1191::Storage.TaskManager.Task::(prepare) Task=`0862c30e-f52c-43c0-aa8f-5852bb974341`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:03:56,264::task::595::Storage.TaskManager.Task::(_updateState) Task=`0862c30e-f52c-43c0-aa8f-5852bb974341`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:03:56,264::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:03:56,264::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:03:56,264::task::993::Storage.TaskManager.Task::(_decref) Task=`0862c30e-f52c-43c0-aa8f-5852bb974341`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:03:56,345::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:03:56,345::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:03:56,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:56,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174554 s, 58.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:57,635::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:57,636::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:03:57,637::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:03:58,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:03:58,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173233 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:03:59,782::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:59,782::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:59,782::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:59,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:59,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:59,783::__init__::225::IOProcess::(_processLogs) (274112) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:59,783::__init__::225::IOProcess::(_processLogs) (274112) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:59,784::__init__::225::IOProcess::(_processLogs) (274112) Building response >Thread-18::DEBUG::2014-07-08 17:03:59,784::__init__::225::IOProcess::(_processLogs) (274112) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:59,784::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:59,784::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:03:59,786::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:03:59,942::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00364367 s, 127 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:03:59,948::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:03:59,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:59,952::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:59,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:59,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:59,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:59,957::__init__::225::IOProcess::(_processLogs) (274113) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:03:59,958::__init__::225::IOProcess::(_processLogs) (274113) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:03:59,959::__init__::225::IOProcess::(_processLogs) (274113) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:59,960::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:59,961::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:03:59,969::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:03:59,971::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:03:59,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:59,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:59,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:59,977::__init__::225::IOProcess::(_processLogs) (274114) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:59,978::__init__::225::IOProcess::(_processLogs) (274114) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:59,979::__init__::225::IOProcess::(_processLogs) (274114) Building response >Thread-18::DEBUG::2014-07-08 17:03:59,980::__init__::225::IOProcess::(_processLogs) (274114) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:59,981::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:59,982::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:59,987::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:03:59,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:59,987::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:59,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:59,988::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:59,988::__init__::225::IOProcess::(_processLogs) (274115) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:59,988::__init__::225::IOProcess::(_processLogs) (274115) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:59,989::__init__::225::IOProcess::(_processLogs) (274115) Building response >Thread-18::DEBUG::2014-07-08 17:03:59,989::__init__::225::IOProcess::(_processLogs) (274115) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:59,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:59,989::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:03:59,990::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:03:59,991::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:03:59,991::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:03:59,991::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:03:59,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:03:59,992::__init__::225::IOProcess::(_processLogs) (274116) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:03:59,992::__init__::225::IOProcess::(_processLogs) (274116) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:03:59,992::__init__::225::IOProcess::(_processLogs) (274116) Building response >Thread-18::DEBUG::2014-07-08 17:03:59,992::__init__::225::IOProcess::(_processLogs) (274116) Queuing response >Thread-18::DEBUG::2014-07-08 17:03:59,993::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:03:59,993::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:04:00,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:01,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174783 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:02,639::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:02,641::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:02,642::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:04:03,073::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:04:03,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ec77913-1598-4660-96ff-b31bfd8eacb7`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:04:03,075::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:04:03,089::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:04:03,090::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ec77913-1598-4660-96ff-b31bfd8eacb7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:04:03,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ec77913-1598-4660-96ff-b31bfd8eacb7`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:04:03,090::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:04:03,091::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:04:03,091::task::993::Storage.TaskManager.Task::(_decref) Task=`9ec77913-1598-4660-96ff-b31bfd8eacb7`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:04:03,124::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:04:03,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1bedad1-db84-4fda-861f-0ab8f2830c99`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:04:03,125::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:04:03,126::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fd1206b3-2f14-487f-bf76-55892f064857`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:04:03,127::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:04:03,127::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:04:03,127::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fd1206b3-2f14-487f-bf76-55892f064857`::Granted request >Thread-7083::DEBUG::2014-07-08 17:04:03,128::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b1bedad1-db84-4fda-861f-0ab8f2830c99`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:04:03,128::task::993::Storage.TaskManager.Task::(_decref) Task=`b1bedad1-db84-4fda-861f-0ab8f2830c99`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:04:03,147::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:03,148::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1bedad1-db84-4fda-861f-0ab8f2830c99`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:03,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1bedad1-db84-4fda-861f-0ab8f2830c99`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:04:03,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:04:03,149::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:04:03,149::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:04:03,149::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:04:03,150::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:04:03,150::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:04:03,150::task::993::Storage.TaskManager.Task::(_decref) Task=`b1bedad1-db84-4fda-861f-0ab8f2830c99`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:04:03,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:03,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477643 s, 21.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:04:05,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:05,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176093 s, 58.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:04:07,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d306459-8467-44ea-bc98-fda608f29f13`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:04:07,180::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:04:07,181::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00364367', 'lastCheck': '7.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:04:07,181::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d306459-8467-44ea-bc98-fda608f29f13`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00364367', 'lastCheck': '7.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:04:07,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d306459-8467-44ea-bc98-fda608f29f13`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:04:07,182::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:04:07,182::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:04:07,182::task::993::Storage.TaskManager.Task::(_decref) Task=`2d306459-8467-44ea-bc98-fda608f29f13`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:04:07,212::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:07,649::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:07,650::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:07,651::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:04:07,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:08,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339778 s, 30.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:09,996::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:09,996::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:09,997::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:09,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:09,997::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:09,997::__init__::225::IOProcess::(_processLogs) (274117) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:09,997::__init__::225::IOProcess::(_processLogs) (274117) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:09,998::__init__::225::IOProcess::(_processLogs) (274117) Building response >Thread-18::DEBUG::2014-07-08 17:04:09,998::__init__::225::IOProcess::(_processLogs) (274117) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:09,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-37::DEBUG::2014-07-08 17:04:10,000::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:04:10,156::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000477701 s, 967 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:10,169::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:10,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:10,171::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:10,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:10,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:10,175::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:10,176::__init__::225::IOProcess::(_processLogs) (274118) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:10,178::__init__::225::IOProcess::(_processLogs) (274118) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:10,179::__init__::225::IOProcess::(_processLogs) (274118) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:10,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:10,181::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:04:10,190::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:04:10,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:10,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:10,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:10,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:10,192::__init__::225::IOProcess::(_processLogs) (274119) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:10,192::__init__::225::IOProcess::(_processLogs) (274119) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:10,193::__init__::225::IOProcess::(_processLogs) (274119) Building response >Thread-18::DEBUG::2014-07-08 17:04:10,193::__init__::225::IOProcess::(_processLogs) (274119) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:10,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:10,194::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:10,196::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:04:10,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:10,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:10,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:10,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:10,197::__init__::225::IOProcess::(_processLogs) (274120) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:10,198::__init__::225::IOProcess::(_processLogs) (274120) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:10,198::__init__::225::IOProcess::(_processLogs) (274120) Building response >Thread-18::DEBUG::2014-07-08 17:04:10,198::__init__::225::IOProcess::(_processLogs) (274120) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:10,198::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:10,199::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:10,200::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:04:10,200::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:10,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:10,201::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:10,201::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 17:04:10,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:04:10,202::__init__::225::IOProcess::(_processLogs) (274121) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:10,363::__init__::225::IOProcess::(_processLogs) (274121) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:10,364::__init__::225::IOProcess::(_processLogs) (274121) Building response >Thread-18::DEBUG::2014-07-08 17:04:10,364::__init__::225::IOProcess::(_processLogs) (274121) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:10,365::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:10,368::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:04:10,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0208208 s, 49.2 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:04:11,389::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:04:11,389::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:04:12,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:12,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171607 s, 59.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:12,711::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:12,717::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:12,721::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:04:13,166::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:04:13,167::task::595::Storage.TaskManager.Task::(_updateState) Task=`df5a0c22-93a0-4dbc-a8d7-949ef166e215`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:04:13,167::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:04:13,186::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:04:13,187::task::1191::Storage.TaskManager.Task::(prepare) Task=`df5a0c22-93a0-4dbc-a8d7-949ef166e215`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:04:13,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`df5a0c22-93a0-4dbc-a8d7-949ef166e215`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:04:13,187::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:04:13,187::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:04:13,188::task::993::Storage.TaskManager.Task::(_decref) Task=`df5a0c22-93a0-4dbc-a8d7-949ef166e215`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:04:13,199::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:04:13,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac0b22bf-a365-4f03-ad28-6036ffb3e4b6`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:04:13,201::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:04:13,202::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`aa8997ff-fde7-4e43-b79b-7b1626ae0046`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:04:13,202::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:04:13,202::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:04:13,203::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`aa8997ff-fde7-4e43-b79b-7b1626ae0046`::Granted request >Thread-7083::DEBUG::2014-07-08 17:04:13,203::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac0b22bf-a365-4f03-ad28-6036ffb3e4b6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:04:13,204::task::993::Storage.TaskManager.Task::(_decref) Task=`ac0b22bf-a365-4f03-ad28-6036ffb3e4b6`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:04:13,222::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:13,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac0b22bf-a365-4f03-ad28-6036ffb3e4b6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:13,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac0b22bf-a365-4f03-ad28-6036ffb3e4b6`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:04:13,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:04:13,224::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:04:13,224::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:04:13,224::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:04:13,225::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:04:13,225::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:04:13,225::task::993::Storage.TaskManager.Task::(_decref) Task=`ac0b22bf-a365-4f03-ad28-6036ffb3e4b6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:04:14,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:14,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171473 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:04:17,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:17,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174733 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:17,730::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:17,732::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:17,733::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:04:19,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:19,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175177 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:20,375::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:20,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:20,376::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:20,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:20,376::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:20,377::__init__::225::IOProcess::(_processLogs) (274122) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:20,377::__init__::225::IOProcess::(_processLogs) (274122) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:20,377::__init__::225::IOProcess::(_processLogs) (274122) Building response >Thread-18::DEBUG::2014-07-08 17:04:20,377::__init__::225::IOProcess::(_processLogs) (274122) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:20,378::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:20,378::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:04:20,379::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:04:20,528::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000468204 s, 987 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:20,530::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:20,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:20,531::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:20,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:20,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:20,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:20,532::__init__::225::IOProcess::(_processLogs) (274123) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:20,532::__init__::225::IOProcess::(_processLogs) (274123) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:20,533::__init__::225::IOProcess::(_processLogs) (274123) Building response >Thread-18::DEBUG::2014-07-08 17:04:20,533::__init__::225::IOProcess::(_processLogs) (274123) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:20,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:20,533::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:04:20,536::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:20,536::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:04:20,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:20,536::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:20,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:20,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:20,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:20,537::__init__::225::IOProcess::(_processLogs) (274124) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:20,538::__init__::225::IOProcess::(_processLogs) (274124) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:20,538::__init__::225::IOProcess::(_processLogs) (274124) Building response >Thread-18::DEBUG::2014-07-08 17:04:20,538::__init__::225::IOProcess::(_processLogs) (274124) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:20,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:20,539::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:20,540::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:20,540::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:04:20,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:20,541::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:20,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:20,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:20,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:20,542::__init__::225::IOProcess::(_processLogs) (274125) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:20,542::__init__::225::IOProcess::(_processLogs) (274125) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:20,542::__init__::225::IOProcess::(_processLogs) (274125) Building response >Thread-18::DEBUG::2014-07-08 17:04:20,542::__init__::225::IOProcess::(_processLogs) (274125) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:20,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:20,543::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:20,544::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:20,544::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:04:20,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:20,545::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:20,545::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:20,545::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:20,545::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:20,546::__init__::225::IOProcess::(_processLogs) (274126) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:20,546::__init__::225::IOProcess::(_processLogs) (274126) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:20,546::__init__::225::IOProcess::(_processLogs) (274126) Building response >Thread-18::DEBUG::2014-07-08 17:04:20,546::__init__::225::IOProcess::(_processLogs) (274126) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:20,547::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:20,547::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:04:21,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-07-08 17:04:21,704::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:04:21,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0213483 s, 48.0 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:04:22,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe97fe3e-660c-425a-9a65-b5038b50840d`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:04:22,467::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:04:22,474::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468204', 'lastCheck': '1.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:04:22,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe97fe3e-660c-425a-9a65-b5038b50840d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468204', 'lastCheck': '1.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:04:22,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe97fe3e-660c-425a-9a65-b5038b50840d`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:04:22,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:04:22,475::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:04:22,475::task::993::Storage.TaskManager.Task::(_decref) Task=`fe97fe3e-660c-425a-9a65-b5038b50840d`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:04:22,507::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:22,740::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:22,741::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:22,742::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:04:23,127::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [1798daa9] >Thread-7087::DEBUG::2014-07-08 17:04:23,129::vm::3329::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug NIC xml: <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > <mac address="00:1a:4a:16:88:5c"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Thread-7082::DEBUG::2014-07-08 17:04:23,239::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:04:23,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f1cebc4-5ac0-40fe-b2ab-4fc6d179dee3`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:04:23,240::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:04:23,257::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:04:23,258::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f1cebc4-5ac0-40fe-b2ab-4fc6d179dee3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:04:23,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f1cebc4-5ac0-40fe-b2ab-4fc6d179dee3`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:04:23,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:04:23,259::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:04:23,259::task::993::Storage.TaskManager.Task::(_decref) Task=`7f1cebc4-5ac0-40fe-b2ab-4fc6d179dee3`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:04:23,272::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:04:23,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`92ff76fd-980f-4dff-ad0f-eb789780519f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:04:23,274::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:04:23,275::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`01cdfdfc-cf35-41a7-af21-4cc21ecc9689`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:04:23,275::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:04:23,275::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:04:23,276::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`01cdfdfc-cf35-41a7-af21-4cc21ecc9689`::Granted request >Thread-7083::DEBUG::2014-07-08 17:04:23,276::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`92ff76fd-980f-4dff-ad0f-eb789780519f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:04:23,277::task::993::Storage.TaskManager.Task::(_decref) Task=`92ff76fd-980f-4dff-ad0f-eb789780519f`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:04:23,298::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:23,298::task::1191::Storage.TaskManager.Task::(prepare) Task=`92ff76fd-980f-4dff-ad0f-eb789780519f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:23,298::task::595::Storage.TaskManager.Task::(_updateState) Task=`92ff76fd-980f-4dff-ad0f-eb789780519f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:04:23,299::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:04:23,299::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:04:23,299::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:04:23,300::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:04:23,300::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:04:23,300::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:04:23,301::task::993::Storage.TaskManager.Task::(_decref) Task=`92ff76fd-980f-4dff-ad0f-eb789780519f`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:04:23,812::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 1 edom: 0 level: 2 message: An error occurred, but the cause is unknown >Dummy-6860::DEBUG::2014-07-08 17:04:23,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::ERROR::2014-07-08 17:04:23,813::vm::3334::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug failed >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 3332, in hotplugNic > self._dom.attachDevice(nicXml) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 399, in attachDevice > if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) >libvirtError: An error occurred, but the cause is unknown >Thread-7087::DEBUG::2014-07-08 17:04:23,978::BindingXMLRPC::1114::vds::(wrapper) return vmHotplugNic with {'status': {'message': 'An error occurred, but the cause is unknown', 'code': 49}} >Dummy-6860::DEBUG::2014-07-08 17:04:24,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172247 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:04:26,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:26,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177605 s, 57.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:04:26,554::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:04:26,554::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:27,816::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:27,820::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:27,822::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:04:28,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:28,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396403 s, 25.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:30,550::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:30,550::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:30,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:30,551::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:30,551::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:30,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:30,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:30,552::__init__::225::IOProcess::(_processLogs) (274127) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:30,552::__init__::225::IOProcess::(_processLogs) (274127) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:30,552::__init__::225::IOProcess::(_processLogs) (274127) Building response >Thread-18::DEBUG::2014-07-08 17:04:30,552::__init__::225::IOProcess::(_processLogs) (274127) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:30,553::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:30,553::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:04:30,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:04:30,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000563186 s, 820 kB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:04:30,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:04:30,876::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:30,879::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:30,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:30,883::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:30,888::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:30,897::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:30,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:30,912::__init__::225::IOProcess::(_processLogs) (274128) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:30,918::__init__::225::IOProcess::(_processLogs) (274128) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:30,923::__init__::225::IOProcess::(_processLogs) (274128) Building response >Thread-18::DEBUG::2014-07-08 17:04:30,926::__init__::225::IOProcess::(_processLogs) (274128) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:30,930::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:30,935::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Dummy-6860::DEBUG::2014-07-08 17:04:31,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0758002 s, 13.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:31,028::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:31,032::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:04:31,035::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:31,039::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:31,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:31,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:31,043::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:31,044::__init__::225::IOProcess::(_processLogs) (274129) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:31,045::__init__::225::IOProcess::(_processLogs) (274129) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:31,046::__init__::225::IOProcess::(_processLogs) (274129) Building response >Thread-18::DEBUG::2014-07-08 17:04:31,047::__init__::225::IOProcess::(_processLogs) (274129) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:31,048::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:31,050::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:31,054::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:31,055::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:04:31,057::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:31,058::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:31,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:31,061::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:31,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:31,063::__init__::225::IOProcess::(_processLogs) (274130) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:31,064::__init__::225::IOProcess::(_processLogs) (274130) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:31,065::__init__::225::IOProcess::(_processLogs) (274130) Building response >Thread-18::DEBUG::2014-07-08 17:04:31,066::__init__::225::IOProcess::(_processLogs) (274130) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:31,067::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:31,069::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:31,073::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:31,074::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:04:31,075::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:31,076::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:31,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:31,078::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:31,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:31,081::__init__::225::IOProcess::(_processLogs) (274131) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:31,082::__init__::225::IOProcess::(_processLogs) DEBUG|(274131) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:31,083::__init__::225::IOProcess::(_processLogs) (274131) Building response >Thread-18::DEBUG::2014-07-08 17:04:31,084::__init__::225::IOProcess::(_processLogs) (274131) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:31,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:31,086::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:04:32,081::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [13971b95] >Thread-7087::DEBUG::2014-07-08 17:04:32,084::vm::3329::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug NIC xml: <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > <mac address="00:1a:4a:16:88:5c"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Thread-7087::DEBUG::2014-07-08 17:04:32,689::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 1 edom: 0 level: 2 message: An error occurred, but the cause is unknown >Thread-7087::ERROR::2014-07-08 17:04:32,690::vm::3334::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug failed >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 3332, in hotplugNic > self._dom.attachDevice(nicXml) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 399, in attachDevice > if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) >libvirtError: An error occurred, but the cause is unknown >Thread-7087::DEBUG::2014-07-08 17:04:32,691::BindingXMLRPC::1114::vds::(wrapper) return vmHotplugNic with {'status': {'message': 'An error occurred, but the cause is unknown', 'code': 49}} >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:32,829::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:32,830::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:32,832::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:04:33,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:04:33,322::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:04:33,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`75dead74-949d-47e3-8f3f-f6478aebf397`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:04:33,325::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:04:33,402::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 17:04:33,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200224 s, 51.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:04:33,404::task::1191::Storage.TaskManager.Task::(prepare) Task=`75dead74-949d-47e3-8f3f-f6478aebf397`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:04:33,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`75dead74-949d-47e3-8f3f-f6478aebf397`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:04:33,406::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:04:33,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:04:33,408::task::993::Storage.TaskManager.Task::(_decref) Task=`75dead74-949d-47e3-8f3f-f6478aebf397`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:04:33,424::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:04:33,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`823150b1-73cd-40a4-a750-db02d5f70147`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:04:33,429::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:04:33,433::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1d3f576c-ef04-44de-b0b1-8f484ed3b517`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:04:33,434::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:04:33,436::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:04:33,437::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1d3f576c-ef04-44de-b0b1-8f484ed3b517`::Granted request >Thread-7083::DEBUG::2014-07-08 17:04:33,440::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`823150b1-73cd-40a4-a750-db02d5f70147`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:04:33,442::task::993::Storage.TaskManager.Task::(_decref) Task=`823150b1-73cd-40a4-a750-db02d5f70147`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:04:33,479::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:33,480::task::1191::Storage.TaskManager.Task::(prepare) Task=`823150b1-73cd-40a4-a750-db02d5f70147`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:33,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`823150b1-73cd-40a4-a750-db02d5f70147`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:04:33,480::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:04:33,481::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:04:33,481::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:04:33,481::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:04:33,482::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:04:33,482::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:04:33,482::task::993::Storage.TaskManager.Task::(_decref) Task=`823150b1-73cd-40a4-a750-db02d5f70147`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:04:35,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:35,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173068 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:04:37,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f19dc78-dcc5-415f-b300-a8ce43aa6f99`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:04:37,716::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:04:37,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563186', 'lastCheck': '6.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:04:37,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f19dc78-dcc5-415f-b300-a8ce43aa6f99`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563186', 'lastCheck': '6.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:04:37,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f19dc78-dcc5-415f-b300-a8ce43aa6f99`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:04:37,717::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:04:37,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:04:37,718::task::993::Storage.TaskManager.Task::(_decref) Task=`6f19dc78-dcc5-415f-b300-a8ce43aa6f99`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:04:37,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:04:37,915::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:37,921::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:37,937::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:37,944::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:04:38,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477842 s, 21.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:04:40,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:40,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172096 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:41,092::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:41,093::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:41,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:41,093::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:41,093::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:41,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:41,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:41,094::__init__::225::IOProcess::(_processLogs) (274132) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:41,094::__init__::225::IOProcess::(_processLogs) (274132) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:41,095::__init__::225::IOProcess::(_processLogs) (274132) Building response >Thread-18::DEBUG::2014-07-08 17:04:41,095::__init__::225::IOProcess::(_processLogs) (274132) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:41,095::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:04:41,096::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:04:41,097::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:04:41,250::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000412332 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:41,256::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:41,258::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:41,260::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:41,262::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:41,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:41,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:41,268::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:41,270::__init__::225::IOProcess::(_processLogs) (274133) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:41,272::__init__::225::IOProcess::(_processLogs) (274133) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:41,273::__init__::225::IOProcess::(_processLogs) DEBUG|(274133) Building response >Thread-18::DEBUG::2014-07-08 17:04:41,275::__init__::225::IOProcess::(_processLogs) (274133) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:41,275::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:41,276::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:04:41,284::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:41,285::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:04:41,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:41,288::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:41,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:41,290::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:41,292::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:41,293::__init__::225::IOProcess::(_processLogs) (274134) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:41,295::__init__::225::IOProcess::(_processLogs) (274134) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:41,296::__init__::225::IOProcess::(_processLogs) (274134) Building response >Thread-18::DEBUG::2014-07-08 17:04:41,297::__init__::225::IOProcess::(_processLogs) (274134) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:41,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:41,300::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:41,305::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:41,306::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:04:41,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:41,306::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:41,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:41,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:41,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:41,307::__init__::225::IOProcess::(_processLogs) (274135) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:41,307::__init__::225::IOProcess::(_processLogs) (274135) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:41,308::__init__::225::IOProcess::(_processLogs) (274135) Building response >Thread-18::DEBUG::2014-07-08 17:04:41,308::__init__::225::IOProcess::(_processLogs) (274135) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:41,308::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:41,308::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:41,309::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:04:41,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:41,310::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:41,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:41,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:41,311::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:41,311::__init__::225::IOProcess::(_processLogs) (274136) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:41,311::__init__::225::IOProcess::(_processLogs) (274136) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:41,311::__init__::225::IOProcess::(_processLogs) (274136) Building response >Thread-18::DEBUG::2014-07-08 17:04:41,312::__init__::225::IOProcess::(_processLogs) (274136) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:41,312::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:41,312::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:04:41,737::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:04:41,738::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:04:42,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:42,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175895 s, 58.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:42,954::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:42,956::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:42,957::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:04:43,496::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:04:43,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`36db14d8-2aa5-4132-a750-778ebdb5a6ed`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:04:43,498::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:04:43,512::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:04:43,513::task::1191::Storage.TaskManager.Task::(prepare) Task=`36db14d8-2aa5-4132-a750-778ebdb5a6ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:04:43,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`36db14d8-2aa5-4132-a750-778ebdb5a6ed`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:04:43,514::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:04:43,514::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:04:43,514::task::993::Storage.TaskManager.Task::(_decref) Task=`36db14d8-2aa5-4132-a750-778ebdb5a6ed`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:04:43,537::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:04:43,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea27f794-e54a-4ccc-801a-495bec894246`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:04:43,539::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:04:43,539::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2932d027-7840-4f5e-8968-735acf81941d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:04:43,540::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:04:43,540::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:04:43,540::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2932d027-7840-4f5e-8968-735acf81941d`::Granted request >Thread-7083::DEBUG::2014-07-08 17:04:43,541::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ea27f794-e54a-4ccc-801a-495bec894246`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:04:43,541::task::993::Storage.TaskManager.Task::(_decref) Task=`ea27f794-e54a-4ccc-801a-495bec894246`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:04:43,560::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:43,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea27f794-e54a-4ccc-801a-495bec894246`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:43,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea27f794-e54a-4ccc-801a-495bec894246`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:04:43,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:04:43,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:04:43,562::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:04:43,562::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:04:43,562::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:04:43,562::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:04:43,563::task::993::Storage.TaskManager.Task::(_decref) Task=`ea27f794-e54a-4ccc-801a-495bec894246`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:04:44,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:44,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172386 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:04:46,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:47,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174663 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:47,964::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:47,965::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:47,966::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:04:49,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:49,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0924348 s, 11.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:51,315::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:51,315::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:51,316::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:51,316::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:51,316::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:51,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:51,317::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:51,317::__init__::225::IOProcess::(_processLogs) (274137) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:51,317::__init__::225::IOProcess::(_processLogs) (274137) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:51,317::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274137) Building response >Thread-18::DEBUG::2014-07-08 17:04:51,318::__init__::225::IOProcess::(_processLogs) (274137) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:51,318::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:51,318::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:04:51,320::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:04:51,468::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000543351 s, 850 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:04:51,470::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:51,471::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:04:51,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:51,471::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:51,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:51,472::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:51,472::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:51,473::__init__::225::IOProcess::(_processLogs) (274138) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:04:51,473::__init__::225::IOProcess::(_processLogs) (274138) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:04:51,473::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274138) Building response >Thread-18::DEBUG::2014-07-08 17:04:51,474::__init__::225::IOProcess::(_processLogs) (274138) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:51,474::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:51,474::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:04:51,476::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:51,476::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:04:51,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:51,477::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:51,477::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:51,478::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:51,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:51,478::__init__::225::IOProcess::(_processLogs) (274139) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:51,478::__init__::225::IOProcess::(_processLogs) (274139) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:51,479::__init__::225::IOProcess::(_processLogs) (274139) Building response >Thread-18::DEBUG::2014-07-08 17:04:51,479::__init__::225::IOProcess::(_processLogs) (274139) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:51,479::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:51,479::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:51,480::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:51,481::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:04:51,481::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:51,481::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:51,481::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:51,482::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:51,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:51,482::__init__::225::IOProcess::(_processLogs) (274140) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:51,483::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274140) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:51,483::__init__::225::IOProcess::(_processLogs) (274140) Building response >Thread-18::DEBUG::2014-07-08 17:04:51,483::__init__::225::IOProcess::(_processLogs) (274140) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:51,483::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:51,484::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:04:51,485::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:51,485::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:04:51,486::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:51,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:51,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:51,487::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:51,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:51,487::__init__::225::IOProcess::(_processLogs) (274141) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:04:51,487::__init__::225::IOProcess::(_processLogs) (274141) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:04:51,488::__init__::225::IOProcess::(_processLogs) (274141) Building response >Thread-18::DEBUG::2014-07-08 17:04:51,489::__init__::225::IOProcess::(_processLogs) (274141) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:51,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:51,489::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:04:51,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:51,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174423 s, 58.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:04:51,808::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:52,973::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:52,975::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:52,976::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:04:53,100::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba959c69-77dd-45a2-9e74-74a146af3b96`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:04:53,100::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:04:53,101::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543351', 'lastCheck': '1.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:04:53,101::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba959c69-77dd-45a2-9e74-74a146af3b96`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543351', 'lastCheck': '1.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:04:53,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba959c69-77dd-45a2-9e74-74a146af3b96`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:04:53,102::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:04:53,102::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:04:53,102::task::993::Storage.TaskManager.Task::(_decref) Task=`ba959c69-77dd-45a2-9e74-74a146af3b96`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:04:53,132::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:04:53,605::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:04:53,606::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8717e06-8640-4731-97d9-4f06944ea266`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:04:53,606::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:04:53,621::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:04:53,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`b8717e06-8640-4731-97d9-4f06944ea266`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:04:53,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8717e06-8640-4731-97d9-4f06944ea266`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:04:53,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:04:53,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:04:53,622::task::993::Storage.TaskManager.Task::(_decref) Task=`b8717e06-8640-4731-97d9-4f06944ea266`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:04:53,637::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:04:53,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`11a21f4c-b5ea-4d17-9719-a0bb49038bb3`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:04:53,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:04:53,639::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8bb40167-8394-4b6d-9858-310d5aa705c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:04:53,639::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:04:53,640::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:04:53,640::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8bb40167-8394-4b6d-9858-310d5aa705c6`::Granted request >Thread-7083::DEBUG::2014-07-08 17:04:53,641::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`11a21f4c-b5ea-4d17-9719-a0bb49038bb3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:04:53,641::task::993::Storage.TaskManager.Task::(_decref) Task=`11a21f4c-b5ea-4d17-9719-a0bb49038bb3`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:04:53,666::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:53,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`11a21f4c-b5ea-4d17-9719-a0bb49038bb3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:04:53,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`11a21f4c-b5ea-4d17-9719-a0bb49038bb3`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:04:53,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:04:53,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:04:53,668::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:04:53,668::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:04:53,668::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:04:53,668::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:04:53,669::task::993::Storage.TaskManager.Task::(_decref) Task=`11a21f4c-b5ea-4d17-9719-a0bb49038bb3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:04:53,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:54,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174129 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:04:56,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:56,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0203817 s, 50.2 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:04:56,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`3318e46e-86a7-4d84-940a-ba0952b99e88`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:04:56,805::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:04:56,806::__init__::225::IOProcess::(_processLogs) (274141) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:56,807::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:04:56,807::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:56,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:56,808::__init__::225::IOProcess::(_processLogs) (274141) Finding callback 'access'...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:56,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:56,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:56,809::__init__::225::IOProcess::(_processLogs) (274142) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:04:56,809::__init__::225::IOProcess::(_processLogs) (274142) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:04:56,809::__init__::225::IOProcess::(_processLogs) (274142) Building response >Thread-18::DEBUG::2014-07-08 17:04:56,809::__init__::225::IOProcess::(_processLogs) (274142) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:56,810::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:56,810::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:04:56,812::__init__::225::IOProcess::(_processLogs) (274141) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:04:56,812::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:04:56,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:04:56,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:04:56,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:04:56,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:04:56,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:04:56,814::__init__::225::IOProcess::(_processLogs) (274143) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:04:56,814::__init__::225::IOProcess::(_processLogs) (274143) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:04:56,814::__init__::225::IOProcess::(_processLogs) (274143) Building response >Thread-18::DEBUG::2014-07-08 17:04:56,814::__init__::225::IOProcess::(_processLogs) (274143) Queuing response >Thread-18::DEBUG::2014-07-08 17:04:56,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:04:56,815::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:04:56,816::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:04:56,816::task::1191::Storage.TaskManager.Task::(prepare) Task=`3318e46e-86a7-4d84-940a-ba0952b99e88`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:04:56,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`3318e46e-86a7-4d84-940a-ba0952b99e88`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:04:56,817::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:04:56,817::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:04:56,817::task::993::Storage.TaskManager.Task::(_decref) Task=`3318e46e-86a7-4d84-940a-ba0952b99e88`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:04:56,897::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:04:56,898::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:57,983::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:57,984::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:04:57,986::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:04:58,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:04:58,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174152 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:05:00,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:00,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173082 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:01,497::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:01,498::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:01,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:01,498::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:01,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:01,499::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:01,500::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:01,500::__init__::225::IOProcess::(_processLogs) (274144) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:01,500::__init__::225::IOProcess::(_processLogs) (274144) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:01,500::__init__::225::IOProcess::(_processLogs) (274144) Building response >Thread-18::DEBUG::2014-07-08 17:05:01,501::__init__::225::IOProcess::(_processLogs) (274144) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:01,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:01,501::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:05:01,503::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:05:01,650::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000449209 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:01,652::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:01,653::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:01,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:01,653::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:01,653::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:01,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:01,654::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:01,654::__init__::225::IOProcess::(_processLogs) (274145) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:01,655::__init__::225::IOProcess::(_processLogs) (274145) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:01,655::__init__::225::IOProcess::(_processLogs) (274145) Building response >Thread-18::DEBUG::2014-07-08 17:05:01,655::__init__::225::IOProcess::(_processLogs) (274145) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:01,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:01,656::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:05:01,658::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:01,658::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:05:01,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:01,659::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:01,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:01,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:01,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:01,660::__init__::225::IOProcess::(_processLogs) (274146) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:01,660::__init__::225::IOProcess::(_processLogs) (274146) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:01,660::__init__::225::IOProcess::(_processLogs) (274146) Building response >Thread-18::DEBUG::2014-07-08 17:05:01,660::__init__::225::IOProcess::(_processLogs) (274146) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:01,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:01,661::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:01,662::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:01,662::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:05:01,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:01,663::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:01,663::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:01,663::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:01,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:01,664::__init__::225::IOProcess::(_processLogs) (274147) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:01,664::__init__::225::IOProcess::(_processLogs) (274147) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:01,664::__init__::225::IOProcess::(_processLogs) (274147) Building response >Thread-18::DEBUG::2014-07-08 17:05:01,665::__init__::225::IOProcess::(_processLogs) (274147) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:01,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:01,665::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:01,666::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:01,666::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:05:01,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:01,667::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:01,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:01,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:01,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:01,668::__init__::225::IOProcess::(_processLogs) (274148) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:01,668::__init__::225::IOProcess::(_processLogs) (274148) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:01,668::__init__::225::IOProcess::(_processLogs) (274148) Building response >Thread-18::DEBUG::2014-07-08 17:05:01,669::__init__::225::IOProcess::(_processLogs) (274148) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:01,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:01,669::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:05:02,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:02,991::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:02,999::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:03,005::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:05:03,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360369 s, 28.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:05:03,683::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:05:03,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`925ab3ce-10e3-4b11-8452-0719b2d29f91`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:05:03,685::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:05:03,700::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:03,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`925ab3ce-10e3-4b11-8452-0719b2d29f91`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:03,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`925ab3ce-10e3-4b11-8452-0719b2d29f91`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:05:03,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:05:03,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:05:03,701::task::993::Storage.TaskManager.Task::(_decref) Task=`925ab3ce-10e3-4b11-8452-0719b2d29f91`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:05:03,713::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:05:03,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff591119-3d42-4691-99bd-49307d005671`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:05:03,714::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:05:03,715::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d429ac36-4f0b-4456-b86f-54101724b269`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:05:03,716::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:05:03,716::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:05:03,716::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d429ac36-4f0b-4456-b86f-54101724b269`::Granted request >Thread-7083::DEBUG::2014-07-08 17:05:03,721::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff591119-3d42-4691-99bd-49307d005671`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:05:03,721::task::993::Storage.TaskManager.Task::(_decref) Task=`ff591119-3d42-4691-99bd-49307d005671`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:05:03,741::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:03,741::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff591119-3d42-4691-99bd-49307d005671`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:03,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff591119-3d42-4691-99bd-49307d005671`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:05:03,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:05:03,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:05:03,742::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:05:03,743::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:05:03,743::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:05:03,743::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:05:03,744::task::993::Storage.TaskManager.Task::(_decref) Task=`ff591119-3d42-4691-99bd-49307d005671`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:05:05,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:05,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116937 s, 8.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:05:07,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:07,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173467 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:08,016::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:08,018::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:08,019::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:05:08,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`9312ad85-a5cb-45cc-b660-9b2deb7aecc0`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:05:08,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:05:08,378::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449209', 'lastCheck': '6.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:05:08,378::task::1191::Storage.TaskManager.Task::(prepare) Task=`9312ad85-a5cb-45cc-b660-9b2deb7aecc0`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449209', 'lastCheck': '6.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:05:08,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`9312ad85-a5cb-45cc-b660-9b2deb7aecc0`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:05:08,379::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:05:08,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:05:08,379::task::993::Storage.TaskManager.Task::(_decref) Task=`9312ad85-a5cb-45cc-b660-9b2deb7aecc0`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:05:08,457::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:05:09,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:10,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347136 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:11,672::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:11,673::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:11,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:11,673::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:11,674::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:11,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:11,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:11,674::__init__::225::IOProcess::(_processLogs) (274149) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:11,675::__init__::225::IOProcess::(_processLogs) (274149) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:11,675::__init__::225::IOProcess::(_processLogs) (274149) Building response >Thread-18::DEBUG::2014-07-08 17:05:11,675::__init__::225::IOProcess::(_processLogs) (274149) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:11,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:11,676::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:05:11,677::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:05:11,822::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000468762 s, 986 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:11,824::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:11,824::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:11,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:11,825::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:11,825::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:11,825::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:11,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:11,826::__init__::225::IOProcess::(_processLogs) (274150) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:11,826::__init__::225::IOProcess::(_processLogs) (274150) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:11,826::__init__::225::IOProcess::(_processLogs) (274150) Building response >Thread-18::DEBUG::2014-07-08 17:05:11,827::__init__::225::IOProcess::(_processLogs) (274150) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:11,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:11,827::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:05:11,829::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:05:11,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:11,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:11,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:11,830::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:11,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:11,831::__init__::225::IOProcess::(_processLogs) (274151) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:11,831::__init__::225::IOProcess::(_processLogs) (274151) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:11,831::__init__::225::IOProcess::(_processLogs) (274151) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:11,832::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:11,832::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:11,833::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:05:11,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:11,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:11,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:11,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:11,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:11,835::__init__::225::IOProcess::(_processLogs) (274152) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:11,835::__init__::225::IOProcess::(_processLogs) (274152) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:11,835::__init__::225::IOProcess::(_processLogs) (274152) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:11,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:11,836::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:11,837::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:05:11,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:11,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:11,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:11,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:11,838::__init__::225::IOProcess::(_processLogs) (274153) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:11,838::__init__::225::IOProcess::(_processLogs) (274153) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:11,839::__init__::225::IOProcess::(_processLogs) (274153) Building response >Thread-18::DEBUG::2014-07-08 17:05:11,839::__init__::225::IOProcess::(_processLogs) (274153) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:11,839::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:11,839::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:05:12,006::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:05:12,007::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:05:12,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:12,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176289 s, 58.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:13,026::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:13,028::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:13,029::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:05:13,759::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:05:13,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0641659-4ab3-4d3e-b7c1-86686766e3a3`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:05:13,761::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:05:13,776::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:13,776::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0641659-4ab3-4d3e-b7c1-86686766e3a3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:13,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0641659-4ab3-4d3e-b7c1-86686766e3a3`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:05:13,777::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:05:13,777::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:05:13,777::task::993::Storage.TaskManager.Task::(_decref) Task=`f0641659-4ab3-4d3e-b7c1-86686766e3a3`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:05:13,911::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:05:13,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`729663c4-1cff-4a07-8df8-66a88a76bc2e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:05:13,912::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:05:13,913::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0adbb82e-494a-4358-a0e5-7266c15e02fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:05:13,913::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:05:13,914::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:05:13,914::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0adbb82e-494a-4358-a0e5-7266c15e02fd`::Granted request >Thread-7083::DEBUG::2014-07-08 17:05:13,915::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`729663c4-1cff-4a07-8df8-66a88a76bc2e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:05:13,915::task::993::Storage.TaskManager.Task::(_decref) Task=`729663c4-1cff-4a07-8df8-66a88a76bc2e`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:05:13,934::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:13,934::task::1191::Storage.TaskManager.Task::(prepare) Task=`729663c4-1cff-4a07-8df8-66a88a76bc2e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:13,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`729663c4-1cff-4a07-8df8-66a88a76bc2e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:05:13,935::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:05:13,935::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:05:13,935::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:05:13,936::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:05:13,936::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:05:13,936::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:05:13,937::task::993::Storage.TaskManager.Task::(_decref) Task=`729663c4-1cff-4a07-8df8-66a88a76bc2e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:05:14,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:14,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174062 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:05:16,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:16,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172889 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:18,036::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:18,038::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:18,039::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:05:18,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:19,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172397 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:05:21,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:21,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100877 s, 10.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:21,843::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:21,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:21,843::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:21,844::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:21,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:21,844::__init__::225::IOProcess::(_processLogs) (274154) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:21,845::__init__::225::IOProcess::(_processLogs) (274154) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:21,845::__init__::225::IOProcess::(_processLogs) (274154) Building response >Thread-18::DEBUG::2014-07-08 17:05:21,845::__init__::225::IOProcess::(_processLogs) (274154) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:21,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:21,845::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:05:21,847::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:05:21,998::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000501726 s, 921 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:22,000::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:22,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:22,001::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:22,001::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:22,001::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:22,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:22,002::__init__::225::IOProcess::(_processLogs) DEBUG|(274155) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:22,002::__init__::225::IOProcess::(_processLogs) (274155) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:22,003::__init__::225::IOProcess::(_processLogs) (274155) Building response >Thread-18::DEBUG::2014-07-08 17:05:22,003::__init__::225::IOProcess::(_processLogs) (274155) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:22,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:22,003::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:05:22,005::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:22,006::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:05:22,006::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:22,006::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:22,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:22,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:22,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:22,007::__init__::225::IOProcess::(_processLogs) (274156) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:22,008::__init__::225::IOProcess::(_processLogs) (274156) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:22,008::__init__::225::IOProcess::(_processLogs) (274156) Building response >Thread-18::DEBUG::2014-07-08 17:05:22,008::__init__::225::IOProcess::(_processLogs) (274156) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:22,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:22,008::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:22,010::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:22,010::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:05:22,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:22,010::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:22,011::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:22,011::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:22,011::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:22,011::__init__::225::IOProcess::(_processLogs) (274157) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:22,012::__init__::225::IOProcess::(_processLogs) (274157) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:22,012::__init__::225::IOProcess::(_processLogs) (274157) Building response >Thread-18::DEBUG::2014-07-08 17:05:22,012::__init__::225::IOProcess::(_processLogs) (274157) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:22,012::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:22,013::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:22,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:22,014::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:05:22,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:22,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:22,015::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:22,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:22,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:22,015::__init__::225::IOProcess::(_processLogs) (274158) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:22,016::__init__::225::IOProcess::(_processLogs) (274158) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:22,016::__init__::225::IOProcess::(_processLogs) (274158) Building response >Thread-18::DEBUG::2014-07-08 17:05:22,016::__init__::225::IOProcess::(_processLogs) (274158) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:22,016::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:22,017::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >VM Channels Listener::DEBUG::2014-07-08 17:05:22,061::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:23,046::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:23,048::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:23,049::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:05:23,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:05:23,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`48f081a5-fa9d-48bc-8a03-5a3ff18b0a18`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:05:23,764::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:05:23,766::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501726', 'lastCheck': '1.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:05:23,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`48f081a5-fa9d-48bc-8a03-5a3ff18b0a18`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501726', 'lastCheck': '1.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:05:23,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`48f081a5-fa9d-48bc-8a03-5a3ff18b0a18`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:05:23,769::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:05:23,770::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:05:23,772::task::993::Storage.TaskManager.Task::(_decref) Task=`48f081a5-fa9d-48bc-8a03-5a3ff18b0a18`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:05:23,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490438 s, 20.9 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:05:23,894::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:05:23,952::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:05:23,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`2092b37d-e0ba-48af-9986-d336b62c7bd9`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:05:23,953::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:05:23,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:23,970::task::1191::Storage.TaskManager.Task::(prepare) Task=`2092b37d-e0ba-48af-9986-d336b62c7bd9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:23,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`2092b37d-e0ba-48af-9986-d336b62c7bd9`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:05:23,970::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:05:23,970::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:05:23,971::task::993::Storage.TaskManager.Task::(_decref) Task=`2092b37d-e0ba-48af-9986-d336b62c7bd9`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:05:23,982::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:05:23,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`3891dd70-f502-4099-8940-3f3fbdef6216`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:05:23,983::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:05:23,984::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`07b7b40d-3a50-4d78-895c-d985ec9ef6c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:05:23,984::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:05:23,985::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:05:23,985::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`07b7b40d-3a50-4d78-895c-d985ec9ef6c6`::Granted request >Thread-7083::DEBUG::2014-07-08 17:05:23,986::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3891dd70-f502-4099-8940-3f3fbdef6216`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:05:23,986::task::993::Storage.TaskManager.Task::(_decref) Task=`3891dd70-f502-4099-8940-3f3fbdef6216`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:05:24,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:24,005::task::1191::Storage.TaskManager.Task::(prepare) Task=`3891dd70-f502-4099-8940-3f3fbdef6216`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:24,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`3891dd70-f502-4099-8940-3f3fbdef6216`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:05:24,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:05:24,006::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:05:24,006::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:05:24,007::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:05:24,007::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:05:24,007::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:05:24,008::task::993::Storage.TaskManager.Task::(_decref) Task=`3891dd70-f502-4099-8940-3f3fbdef6216`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:05:25,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:26,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173233 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:05:27,089::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:05:27,089::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:28,056::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:28,057::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:28,059::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:05:28,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:28,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324645 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:05:30,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:30,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176172 s, 58.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:32,020::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:32,020::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:32,020::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:32,021::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:32,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:32,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:32,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:32,022::__init__::225::IOProcess::(_processLogs) (274159) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:32,022::__init__::225::IOProcess::(_processLogs) (274159) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:32,022::__init__::225::IOProcess::(_processLogs) (274159) Building response >Thread-18::DEBUG::2014-07-08 17:05:32,022::__init__::225::IOProcess::(_processLogs) (274159) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:32,023::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:32,023::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:05:32,025::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:05:32,260::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000600341 s, 770 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:32,271::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:32,275::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:32,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:32,276::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:32,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:32,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:32,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:32,277::__init__::225::IOProcess::(_processLogs) (274160) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:32,277::__init__::225::IOProcess::(_processLogs) (274160) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:32,277::__init__::225::IOProcess::(_processLogs) (274160) Building response >Thread-18::DEBUG::2014-07-08 17:05:32,277::__init__::225::IOProcess::(_processLogs) (274160) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:32,278::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:32,278::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:05:32,281::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:32,281::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:05:32,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:32,282::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:32,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:32,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:32,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:32,283::__init__::225::IOProcess::(_processLogs) (274161) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:32,283::__init__::225::IOProcess::(_processLogs) (274161) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:32,283::__init__::225::IOProcess::(_processLogs) (274161) Building response >Thread-18::DEBUG::2014-07-08 17:05:32,283::__init__::225::IOProcess::(_processLogs) (274161) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:32,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:32,284::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:32,285::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:32,286::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:05:32,286::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:32,286::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:32,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:32,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:32,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:32,287::__init__::225::IOProcess::(_processLogs) (274162) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:32,288::__init__::225::IOProcess::(_processLogs) (274162) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:32,288::__init__::225::IOProcess::(_processLogs) (274162) Building response >Thread-18::DEBUG::2014-07-08 17:05:32,288::__init__::225::IOProcess::(_processLogs) (274162) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:32,288::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:32,288::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:32,293::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:32,293::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:05:32,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:32,294::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:32,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:32,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:32,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:32,295::__init__::225::IOProcess::(_processLogs) (274163) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:32,295::__init__::225::IOProcess::(_processLogs) (274163) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:32,295::__init__::225::IOProcess::(_processLogs) (274163) Building response >Thread-18::DEBUG::2014-07-08 17:05:32,296::__init__::225::IOProcess::(_processLogs) (274163) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:32,296::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:32,296::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:05:32,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:32,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175892 s, 58.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:33,061::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:33,063::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:33,064::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:05:33,123::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [6ebffc06] >Thread-7082::DEBUG::2014-07-08 17:05:33,123::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7087::DEBUG::2014-07-08 17:05:33,126::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call setupNetworks with ({'net5': {'nic': 'eth3', 'vlan': '5', 'STP': 'no', 'bridged': 'true', 'mtu': '1500'}}, {}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [6ebffc06] >Thread-7082::DEBUG::2014-07-08 17:05:33,629::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [6ebffc06] >Thread-7082::DEBUG::2014-07-08 17:05:33,630::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7082::DEBUG::2014-07-08 17:05:34,022::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:05:34,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c2fbd96-2a58-4173-9831-0bc1413412e7`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:05:34,024::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:05:34,063::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:05:34,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c2fbd96-2a58-4173-9831-0bc1413412e7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:05:34,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c2fbd96-2a58-4173-9831-0bc1413412e7`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:05:34,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:05:34,064::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:05:34,064::task::993::Storage.TaskManager.Task::(_decref) Task=`1c2fbd96-2a58-4173-9831-0bc1413412e7`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:05:34,076::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:05:34,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`53354acc-2517-4d23-8b4a-18a0c29adfcf`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:05:34,077::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:05:34,078::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0bb31ec5-7604-46e1-97a4-e82241ee19f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:05:34,079::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:05:34,079::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:05:34,080::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0bb31ec5-7604-46e1-97a4-e82241ee19f1`::Granted request >Thread-7083::DEBUG::2014-07-08 17:05:34,080::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`53354acc-2517-4d23-8b4a-18a0c29adfcf`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:05:34,081::task::993::Storage.TaskManager.Task::(_decref) Task=`53354acc-2517-4d23-8b4a-18a0c29adfcf`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:05:34,101::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:34,102::task::1191::Storage.TaskManager.Task::(prepare) Task=`53354acc-2517-4d23-8b4a-18a0c29adfcf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:34,102::task::595::Storage.TaskManager.Task::(_updateState) Task=`53354acc-2517-4d23-8b4a-18a0c29adfcf`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:05:34,102::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:05:34,103::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:05:34,103::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:05:34,104::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:05:34,104::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:05:34,104::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:05:34,104::task::993::Storage.TaskManager.Task::(_decref) Task=`53354acc-2517-4d23-8b4a-18a0c29adfcf`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:05:34,136::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [6ebffc06] >Thread-7082::DEBUG::2014-07-08 17:05:34,137::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7082::DEBUG::2014-07-08 17:05:34,644::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [6ebffc06] >Thread-7082::DEBUG::2014-07-08 17:05:34,646::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-6860::DEBUG::2014-07-08 17:05:34,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:05:35,159::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [6ebffc06] >Thread-7082::DEBUG::2014-07-08 17:05:35,163::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-6860::DEBUG::2014-07-08 17:05:35,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538217 s, 19.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:05:35,678::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call ping with () {} flowID [6ebffc06] >Thread-7082::DEBUG::2014-07-08 17:05:35,679::BindingXMLRPC::1114::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-7087::DEBUG::2014-07-08 17:05:35,970::BindingXMLRPC::1114::vds::(wrapper) return setupNetworks with {'status': {'message': 'Done', 'code': 0}} >Thread-7087::DEBUG::2014-07-08 17:05:36,184::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call getCapabilities with () {} flowID [6ebffc06] >Thread-7087::DEBUG::2014-07-08 17:05:36,186::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-7087::DEBUG::2014-07-08 17:05:36,347::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:05:36,461::BindingXMLRPC::1114::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:orange-vdsc'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.17.1.el6.x86_64', 'buildtime': 1397226420.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '3.git601f786.el6', 'buildtime': 1404118673L, 'version': '4.16.0'}, 'qemu-kvm': {'release': '2.415.el6_5.11', 'buildtime': 1403019242L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.11', 'buildtime': 1403019242L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Dual-Core AMD Opteron(tm) Processor 2210', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}, '10_faqemu': {'md5': 'e3cb338be6b9075a04bed0e7400ab7e2'}, '50_nestedvt': {'md5': '1eb86fc52cea5ee7812978176ce2d545'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 1, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.128.17', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745e/64'], 'gateway': '10.35.128.254', 'bootproto4': 'none', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.128.17/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}, 'net5': {'iface': 'net5', 'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net5', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'gateway': '', 'bootproto4': 'none', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth3.5']}, 'net3': {'iface': 'net3', 'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net3', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'gateway': '', 'bootproto4': 'none', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth3.4093']}, 'net1': {'iface': 'net1', 'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net1', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::216:36ff:fe84:745f/64'], 'gateway': '', 'bootproto4': 'none', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['bond0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.128.17', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745e/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.128.17/24'], 'ipv6gateway': '::', 'gateway': '10.35.128.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '82', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745e', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745e', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '82', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}, 'net5': {'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net5', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': '', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '20', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745d', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745d', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '80', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth3.5']}, 'net3': {'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net3', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': '', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '81', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745d', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745d', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '81', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth3.4093']}, 'net1': {'addr': '', 'cfg': {'DEFROUTE': 'no', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'net1', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745f/64'], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': '', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '181', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.00163684745f', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.00163684745f', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '81', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['bond0']}}, 'uuid': '007EF314-A079-0010-A38A-0016367B3DFE', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth3': {'addr': '', 'cfg': {'DEVICE': 'eth3', 'HWADDR': '00:16:36:84:74:5d', 'ONBOOT': 'no', 'NM_CONTROLLED': 'no', 'MTU': '1500'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5d', 'speed': 1000}, 'eth2': {'permhwaddr': '00:16:36:84:74:5C', 'addr': '', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '5000', 'HWADDR': '00:16:36:84:74:5c', 'MASTER': 'bond0', 'DEVICE': 'eth2', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5f', 'speed': 1000}, 'eth1': {'permhwaddr': '00:16:36:84:74:5F', 'addr': '', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '5000', 'HWADDR': '00:16:36:84:74:5f', 'MASTER': 'bond0', 'DEVICE': 'eth1', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '5000', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5f', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:16:36:84:74:5e', 'DEVICE': 'eth0', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5e', 'speed': 0}}, 'software_revision': '3', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ht,syscall,nx,mmxext,fxsr_opt,rdtscp,lm,3dnowext,3dnow,rep_good,extd_apicid,pni,cx16,lahf_lm,cmp_legacy,svm,extapic,cr8_legacy,model_athlon,model_Opteron_G1,model_Opteron_G2', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:orange-vdsc', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond0': {'addr': '', 'cfg': {'BRIDGE': 'net1', 'HOTPLUG': 'no', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BONDING_OPTS': 'mode=1 miimon=100', 'DEVICE': 'bond0', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745f/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:16:36:84:74:5f', 'slaves': ['eth1', 'eth2'], 'opts': {'miimon': '100', 'mode': '1'}}, 'bond1': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond2': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond3': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}}, 'software_version': '4.16', 'memSize': '3830', 'cpuSpeed': '1809.257', 'numaNodes': {u'0': {'totalMemory': '3830', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {'eth3.5': {'iface': 'eth3', 'addr': '', 'cfg': {'BRIDGE': 'net5', 'VLAN': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'DEVICE': 'eth3.5', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'vlanid': 5, 'mtu': '1500', 'netmask': '', 'ipv4addrs': []}, 'eth3.4093': {'iface': 'eth3', 'addr': '', 'cfg': {'BRIDGE': 'net3', 'VLAN': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'DEVICE': 'eth3.4093', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::216:36ff:fe84:745d/64'], 'vlanid': 4093, 'mtu': '1500', 'netmask': '', 'ipv4addrs': []}}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.162.23'}} >Thread-7087::DEBUG::2014-07-08 17:05:36,789::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call setSafeNetworkConfig with () {} flowID [bde79d8] >Thread-7087::DEBUG::2014-07-08 17:05:36,838::BindingXMLRPC::1114::vds::(wrapper) return setSafeNetworkConfig with {'status': {'message': 'Done', 'code': 0}} >Dummy-6860::DEBUG::2014-07-08 17:05:37,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:37,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0938324 s, 10.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:38,071::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:38,087::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:38,088::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::ERROR::2014-07-08 17:05:39,064::BindingXMLRPC::1126::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/rpc/BindingXMLRPC.py", line 1110, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/rpc/BindingXMLRPC.py", line 455, in getStats > return api.getStats() > File "/usr/share/vdsm/API.py", line 1245, in getStats > decStats = self._cif._hostStats.get() > File "/usr/share/vdsm/virt/sampling.py", line 514, in get > stats = self._getInterfacesStats() > File "/usr/share/vdsm/virt/sampling.py", line 619, in _getInterfacesStats > for hs in self._samples]) >KeyError: 'eth3.5' >Dummy-6860::DEBUG::2014-07-08 17:05:39,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:40,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171769 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:05:42,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:42,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0228048 s, 44.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:42,314::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:42,317::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:42,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:42,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:42,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:42,322::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:42,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:42,323::__init__::225::IOProcess::(_processLogs) (274164) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:42,324::__init__::225::IOProcess::(_processLogs) (274164) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:42,325::__init__::225::IOProcess::(_processLogs) (274164) Building response >Thread-18::DEBUG::2014-07-08 17:05:42,326::__init__::225::IOProcess::(_processLogs) (274164) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:42,326::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:42,327::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:05:42,334::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7086::DEBUG::2014-07-08 17:05:42,491::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-37::DEBUG::2014-07-08 17:05:42,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000574361 s, 804 kB/s\n'; <rc> = 0 >Thread-7086::ERROR::2014-07-08 17:05:42,496::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:05:42,503::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:42,505::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:42,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:42,508::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:42,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:42,510::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:42,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:42,512::__init__::225::IOProcess::(_processLogs) (274165) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:42,513::__init__::225::IOProcess::(_processLogs) (274165) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:42,515::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274165) Building response >Thread-18::DEBUG::2014-07-08 17:05:42,516::__init__::225::IOProcess::(_processLogs) (274165) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:42,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:42,518::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:05:42,526::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:42,527::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:05:42,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:42,529::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:42,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:42,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:42,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:42,534::__init__::225::IOProcess::(_processLogs) (274166) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:42,535::__init__::225::IOProcess::(_processLogs) (274166) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:42,536::__init__::225::IOProcess::(_processLogs) (274166) Building response >Thread-18::DEBUG::2014-07-08 17:05:42,538::__init__::225::IOProcess::(_processLogs) (274166) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:42,539::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:42,539::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:42,544::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:42,545::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:05:42,546::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:42,547::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:42,548::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:42,550::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:42,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:42,552::__init__::225::IOProcess::(_processLogs) (274167) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:42,553::__init__::225::IOProcess::(_processLogs) (274167) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:42,554::__init__::225::IOProcess::(_processLogs) (274167) Building response >Thread-18::DEBUG::2014-07-08 17:05:42,556::__init__::225::IOProcess::(_processLogs) (274167) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:42,557::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:42,559::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:42,563::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:42,564::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:05:42,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:42,566::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:42,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:42,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:42,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:42,570::__init__::225::IOProcess::(_processLogs) (274168) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:42,572::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274168) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:42,573::__init__::225::IOProcess::(_processLogs) (274168) Building response >Thread-18::DEBUG::2014-07-08 17:05:42,574::__init__::225::IOProcess::(_processLogs) (274168) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:42,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:42,576::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:43,096::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:43,186::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:43,188::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:05:44,119::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:05:44,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`6624dc27-8321-45d2-b654-93d17d346f8f`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:05:44,121::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:05:44,136::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:44,137::task::1191::Storage.TaskManager.Task::(prepare) Task=`6624dc27-8321-45d2-b654-93d17d346f8f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:44,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`6624dc27-8321-45d2-b654-93d17d346f8f`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:05:44,137::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:05:44,138::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:05:44,138::task::993::Storage.TaskManager.Task::(_decref) Task=`6624dc27-8321-45d2-b654-93d17d346f8f`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:05:44,150::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:05:44,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e838267-12a8-48c0-814d-a101ab870296`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:05:44,151::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:05:44,152::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`be314586-5031-4496-be56-15ddc2d6e362`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:05:44,152::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:05:44,153::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:05:44,153::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`be314586-5031-4496-be56-15ddc2d6e362`::Granted request >Thread-7083::DEBUG::2014-07-08 17:05:44,154::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8e838267-12a8-48c0-814d-a101ab870296`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:05:44,154::task::993::Storage.TaskManager.Task::(_decref) Task=`8e838267-12a8-48c0-814d-a101ab870296`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:05:44,174::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:44,174::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e838267-12a8-48c0-814d-a101ab870296`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:44,174::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e838267-12a8-48c0-814d-a101ab870296`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:05:44,175::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:05:44,175::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:05:44,175::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:05:44,176::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:05:44,176::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:05:44,176::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:05:44,177::task::993::Storage.TaskManager.Task::(_decref) Task=`8e838267-12a8-48c0-814d-a101ab870296`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:05:44,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:44,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336744 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:05:46,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:47,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174616 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:48,196::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:48,197::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:48,198::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:05:49,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:49,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173741 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:05:51,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:51,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175244 s, 58.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:05:52,319::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-18::DEBUG::2014-07-08 17:05:52,583::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:52,583::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:52,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:52,584::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:52,584::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:52,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:52,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:52,585::__init__::225::IOProcess::(_processLogs) (274169) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:52,585::__init__::225::IOProcess::(_processLogs) (274169) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:52,585::__init__::225::IOProcess::(_processLogs) (274169) Building response >Thread-18::DEBUG::2014-07-08 17:05:52,586::__init__::225::IOProcess::(_processLogs) (274169) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:52,586::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:52,586::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:05:52,588::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:05:52,735::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000480497 s, 962 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:05:52,737::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:52,738::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:05:52,738::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:52,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:52,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:52,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:52,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:52,739::__init__::225::IOProcess::(_processLogs) (274170) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:05:52,740::__init__::225::IOProcess::(_processLogs) (274170) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:05:52,740::__init__::225::IOProcess::(_processLogs) (274170) Building response >Thread-18::DEBUG::2014-07-08 17:05:52,740::__init__::225::IOProcess::(_processLogs) (274170) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:52,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:52,741::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:05:52,743::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:52,743::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:05:52,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:52,744::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:52,744::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:52,744::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:52,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:52,745::__init__::225::IOProcess::(_processLogs) (274171) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:52,745::__init__::225::IOProcess::(_processLogs) (274171) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:52,745::__init__::225::IOProcess::(_processLogs) (274171) Building response >Thread-18::DEBUG::2014-07-08 17:05:52,745::__init__::225::IOProcess::(_processLogs) (274171) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:52,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:52,746::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:52,747::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:52,747::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:05:52,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:52,748::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:52,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:52,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:52,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:52,749::__init__::225::IOProcess::(_processLogs) (274172) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:52,749::__init__::225::IOProcess::(_processLogs) (274172) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:52,749::__init__::225::IOProcess::(_processLogs) (274172) Building response >Thread-18::DEBUG::2014-07-08 17:05:52,749::__init__::225::IOProcess::(_processLogs) (274172) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:52,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:52,750::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:05:52,751::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:52,751::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:05:52,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:52,752::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:52,752::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:52,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:52,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:52,753::__init__::225::IOProcess::(_processLogs) (274173) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:05:52,753::__init__::225::IOProcess::(_processLogs) (274173) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:05:52,753::__init__::225::IOProcess::(_processLogs) (274173) Building response >Thread-18::DEBUG::2014-07-08 17:05:52,753::__init__::225::IOProcess::(_processLogs) (274173) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:52,754::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:52,754::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:53,206::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:53,207::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:53,208::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:05:53,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:54,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0954061 s, 10.7 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:05:54,192::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:05:54,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bf21e2b-88fa-4f62-9855-9768f85196cb`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:05:54,195::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:05:54,210::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:54,210::task::1191::Storage.TaskManager.Task::(prepare) Task=`5bf21e2b-88fa-4f62-9855-9768f85196cb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:05:54,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bf21e2b-88fa-4f62-9855-9768f85196cb`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:05:54,211::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:05:54,211::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:05:54,211::task::993::Storage.TaskManager.Task::(_decref) Task=`5bf21e2b-88fa-4f62-9855-9768f85196cb`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:05:54,224::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:05:54,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`21549d70-b72a-42bb-bd4b-6bfeb1b081ff`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:05:54,226::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:05:54,229::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`919e5209-0537-4289-969f-bfa7e19de312`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:05:54,229::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:05:54,230::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:05:54,230::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`919e5209-0537-4289-969f-bfa7e19de312`::Granted request >Thread-7083::DEBUG::2014-07-08 17:05:54,231::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`21549d70-b72a-42bb-bd4b-6bfeb1b081ff`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:05:54,231::task::993::Storage.TaskManager.Task::(_decref) Task=`21549d70-b72a-42bb-bd4b-6bfeb1b081ff`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:05:54,251::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:54,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`21549d70-b72a-42bb-bd4b-6bfeb1b081ff`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:05:54,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`21549d70-b72a-42bb-bd4b-6bfeb1b081ff`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:05:54,252::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:05:54,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:05:54,253::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:05:54,253::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:05:54,253::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:05:54,254::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:05:54,254::task::993::Storage.TaskManager.Task::(_decref) Task=`21549d70-b72a-42bb-bd4b-6bfeb1b081ff`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:05:54,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`3996045b-7955-462f-8961-ae689d80c4fd`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:05:54,290::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:05:54,290::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480497', 'lastCheck': '1.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:05:54,291::task::1191::Storage.TaskManager.Task::(prepare) Task=`3996045b-7955-462f-8961-ae689d80c4fd`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480497', 'lastCheck': '1.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:05:54,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`3996045b-7955-462f-8961-ae689d80c4fd`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:05:54,291::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:05:54,291::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:05:54,291::task::993::Storage.TaskManager.Task::(_decref) Task=`3996045b-7955-462f-8961-ae689d80c4fd`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:05:54,333::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:05:56,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:56,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177088 s, 57.8 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:05:57,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`749ad79f-4e60-4d84-9c96-66003756d683`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:05:57,588::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:05:57,592::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:57,593::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:05:57,593::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:57,593::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:57,593::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:57,594::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:57,594::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:57,594::__init__::225::IOProcess::(_processLogs) (274174) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:05:57,594::__init__::225::IOProcess::(_processLogs) (274174) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:05:57,595::__init__::225::IOProcess::(_processLogs) (274174) Building response >Thread-18::DEBUG::2014-07-08 17:05:57,595::__init__::225::IOProcess::(_processLogs) (274174) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:57,595::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:57,595::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:05:57,597::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:05:57,598::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:05:57,598::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:05:57,598::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:05:57,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:05:57,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:05:57,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:05:57,599::__init__::225::IOProcess::(_processLogs) (274175) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:05:57,599::__init__::225::IOProcess::(_processLogs) (274175) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:05:57,600::__init__::225::IOProcess::(_processLogs) (274175) Building response >Thread-18::DEBUG::2014-07-08 17:05:57,600::__init__::225::IOProcess::(_processLogs) (274175) Queuing response >Thread-18::DEBUG::2014-07-08 17:05:57,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:05:57,600::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:05:57,602::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:05:57,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`749ad79f-4e60-4d84-9c96-66003756d683`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:05:57,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`749ad79f-4e60-4d84-9c96-66003756d683`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:05:57,603::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:05:57,603::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:05:57,603::task::993::Storage.TaskManager.Task::(_decref) Task=`749ad79f-4e60-4d84-9c96-66003756d683`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:05:57,697::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:05:57,698::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:58,215::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:58,217::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:05:58,218::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:05:58,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:05:58,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176551 s, 58.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:00,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:00,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174227 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:06:02,757::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:02,757::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:02,759::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:02,760::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:02,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:02,760::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:02,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:02,761::__init__::225::IOProcess::(_processLogs) (274176) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:02,761::__init__::225::IOProcess::(_processLogs) (274176) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:02,761::__init__::225::IOProcess::(_processLogs) (274176) Building response >Thread-18::DEBUG::2014-07-08 17:06:02,761::__init__::225::IOProcess::(_processLogs) (274176) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:02,762::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:02,762::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:06:02,764::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:02,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 17:06:02,914::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000455074 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:06:03,080::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:03,084::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:03,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:03,094::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:03,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:03,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:03,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:03,114::__init__::225::IOProcess::(_processLogs) (274177) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:03,119::__init__::225::IOProcess::(_processLogs) (274177) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:03,123::__init__::225::IOProcess::(_processLogs) (274177) Building response >Thread-18::DEBUG::2014-07-08 17:06:03,128::__init__::225::IOProcess::(_processLogs) (274177) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:03,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:03,135::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:06:03,158::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:03,163::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:06:03,168::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:03,240::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:03,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 17:06:03,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.096207 s, 10.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:03,254::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:06:03,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:03,263::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:03,267::__init__::225::IOProcess::(_processLogs) (274178) Finding callback 'access'... >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:03,272::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:06:03,272::__init__::225::IOProcess::(_processLogs) (274178) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:03,276::__init__::225::IOProcess::(_processLogs) (274178) Building response >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:03,281::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:06:03,281::__init__::225::IOProcess::(_processLogs) (274178) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:03,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:03,288::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:03,292::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:03,292::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:06:03,292::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:03,293::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:03,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:03,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:03,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:03,294::__init__::225::IOProcess::(_processLogs) (274179) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:03,294::__init__::225::IOProcess::(_processLogs) (274179) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:03,295::__init__::225::IOProcess::(_processLogs) (274179) Building response >Thread-18::DEBUG::2014-07-08 17:06:03,296::__init__::225::IOProcess::(_processLogs) (274179) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:03,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:03,298::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:03,301::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:03,301::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:06:03,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:03,302::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:03,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:03,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:03,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:03,303::__init__::225::IOProcess::(_processLogs) (274180) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:03,303::__init__::225::IOProcess::(_processLogs) (274180) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:03,304::__init__::225::IOProcess::(_processLogs) (274180) Building response >Thread-18::DEBUG::2014-07-08 17:06:03,305::__init__::225::IOProcess::(_processLogs) (274180) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:03,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:03,307::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:06:04,281::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:06:04,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`11b8c5dc-26ba-420c-ac69-e033d95fcaed`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:04,282::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:06:04,297::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:04,298::task::1191::Storage.TaskManager.Task::(prepare) Task=`11b8c5dc-26ba-420c-ac69-e033d95fcaed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:04,298::task::595::Storage.TaskManager.Task::(_updateState) Task=`11b8c5dc-26ba-420c-ac69-e033d95fcaed`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:04,298::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:04,299::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:04,299::task::993::Storage.TaskManager.Task::(_decref) Task=`11b8c5dc-26ba-420c-ac69-e033d95fcaed`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:06:04,318::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:06:04,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`c25bd2ac-bc4b-449f-a243-b04c76931bf1`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:06:04,319::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:06:04,324::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f46230b2-e58e-4036-a1f3-63904f842524`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:06:04,325::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:06:04,325::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:06:04,326::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f46230b2-e58e-4036-a1f3-63904f842524`::Granted request >Thread-7083::DEBUG::2014-07-08 17:06:04,326::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c25bd2ac-bc4b-449f-a243-b04c76931bf1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:06:04,327::task::993::Storage.TaskManager.Task::(_decref) Task=`c25bd2ac-bc4b-449f-a243-b04c76931bf1`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:06:04,346::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:04,346::task::1191::Storage.TaskManager.Task::(prepare) Task=`c25bd2ac-bc4b-449f-a243-b04c76931bf1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:04,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`c25bd2ac-bc4b-449f-a243-b04c76931bf1`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:06:04,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:06:04,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:06:04,348::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:06:04,348::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:06:04,348::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:06:04,348::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:06:04,349::task::993::Storage.TaskManager.Task::(_decref) Task=`c25bd2ac-bc4b-449f-a243-b04c76931bf1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:06:05,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:05,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171936 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:07,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:07,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171967 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:08,294::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:08,295::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:08,296::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:06:09,623::task::595::Storage.TaskManager.Task::(_updateState) Task=`152dc4eb-bd3a-4cbb-9368-1e6efefca036`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:09,624::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:06:09,624::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455074', 'lastCheck': '6.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:06:09,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`152dc4eb-bd3a-4cbb-9368-1e6efefca036`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455074', 'lastCheck': '6.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:06:09,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`152dc4eb-bd3a-4cbb-9368-1e6efefca036`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:09,625::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:09,625::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:09,626::task::993::Storage.TaskManager.Task::(_decref) Task=`152dc4eb-bd3a-4cbb-9368-1e6efefca036`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:06:09,661::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:09,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:10,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0942227 s, 10.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:12,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:12,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173099 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:06:12,778::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:06:12,779::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:13,304::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:13,305::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:13,306::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:06:13,312::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:13,312::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:13,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:13,313::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:13,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:13,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:13,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:13,314::__init__::225::IOProcess::(_processLogs) (274181) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:13,314::__init__::225::IOProcess::(_processLogs) (274181) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:13,314::__init__::225::IOProcess::(_processLogs) (274181) Building response >Thread-18::DEBUG::2014-07-08 17:06:13,314::__init__::225::IOProcess::(_processLogs) (274181) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:13,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:13,315::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:06:13,316::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:06:13,466::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0004791 s, 964 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:06:13,472::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:13,474::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:13,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:13,479::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:13,481::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:13,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:13,485::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:13,487::__init__::225::IOProcess::(_processLogs) (274182) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:13,488::__init__::225::IOProcess::(_processLogs) (274182) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:13,488::__init__::225::IOProcess::(_processLogs) (274182) Building response >Thread-18::DEBUG::2014-07-08 17:06:13,489::__init__::225::IOProcess::(_processLogs) (274182) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:13,490::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:13,491::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:06:13,499::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:13,500::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:06:13,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:13,503::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:13,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:13,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:13,507::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:13,508::__init__::225::IOProcess::(_processLogs) (274183) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:13,509::__init__::225::IOProcess::(_processLogs) (274183) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:13,511::__init__::225::IOProcess::(_processLogs) (274183) Building response >Thread-18::DEBUG::2014-07-08 17:06:13,512::__init__::225::IOProcess::(_processLogs) (274183) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:13,513::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:13,514::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:13,517::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:13,518::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:06:13,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:13,518::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:13,518::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:13,519::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:13,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:13,519::__init__::225::IOProcess::(_processLogs) (274184) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:13,519::__init__::225::IOProcess::(_processLogs) (274184) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:13,520::__init__::225::IOProcess::(_processLogs) (274184) Building response >Thread-18::DEBUG::2014-07-08 17:06:13,520::__init__::225::IOProcess::(_processLogs) (274184) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:13,520::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:13,520::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:13,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:13,522::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:06:13,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:13,522::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:13,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:13,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:13,524::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:13,524::__init__::225::IOProcess::(_processLogs) (274185) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:13,524::__init__::225::IOProcess::(_processLogs) (274185) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:13,524::__init__::225::IOProcess::(_processLogs) (274185) Building response >Thread-18::DEBUG::2014-07-08 17:06:13,525::__init__::225::IOProcess::(_processLogs) (274185) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:13,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:13,525::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:06:14,364::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:06:14,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`0be20625-678c-4ec1-9fb7-9aef9e75b935`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:14,366::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:06:14,380::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:14,381::task::1191::Storage.TaskManager.Task::(prepare) Task=`0be20625-678c-4ec1-9fb7-9aef9e75b935`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:14,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`0be20625-678c-4ec1-9fb7-9aef9e75b935`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:14,381::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:14,381::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:14,382::task::993::Storage.TaskManager.Task::(_decref) Task=`0be20625-678c-4ec1-9fb7-9aef9e75b935`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:06:14,393::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:06:14,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6fd3e4b-d7cf-4a3a-a439-21108ef44516`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:06:14,394::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:06:14,395::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`acbd6ba6-0a90-491d-ad18-88893050d577`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:06:14,395::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:06:14,396::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:06:14,396::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`acbd6ba6-0a90-491d-ad18-88893050d577`::Granted request >Thread-7083::DEBUG::2014-07-08 17:06:14,397::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c6fd3e4b-d7cf-4a3a-a439-21108ef44516`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:06:14,397::task::993::Storage.TaskManager.Task::(_decref) Task=`c6fd3e4b-d7cf-4a3a-a439-21108ef44516`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:06:14,416::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:14,416::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6fd3e4b-d7cf-4a3a-a439-21108ef44516`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:14,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6fd3e4b-d7cf-4a3a-a439-21108ef44516`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:06:14,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:06:14,417::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:06:14,418::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:06:14,418::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:06:14,418::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:06:14,418::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:06:14,419::task::993::Storage.TaskManager.Task::(_decref) Task=`c6fd3e4b-d7cf-4a3a-a439-21108ef44516`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:06:14,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:14,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01728 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:16,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:17,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174794 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:18,314::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:18,315::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:18,316::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:19,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:19,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0230934 s, 44.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:21,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:21,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0203353 s, 50.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:06:22,584::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:23,323::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:23,325::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:23,326::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:06:23,528::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:23,529::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:23,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:23,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:23,529::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:23,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:23,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:23,530::__init__::225::IOProcess::(_processLogs) (274186) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:23,530::__init__::225::IOProcess::(_processLogs) (274186) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:23,531::__init__::225::IOProcess::(_processLogs) (274186) Building response >Thread-18::DEBUG::2014-07-08 17:06:23,531::__init__::225::IOProcess::(_processLogs) (274186) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:23,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:23,531::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:06:23,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:06:23,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000473511 s, 976 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:06:23,683::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:23,684::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:23,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:23,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:23,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:23,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:23,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:23,686::__init__::225::IOProcess::(_processLogs) (274187) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:23,686::__init__::225::IOProcess::(_processLogs) (274187) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:23,686::__init__::225::IOProcess::(_processLogs) (274187) Building response >Thread-18::DEBUG::2014-07-08 17:06:23,686::__init__::225::IOProcess::(_processLogs) (274187) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:23,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:23,687::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:06:23,689::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:06:23,689::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:23,690::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:23,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:23,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:23,690::__init__::225::IOProcess::(_processLogs) (274188) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:23,690::__init__::225::IOProcess::(_processLogs) (274188) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:23,691::__init__::225::IOProcess::(_processLogs) (274188) Building response >Thread-18::DEBUG::2014-07-08 17:06:23,691::__init__::225::IOProcess::(_processLogs) (274188) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:23,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:23,691::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:23,692::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:06:23,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:23,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:23,693::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:23,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:23,694::__init__::225::IOProcess::(_processLogs) (274189) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:23,694::__init__::225::IOProcess::(_processLogs) (274189) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:23,694::__init__::225::IOProcess::(_processLogs) (274189) Building response >Thread-18::DEBUG::2014-07-08 17:06:23,695::__init__::225::IOProcess::(_processLogs) (274189) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:23,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:23,695::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:23,696::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:06:23,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:23,697::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:23,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:23,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:23,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:23,698::__init__::225::IOProcess::(_processLogs) (274190) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:23,698::__init__::225::IOProcess::(_processLogs) (274190) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:23,698::__init__::225::IOProcess::(_processLogs) (274190) Building response >Thread-18::DEBUG::2014-07-08 17:06:23,698::__init__::225::IOProcess::(_processLogs) (274190) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:23,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:23,699::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:06:23,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:23,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0259973 s, 39.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:06:24,433::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:06:24,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`da71fd33-840c-4f90-b607-79eb57eb11a1`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:24,435::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:06:24,450::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:24,450::task::1191::Storage.TaskManager.Task::(prepare) Task=`da71fd33-840c-4f90-b607-79eb57eb11a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:24,451::task::595::Storage.TaskManager.Task::(_updateState) Task=`da71fd33-840c-4f90-b607-79eb57eb11a1`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:24,451::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:24,451::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:24,451::task::993::Storage.TaskManager.Task::(_decref) Task=`da71fd33-840c-4f90-b607-79eb57eb11a1`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:06:24,465::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:06:24,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`776fdab0-687a-4499-bea5-9d31ad4a710a`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:06:24,467::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:06:24,468::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3aa74b66-6f21-4855-bd03-aecb6a620631`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:06:24,468::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:06:24,468::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:06:24,469::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3aa74b66-6f21-4855-bd03-aecb6a620631`::Granted request >Thread-7083::DEBUG::2014-07-08 17:06:24,469::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`776fdab0-687a-4499-bea5-9d31ad4a710a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:06:24,469::task::993::Storage.TaskManager.Task::(_decref) Task=`776fdab0-687a-4499-bea5-9d31ad4a710a`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:06:24,488::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:24,489::task::1191::Storage.TaskManager.Task::(prepare) Task=`776fdab0-687a-4499-bea5-9d31ad4a710a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:24,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`776fdab0-687a-4499-bea5-9d31ad4a710a`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:06:24,489::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:06:24,489::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:06:24,490::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:06:24,490::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:06:24,490::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:06:24,491::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:06:24,491::task::993::Storage.TaskManager.Task::(_decref) Task=`776fdab0-687a-4499-bea5-9d31ad4a710a`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:06:24,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`2673d6d6-ef81-42be-9fd8-efd8019a38dc`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:24,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:06:24,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473511', 'lastCheck': '1.1', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:06:24,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`2673d6d6-ef81-42be-9fd8-efd8019a38dc`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473511', 'lastCheck': '1.1', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:06:24,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`2673d6d6-ef81-42be-9fd8-efd8019a38dc`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:24,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:24,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:24,789::task::993::Storage.TaskManager.Task::(_decref) Task=`2673d6d6-ef81-42be-9fd8-efd8019a38dc`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:06:24,819::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:26,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:26,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0890401 s, 11.5 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:06:27,544::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [318958f7] >Thread-7087::DEBUG::2014-07-08 17:06:27,547::vm::3329::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug NIC xml: <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > <mac address="00:1a:4a:16:88:5c"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Thread-7086::DEBUG::2014-07-08 17:06:27,981::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:06:27,981::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:06:28,201::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 1 edom: 0 level: 2 message: An error occurred, but the cause is unknown >Thread-7087::ERROR::2014-07-08 17:06:28,201::vm::3334::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug failed >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 3332, in hotplugNic > self._dom.attachDevice(nicXml) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 399, in attachDevice > if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) >libvirtError: An error occurred, but the cause is unknown >Thread-7087::DEBUG::2014-07-08 17:06:28,202::BindingXMLRPC::1114::vds::(wrapper) return vmHotplugNic with {'status': {'message': 'An error occurred, but the cause is unknown', 'code': 49}} >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:28,333::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:28,334::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:28,336::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:28,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:28,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181471 s, 56.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:30,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:30,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174412 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:32,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:33,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175671 s, 58.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:33,343::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:33,345::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:33,346::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:06:33,702::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:33,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:33,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:33,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:33,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:33,703::__init__::225::IOProcess::(_processLogs) (274191) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:33,704::__init__::225::IOProcess::(_processLogs) (274191) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:33,704::__init__::225::IOProcess::(_processLogs) (274191) Building response >Thread-18::DEBUG::2014-07-08 17:06:33,704::__init__::225::IOProcess::(_processLogs) (274191) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:33,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:33,705::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:06:33,706::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:06:33,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000691131 s, 668 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:06:33,859::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:33,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:33,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:33,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:33,860::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:33,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:33,861::__init__::225::IOProcess::(_processLogs) (274192) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:33,861::__init__::225::IOProcess::(_processLogs) (274192) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:33,862::__init__::225::IOProcess::(_processLogs) (274192) Building response >Thread-18::DEBUG::2014-07-08 17:06:33,862::__init__::225::IOProcess::(_processLogs) (274192) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:33,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:33,862::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:06:33,865::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:33,865::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:06:33,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:33,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:33,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:33,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:33,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:33,867::__init__::225::IOProcess::(_processLogs) (274193) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:33,867::__init__::225::IOProcess::(_processLogs) (274193) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:33,867::__init__::225::IOProcess::(_processLogs) (274193) Building response >Thread-18::DEBUG::2014-07-08 17:06:33,868::__init__::225::IOProcess::(_processLogs) (274193) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:33,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:33,868::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:33,869::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:06:33,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:33,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:33,870::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:33,870::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:33,871::__init__::225::IOProcess::(_processLogs) (274194) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:33,871::__init__::225::IOProcess::(_processLogs) (274194) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:33,871::__init__::225::IOProcess::(_processLogs) (274194) Building response >Thread-18::DEBUG::2014-07-08 17:06:33,872::__init__::225::IOProcess::(_processLogs) (274194) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:33,872::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:33,872::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:33,873::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:06:33,874::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:33,874::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:33,874::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:33,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:33,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:33,875::__init__::225::IOProcess::(_processLogs) (274195) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:33,875::__init__::225::IOProcess::(_processLogs) (274195) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:33,875::__init__::225::IOProcess::(_processLogs) (274195) Building response >Thread-18::DEBUG::2014-07-08 17:06:33,876::__init__::225::IOProcess::(_processLogs) (274195) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:33,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:33,876::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:06:34,507::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:06:34,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b4fd882-755c-43f1-8a95-f85120da67f6`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:34,511::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:06:34,526::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:34,527::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b4fd882-755c-43f1-8a95-f85120da67f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:34,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b4fd882-755c-43f1-8a95-f85120da67f6`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:34,529::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:34,530::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:34,531::task::993::Storage.TaskManager.Task::(_decref) Task=`1b4fd882-755c-43f1-8a95-f85120da67f6`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:06:34,547::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:06:34,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f7504fd-b4d9-4ba0-ab56-02b89a5f6150`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:06:34,551::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:06:34,555::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e8351ba1-f853-41b1-b3e3-49c0f030fd52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:06:34,556::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:06:34,558::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:06:34,559::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e8351ba1-f853-41b1-b3e3-49c0f030fd52`::Granted request >Thread-7083::DEBUG::2014-07-08 17:06:34,562::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1f7504fd-b4d9-4ba0-ab56-02b89a5f6150`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:06:34,563::task::993::Storage.TaskManager.Task::(_decref) Task=`1f7504fd-b4d9-4ba0-ab56-02b89a5f6150`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:06:34,595::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:34,597::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f7504fd-b4d9-4ba0-ab56-02b89a5f6150`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:34,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f7504fd-b4d9-4ba0-ab56-02b89a5f6150`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:06:34,599::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:06:34,600::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:06:34,602::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:06:34,604::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:06:34,605::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:06:34,606::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:06:34,608::task::993::Storage.TaskManager.Task::(_decref) Task=`1f7504fd-b4d9-4ba0-ab56-02b89a5f6150`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:06:35,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:35,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0823179 s, 12.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:37,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:37,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170948 s, 59.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:38,354::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:38,355::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:38,356::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:39,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:06:40,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`100f5a4a-5c04-4d34-916f-1adb0347690e`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:40,154::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:06:40,161::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691131', 'lastCheck': '6.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:06:40,165::task::1191::Storage.TaskManager.Task::(prepare) Task=`100f5a4a-5c04-4d34-916f-1adb0347690e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691131', 'lastCheck': '6.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:06:40,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`100f5a4a-5c04-4d34-916f-1adb0347690e`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:40,173::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:40,175::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:40,179::task::993::Storage.TaskManager.Task::(_decref) Task=`100f5a4a-5c04-4d34-916f-1adb0347690e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:06:40,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101213 s, 10.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:06:40,331::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:42,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:42,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111583 s, 9.2 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:06:43,171::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:06:43,172::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:43,364::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:43,365::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:43,366::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:06:43,879::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:43,879::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:43,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:43,880::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:43,880::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:43,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:43,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:43,881::__init__::225::IOProcess::(_processLogs) (274196) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:43,881::__init__::225::IOProcess::(_processLogs) (274196) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:43,881::__init__::225::IOProcess::(_processLogs) (274196) Building response >Thread-18::DEBUG::2014-07-08 17:06:43,882::__init__::225::IOProcess::(_processLogs) (274196) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:43,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:43,882::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:06:43,884::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:06:44,032::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00043496 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:06:44,034::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:44,034::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:44,035::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:44,035::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:44,035::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:44,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:44,036::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:44,036::__init__::225::IOProcess::(_processLogs) (274197) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:44,036::__init__::225::IOProcess::(_processLogs) (274197) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:44,036::__init__::225::IOProcess::(_processLogs) (274197) Building response >Thread-18::DEBUG::2014-07-08 17:06:44,037::__init__::225::IOProcess::(_processLogs) (274197) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:44,037::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:44,037::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:06:44,039::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:44,040::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:06:44,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:44,040::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:44,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:44,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:44,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:44,041::__init__::225::IOProcess::(_processLogs) (274198) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:44,041::__init__::225::IOProcess::(_processLogs) (274198) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:44,042::__init__::225::IOProcess::(_processLogs) (274198) Building response >Thread-18::DEBUG::2014-07-08 17:06:44,042::__init__::225::IOProcess::(_processLogs) (274198) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:44,042::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:44,042::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:44,043::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:44,044::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:06:44,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:44,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:44,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:44,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:44,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:44,045::__init__::225::IOProcess::(_processLogs) (274199) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:44,045::__init__::225::IOProcess::(_processLogs) (274199) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:44,046::__init__::225::IOProcess::(_processLogs) (274199) Building response >Thread-18::DEBUG::2014-07-08 17:06:44,046::__init__::225::IOProcess::(_processLogs) (274199) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:44,046::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:44,046::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:44,047::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:44,048::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:06:44,048::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:44,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:44,048::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:44,049::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:44,049::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:44,049::__init__::225::IOProcess::(_processLogs) (274200) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:44,049::__init__::225::IOProcess::(_processLogs) (274200) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:44,050::__init__::225::IOProcess::(_processLogs) (274200) Building response >Thread-18::DEBUG::2014-07-08 17:06:44,050::__init__::225::IOProcess::(_processLogs) (274200) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:44,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:44,050::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:06:44,628::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:06:44,629::task::595::Storage.TaskManager.Task::(_updateState) Task=`efd1d035-cbac-4c46-8058-8aff36f31d5b`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:44,629::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:06:44,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:44,645::task::1191::Storage.TaskManager.Task::(prepare) Task=`efd1d035-cbac-4c46-8058-8aff36f31d5b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:44,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`efd1d035-cbac-4c46-8058-8aff36f31d5b`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:44,646::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:44,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:44,646::task::993::Storage.TaskManager.Task::(_decref) Task=`efd1d035-cbac-4c46-8058-8aff36f31d5b`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:06:44,658::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:06:44,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`0de44898-a628-452b-a1d3-ccf8b3f26b9b`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:06:44,660::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:06:44,661::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`15c3107b-7b72-4f78-8838-d56963a6e1a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:06:44,661::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:06:44,661::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:06:44,662::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`15c3107b-7b72-4f78-8838-d56963a6e1a5`::Granted request >Thread-7083::DEBUG::2014-07-08 17:06:44,662::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0de44898-a628-452b-a1d3-ccf8b3f26b9b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:06:44,663::task::993::Storage.TaskManager.Task::(_decref) Task=`0de44898-a628-452b-a1d3-ccf8b3f26b9b`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:06:44,681::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:44,682::task::1191::Storage.TaskManager.Task::(prepare) Task=`0de44898-a628-452b-a1d3-ccf8b3f26b9b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:44,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`0de44898-a628-452b-a1d3-ccf8b3f26b9b`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:06:44,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:06:44,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:06:44,683::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:06:44,683::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:06:44,684::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:06:44,684::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:06:44,684::task::993::Storage.TaskManager.Task::(_decref) Task=`0de44898-a628-452b-a1d3-ccf8b3f26b9b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:06:44,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:44,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170931 s, 59.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:46,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:47,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173772 s, 58.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:48,374::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:48,376::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:48,377::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:49,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:49,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171246 s, 59.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:06:51,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:51,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176557 s, 58.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:06:52,952::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:53,384::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:53,386::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:53,387::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:53,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:54,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173115 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:06:54,053::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:54,054::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:54,054::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:54,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:54,055::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:54,055::__init__::225::IOProcess::(_processLogs) (274201) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:54,055::__init__::225::IOProcess::(_processLogs) (274201) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:54,056::__init__::225::IOProcess::(_processLogs) (274201) Building response >Thread-18::DEBUG::2014-07-08 17:06:54,056::__init__::225::IOProcess::(_processLogs) (274201) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:54,056::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-37::DEBUG::2014-07-08 17:06:54,058::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:06:54,205::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000557598 s, 829 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:06:54,207::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:06:54,208::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:54,208::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:54,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:54,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:54,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:54,209::__init__::225::IOProcess::(_processLogs) (274202) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:06:54,209::__init__::225::IOProcess::(_processLogs) (274202) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:06:54,210::__init__::225::IOProcess::(_processLogs) (274202) Building response >Thread-18::DEBUG::2014-07-08 17:06:54,210::__init__::225::IOProcess::(_processLogs) (274202) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:54,210::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:54,210::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:06:54,213::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:54,213::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:06:54,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:54,214::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:54,214::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:54,214::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:54,214::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:54,215::__init__::225::IOProcess::(_processLogs) (274203) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:54,215::__init__::225::IOProcess::(_processLogs) (274203) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:54,215::__init__::225::IOProcess::(_processLogs) (274203) Building response >Thread-18::DEBUG::2014-07-08 17:06:54,215::__init__::225::IOProcess::(_processLogs) (274203) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:54,216::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:54,216::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:54,217::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:54,217::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:06:54,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:54,218::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:54,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:54,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:54,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:54,219::__init__::225::IOProcess::(_processLogs) (274204) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:54,219::__init__::225::IOProcess::(_processLogs) (274204) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:54,219::__init__::225::IOProcess::(_processLogs) (274204) Building response >Thread-18::DEBUG::2014-07-08 17:06:54,219::__init__::225::IOProcess::(_processLogs) (274204) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:54,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:54,220::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:06:54,221::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:54,221::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:06:54,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:54,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:54,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:54,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:54,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:54,223::__init__::225::IOProcess::(_processLogs) (274205) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:06:54,223::__init__::225::IOProcess::(_processLogs) (274205) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:06:54,223::__init__::225::IOProcess::(_processLogs) (274205) Building response >Thread-18::DEBUG::2014-07-08 17:06:54,224::__init__::225::IOProcess::(_processLogs) (274205) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:54,224::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:54,224::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:06:54,698::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:06:54,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`45f8ccf0-cb76-4e88-b656-86bb8f02c61f`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:54,700::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:06:54,715::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:54,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`45f8ccf0-cb76-4e88-b656-86bb8f02c61f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:06:54,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`45f8ccf0-cb76-4e88-b656-86bb8f02c61f`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:54,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:54,721::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:54,723::task::993::Storage.TaskManager.Task::(_decref) Task=`45f8ccf0-cb76-4e88-b656-86bb8f02c61f`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:06:54,741::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:06:54,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f65b595-30c0-4677-a70f-a9dc91253b88`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:06:54,750::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:06:54,754::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8b60fa13-b6a6-4a54-9cd8-bafb5e1cd7d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:06:54,756::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:06:54,756::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:06:54,757::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8b60fa13-b6a6-4a54-9cd8-bafb5e1cd7d1`::Granted request >Thread-7083::DEBUG::2014-07-08 17:06:54,757::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1f65b595-30c0-4677-a70f-a9dc91253b88`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:06:54,758::task::993::Storage.TaskManager.Task::(_decref) Task=`1f65b595-30c0-4677-a70f-a9dc91253b88`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:06:54,776::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:54,777::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f65b595-30c0-4677-a70f-a9dc91253b88`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:06:54,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f65b595-30c0-4677-a70f-a9dc91253b88`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:06:54,777::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:06:54,778::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:06:54,778::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:06:54,778::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:06:54,779::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:06:54,779::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:06:54,779::task::993::Storage.TaskManager.Task::(_decref) Task=`1f65b595-30c0-4677-a70f-a9dc91253b88`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:06:55,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`95289d86-cad2-467e-a3c0-0429d93640a7`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:06:55,505::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:06:55,506::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557598', 'lastCheck': '1.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:06:55,506::task::1191::Storage.TaskManager.Task::(prepare) Task=`95289d86-cad2-467e-a3c0-0429d93640a7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557598', 'lastCheck': '1.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:06:55,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`95289d86-cad2-467e-a3c0-0429d93640a7`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:06:55,507::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:06:55,507::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:06:55,507::task::993::Storage.TaskManager.Task::(_decref) Task=`95289d86-cad2-467e-a3c0-0429d93640a7`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:06:55,548::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:56,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:06:56,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175255 s, 58.4 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:06:58,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`b80d9405-3a38-4fc3-b8c8-29f9b3823920`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:06:58,269::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:06:58,271::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:58,271::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:06:58,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:58,272::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:58,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:58,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:58,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:58,273::__init__::225::IOProcess::(_processLogs) (274206) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:06:58,273::__init__::225::IOProcess::(_processLogs) (274206) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:06:58,273::__init__::225::IOProcess::(_processLogs) (274206) Building response >Thread-18::DEBUG::2014-07-08 17:06:58,274::__init__::225::IOProcess::(_processLogs) (274206) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:58,274::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:06:58,274::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:06:58,276::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:06:58,277::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:06:58,277::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:06:58,277::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:06:58,278::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:06:58,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:06:58,278::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:06:58,278::__init__::225::IOProcess::(_processLogs) (274207) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:06:58,279::__init__::225::IOProcess::(_processLogs) (274207) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:06:58,279::__init__::225::IOProcess::(_processLogs) (274207) Building response >Thread-18::DEBUG::2014-07-08 17:06:58,279::__init__::225::IOProcess::(_processLogs) (274207) Queuing response >Thread-18::DEBUG::2014-07-08 17:06:58,279::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:06:58,280::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:06:58,281::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:06:58,281::task::1191::Storage.TaskManager.Task::(prepare) Task=`b80d9405-3a38-4fc3-b8c8-29f9b3823920`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:06:58,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`b80d9405-3a38-4fc3-b8c8-29f9b3823920`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:06:58,282::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:06:58,282::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:06:58,282::task::993::Storage.TaskManager.Task::(_decref) Task=`b80d9405-3a38-4fc3-b8c8-29f9b3823920`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:06:58,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:58,463::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:58,560::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:06:58,569::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:06:58,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.132142 s, 7.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:06:58,761::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:06:58,763::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:07:00,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:01,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368618 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:07:03,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:03,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175035 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:03,581::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:03,582::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:03,583::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:07:04,228::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:04,228::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:04,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:04,229::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:04,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:04,230::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:04,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:04,230::__init__::225::IOProcess::(_processLogs) (274208) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:04,230::__init__::225::IOProcess::(_processLogs) (274208) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:04,231::__init__::225::IOProcess::(_processLogs) (274208) Building response >Thread-18::DEBUG::2014-07-08 17:07:04,231::__init__::225::IOProcess::(_processLogs) (274208) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:04,231::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:04,231::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:07:04,233::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:07:04,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000480217 s, 962 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:07:04,387::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:04,388::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:04,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:04,388::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:04,388::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:04,389::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:04,389::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:04,389::__init__::225::IOProcess::(_processLogs) (274209) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:04,390::__init__::225::IOProcess::(_processLogs) (274209) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:04,390::__init__::225::IOProcess::(_processLogs) (274209) Building response >Thread-18::DEBUG::2014-07-08 17:07:04,390::__init__::225::IOProcess::(_processLogs) (274209) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:04,390::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:04,391::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:07:04,393::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:04,393::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:07:04,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:04,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:04,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:04,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:04,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:04,395::__init__::225::IOProcess::(_processLogs) (274210) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:04,395::__init__::225::IOProcess::(_processLogs) (274210) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:04,395::__init__::225::IOProcess::(_processLogs) (274210) Building response >Thread-18::DEBUG::2014-07-08 17:07:04,396::__init__::225::IOProcess::(_processLogs) (274210) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:04,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:04,396::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:04,397::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:04,398::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:07:04,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:04,398::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:04,399::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:04,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:04,399::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:04,399::__init__::225::IOProcess::(_processLogs) (274211) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:04,400::__init__::225::IOProcess::(_processLogs) (274211) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:04,400::__init__::225::IOProcess::(_processLogs) (274211) Building response >Thread-18::DEBUG::2014-07-08 17:07:04,400::__init__::225::IOProcess::(_processLogs) (274211) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:04,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:04,401::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:04,402::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:04,402::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:07:04,402::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:04,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:04,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:04,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:04,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:04,404::__init__::225::IOProcess::(_processLogs) (274212) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:04,404::__init__::225::IOProcess::(_processLogs) (274212) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:04,404::__init__::225::IOProcess::(_processLogs) (274212) Building response >Thread-18::DEBUG::2014-07-08 17:07:04,404::__init__::225::IOProcess::(_processLogs) (274212) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:04,405::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:04,405::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:07:04,794::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:07:04,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`213d67da-a3d0-451e-85c2-ec080036e1ae`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:07:04,799::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:07:04,814::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:07:04,816::task::1191::Storage.TaskManager.Task::(prepare) Task=`213d67da-a3d0-451e-85c2-ec080036e1ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:07:04,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`213d67da-a3d0-451e-85c2-ec080036e1ae`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:07:04,817::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:07:04,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:07:04,819::task::993::Storage.TaskManager.Task::(_decref) Task=`213d67da-a3d0-451e-85c2-ec080036e1ae`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:07:04,873::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:07:04,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ac481a3-2a13-477a-aea4-e962925a8974`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:07:04,878::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:07:04,882::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3e3a8981-7f49-41db-8851-33a74aa6c6a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:07:04,884::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:07:04,886::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:07:04,887::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3e3a8981-7f49-41db-8851-33a74aa6c6a6`::Granted request >Thread-7083::DEBUG::2014-07-08 17:07:04,891::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6ac481a3-2a13-477a-aea4-e962925a8974`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:07:04,892::task::993::Storage.TaskManager.Task::(_decref) Task=`6ac481a3-2a13-477a-aea4-e962925a8974`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:07:04,926::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:04,928::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ac481a3-2a13-477a-aea4-e962925a8974`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:04,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ac481a3-2a13-477a-aea4-e962925a8974`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:07:04,930::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:07:04,931::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:07:04,933::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:07:04,934::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:07:04,935::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:07:04,936::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:07:04,938::task::993::Storage.TaskManager.Task::(_decref) Task=`6ac481a3-2a13-477a-aea4-e962925a8974`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:07:05,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:05,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040391 s, 25.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:07:05,660::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [530ccf8a] >Thread-7087::DEBUG::2014-07-08 17:07:05,667::vm::3329::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug NIC xml: <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > <mac address="00:1a:4a:16:88:5c"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Thread-7087::DEBUG::2014-07-08 17:07:06,250::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 1 edom: 0 level: 2 message: An error occurred, but the cause is unknown >Thread-7087::ERROR::2014-07-08 17:07:06,251::vm::3334::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug failed >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 3332, in hotplugNic > self._dom.attachDevice(nicXml) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 399, in attachDevice > if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) >libvirtError: An error occurred, but the cause is unknown >Thread-7087::DEBUG::2014-07-08 17:07:06,252::BindingXMLRPC::1114::vds::(wrapper) return vmHotplugNic with {'status': {'message': 'An error occurred, but the cause is unknown', 'code': 49}} >Dummy-6860::DEBUG::2014-07-08 17:07:07,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:07,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172498 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:08,591::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:08,592::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:08,594::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:07:09,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:10,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171733 s, 59.6 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:07:10,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`6967b74d-942b-422a-9a0f-e29036303b18`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:07:10,892::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:07:10,893::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480217', 'lastCheck': '6.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:07:10,893::task::1191::Storage.TaskManager.Task::(prepare) Task=`6967b74d-942b-422a-9a0f-e29036303b18`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480217', 'lastCheck': '6.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:07:10,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`6967b74d-942b-422a-9a0f-e29036303b18`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:07:10,894::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:07:10,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:07:10,894::task::993::Storage.TaskManager.Task::(_decref) Task=`6967b74d-942b-422a-9a0f-e29036303b18`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:07:10,928::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:07:12,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:12,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017321 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:13,596::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:13,597::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:13,598::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:07:13,796::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:07:13,797::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:07:14,408::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:14,408::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:14,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:14,409::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:14,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:14,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:14,410::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:14,410::__init__::225::IOProcess::(_processLogs) (274213) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:14,410::__init__::225::IOProcess::(_processLogs) (274213) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:14,410::__init__::225::IOProcess::(_processLogs) (274213) Building response >Thread-18::DEBUG::2014-07-08 17:07:14,411::__init__::225::IOProcess::(_processLogs) (274213) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:14,411::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:14,411::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:07:14,413::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:14,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 17:07:14,566::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000497258 s, 929 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:07:14,815::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:14,820::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:14,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:14,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:14,826::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:14,829::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:14,831::__init__::225::IOProcess::(_processLogs) (274214) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:14,833::__init__::225::IOProcess::(_processLogs) (274214) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:14,835::__init__::225::IOProcess::(_processLogs) (274214) Building response >Thread-18::DEBUG::2014-07-08 17:07:14,837::__init__::225::IOProcess::(_processLogs) (274214) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:14,838::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:14,840::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:07:14,922::__init__::225::IOProcess::(_processLogs) Message size is 164 >Dummy-6860::DEBUG::2014-07-08 17:07:15,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125751 s, 8.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:07:15,023::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [3d91d208] >Thread-18::DEBUG::2014-07-08 17:07:15,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::DEBUG::2014-07-08 17:07:15,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cd3b040-b754-48ad-ad1b-87bce574c101`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:07:15,031::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::INFO::2014-07-08 17:07:15,033::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:07:15,035::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:15,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:15,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:15,043::__init__::225::IOProcess::(_processLogs) (274215) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:15,044::__init__::225::IOProcess::(_processLogs) (274215) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:15,045::__init__::225::IOProcess::(_processLogs) (274215) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:15,047::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:15,048::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:15,059::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:07:15,060::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:15,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:15,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:15,064::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:15,065::__init__::225::IOProcess::(_processLogs) (274216) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:15,066::__init__::225::IOProcess::(_processLogs) (274216) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:15,101::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:15,104::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:07:15,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:15,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:15,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:15,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:15,106::__init__::225::IOProcess::(_processLogs) (274217) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:15,106::__init__::225::IOProcess::(_processLogs) (274217) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:15,106::__init__::225::IOProcess::(_processLogs) (274217) Building response >Thread-18::DEBUG::2014-07-08 17:07:15,107::__init__::225::IOProcess::(_processLogs) (274217) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:15,107::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:15,107::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::INFO::2014-07-08 17:07:15,108::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:07:15,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`5cd3b040-b754-48ad-ad1b-87bce574c101`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:07:15,111::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cd3b040-b754-48ad-ad1b-87bce574c101`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:07:15,112::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:07:15,112::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:07:15,112::task::993::Storage.TaskManager.Task::(_decref) Task=`5cd3b040-b754-48ad-ad1b-87bce574c101`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:07:15,127::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [3d91d208] >Thread-7083::DEBUG::2014-07-08 17:07:15,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`eea17f78-5e9c-4121-a225-7d1224e2f197`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:07:15,128::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:07:15,129::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a53de17f-c3b7-4788-aa41-13728134a382`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:07:15,129::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:07:15,130::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:07:15,130::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a53de17f-c3b7-4788-aa41-13728134a382`::Granted request >Thread-7083::DEBUG::2014-07-08 17:07:15,131::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`eea17f78-5e9c-4121-a225-7d1224e2f197`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:07:15,132::task::993::Storage.TaskManager.Task::(_decref) Task=`eea17f78-5e9c-4121-a225-7d1224e2f197`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:07:15,150::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:15,151::task::1191::Storage.TaskManager.Task::(prepare) Task=`eea17f78-5e9c-4121-a225-7d1224e2f197`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:15,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`eea17f78-5e9c-4121-a225-7d1224e2f197`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:07:15,152::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:07:15,152::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:07:15,152::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:07:15,153::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:07:15,153::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:07:15,153::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:07:15,153::task::993::Storage.TaskManager.Task::(_decref) Task=`eea17f78-5e9c-4121-a225-7d1224e2f197`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:07:17,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:17,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338138 s, 30.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:18,606::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:18,607::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:18,608::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:07:19,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:19,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171557 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:07:21,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:21,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173437 s, 59.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:07:23,251::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:23,615::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:23,617::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:23,618::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:07:23,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:24,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173132 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:07:24,942::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5f', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': 'c3b55d71-ae15-40fa-9085-226336138820', 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [2268db27] >Thread-7087::DEBUG::2014-07-08 17:07:24,945::vm::3329::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug NIC xml: <interface type="bridge"> > <mac address="00:1a:4a:16:88:5f"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Thread-18::DEBUG::2014-07-08 17:07:25,113::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:25,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:25,114::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:25,114::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:25,114::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:25,115::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:25,115::__init__::225::IOProcess::(_processLogs) (274218) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:25,116::__init__::225::IOProcess::(_processLogs) (274218) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:25,116::__init__::225::IOProcess::(_processLogs) (274218) Building response >Thread-18::DEBUG::2014-07-08 17:07:25,116::__init__::225::IOProcess::(_processLogs) (274218) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:25,116::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:07:25,117::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:07:25,118::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:07:25,276::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000503402 s, 918 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:07:25,276::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:07:25,282::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 17:07:25,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e3d8534-6513-4883-b0ee-56297f08cdc2`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:07:25,284::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 17:07:25,284::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:07:25,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:25,287::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:25,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:25,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:25,288::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:25,288::__init__::225::IOProcess::(_processLogs) (274219) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:25,288::__init__::225::IOProcess::(_processLogs) (274219) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:25,289::__init__::225::IOProcess::(_processLogs) (274219) Building response >Thread-18::DEBUG::2014-07-08 17:07:25,289::__init__::225::IOProcess::(_processLogs) (274219) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:25,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:25,289::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:07:25,292::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:25,292::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:07:25,292::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:25,293::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:25,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:25,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:25,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:25,294::__init__::225::IOProcess::(_processLogs) (274220) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:25,294::__init__::225::IOProcess::(_processLogs) (274220) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:25,294::__init__::225::IOProcess::(_processLogs) (274220) Building response >Thread-18::DEBUG::2014-07-08 17:07:25,294::__init__::225::IOProcess::(_processLogs) (274220) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:25,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:25,295::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:25,296::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:25,296::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:07:25,296::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:25,297::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:25,297::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:25,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:25,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:25,298::__init__::225::IOProcess::(_processLogs) (274221) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:25,298::__init__::225::IOProcess::(_processLogs) (274221) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:25,298::__init__::225::IOProcess::(_processLogs) (274221) Building response >Thread-18::DEBUG::2014-07-08 17:07:25,298::__init__::225::IOProcess::(_processLogs) (274221) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:25,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:25,299::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:25,300::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:25,300::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:07:25,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:25,301::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:25,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::INFO::2014-07-08 17:07:25,302::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:07:25,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 17:07:25,303::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e3d8534-6513-4883-b0ee-56297f08cdc2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:07:25,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e3d8534-6513-4883-b0ee-56297f08cdc2`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:07:25,305::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-7082::DEBUG::2014-07-08 17:07:25,305::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:07:25,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:07:25,307::__init__::225::IOProcess::(_processLogs) (274222) Finding callback 'access'... >Thread-7082::DEBUG::2014-07-08 17:07:25,308::task::993::Storage.TaskManager.Task::(_decref) Task=`7e3d8534-6513-4883-b0ee-56297f08cdc2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:07:25,309::__init__::225::IOProcess::(_processLogs) (274222) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:25,311::__init__::225::IOProcess::(_processLogs) (274222) Building response >Thread-18::DEBUG::2014-07-08 17:07:25,313::__init__::225::IOProcess::(_processLogs) (274222) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:25,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:25,313::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:07:25,323::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:07:25,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`a169a82c-1dd7-4b34-896d-0b593dc91f44`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:07:25,324::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:07:25,325::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b78cff32-1f0f-4ef0-8a5d-fbbe8beeb4ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:07:25,325::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:07:25,326::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:07:25,326::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b78cff32-1f0f-4ef0-8a5d-fbbe8beeb4ef`::Granted request >Thread-7083::DEBUG::2014-07-08 17:07:25,327::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a169a82c-1dd7-4b34-896d-0b593dc91f44`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:07:25,327::task::993::Storage.TaskManager.Task::(_decref) Task=`a169a82c-1dd7-4b34-896d-0b593dc91f44`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:07:25,346::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:25,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`a169a82c-1dd7-4b34-896d-0b593dc91f44`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:25,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`a169a82c-1dd7-4b34-896d-0b593dc91f44`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:07:25,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:07:25,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:07:25,348::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:07:25,348::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:07:25,348::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:07:25,349::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:07:25,349::task::993::Storage.TaskManager.Task::(_decref) Task=`a169a82c-1dd7-4b34-896d-0b593dc91f44`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:07:25,543::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 1 edom: 0 level: 2 message: An error occurred, but the cause is unknown >Thread-7087::ERROR::2014-07-08 17:07:25,551::vm::3334::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug failed >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 3332, in hotplugNic > self._dom.attachDevice(nicXml) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 399, in attachDevice > if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) >libvirtError: An error occurred, but the cause is unknown >Thread-7087::DEBUG::2014-07-08 17:07:25,553::BindingXMLRPC::1114::vds::(wrapper) return vmHotplugNic with {'status': {'message': 'An error occurred, but the cause is unknown', 'code': 49}} >Thread-7087::DEBUG::2014-07-08 17:07:26,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c3123e4-facd-4c9e-aa24-7d3a41315620`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:07:26,055::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:07:26,057::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503402', 'lastCheck': '0.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:07:26,058::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c3123e4-facd-4c9e-aa24-7d3a41315620`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503402', 'lastCheck': '0.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:07:26,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c3123e4-facd-4c9e-aa24-7d3a41315620`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:07:26,060::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:07:26,061::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:07:26,062::task::993::Storage.TaskManager.Task::(_decref) Task=`7c3123e4-facd-4c9e-aa24-7d3a41315620`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:07:26,118::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:07:26,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:26,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173255 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:07:28,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:28,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173548 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:28,652::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:28,658::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:28,662::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:07:28,848::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:07:28,848::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:07:30,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:31,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.109263 s, 9.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:07:33,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:33,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200263 s, 51.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:33,672::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:33,673::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:33,674::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-37::DEBUG::2014-07-08 17:07:35,315::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:07:35,325::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,330::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 17:07:35,333::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,335::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:35,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,339::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,340::__init__::225::IOProcess::(_processLogs) (274223) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:07:35,342::__init__::225::IOProcess::(_processLogs) (274223) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:07:35,343::__init__::225::IOProcess::(_processLogs) (274223) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,345::__init__::225::IOProcess::(_processLogs) (274223) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:35,347::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:07:35,350::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,351::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:07:35,352::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,352::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,353::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:35,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,354::__init__::225::IOProcess::(_processLogs) (274224) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:07:35,354::__init__::225::IOProcess::(_processLogs) (274224) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:07:35,355::__init__::225::IOProcess::(_processLogs) (274224) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,355::__init__::225::IOProcess::(_processLogs) (274224) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,355::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:35,356::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:07:35,358::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,360::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:07:35,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,362::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,363::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:35,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,366::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,367::__init__::225::IOProcess::(_processLogs) (274225) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:07:35,368::__init__::225::IOProcess::(_processLogs) (274225) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:07:35,369::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274225) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,371::__init__::225::IOProcess::(_processLogs) (274225) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,374::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::DEBUG::2014-07-08 17:07:35,376::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:07:35,377::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-7087::DEBUG::2014-07-08 17:07:35,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bdd5e07-9a28-4e73-8b1a-c3c14abbf707`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:07:35,386::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:07:35,388::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,394::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 17:07:35,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,400::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 17:07:35,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:07:35,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,588::__init__::225::IOProcess::(_processLogs) (274226) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:07:35,598::__init__::225::IOProcess::(_processLogs) (274226) Got request for method 'glob' >Thread-37::DEBUG::2014-07-08 17:07:35,608::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:07:35,606::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274226) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,615::__init__::225::IOProcess::(_processLogs) (274226) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:35,626::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 17:07:35,638::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,642::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 17:07:35,645::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,647::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:35,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,656::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,659::__init__::225::IOProcess::(_processLogs) (274227) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 17:07:35,663::__init__::225::IOProcess::(_processLogs) (274227) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 17:07:35,666::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274227) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,669::__init__::225::IOProcess::(_processLogs) (274227) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:35,677::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:07:35,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10858 s, 9.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 17:07:35,750::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 17:07:35,753::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,755::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 17:07:35,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,757::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,759::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:35,759::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,762::__init__::225::IOProcess::(_processLogs) (274228) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 17:07:35,763::__init__::225::IOProcess::(_processLogs) (274228) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 17:07:35,764::__init__::225::IOProcess::(_processLogs) (274228) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,765::__init__::225::IOProcess::(_processLogs) (274228) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:35,767::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 17:07:35,770::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 17:07:35,773::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,775::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 17:07:35,776::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,777::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:35,779::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,781::__init__::225::IOProcess::(_processLogs) (274229) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:35,782::__init__::225::IOProcess::(_processLogs) (274229) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:35,782::__init__::225::IOProcess::(_processLogs) (274229) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,784::__init__::225::IOProcess::(_processLogs) (274229) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:35,786::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:35,790::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,791::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 17:07:35,792::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,793::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,794::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:35,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,798::__init__::225::IOProcess::(_processLogs) (274230) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:07:35,799::__init__::225::IOProcess::(_processLogs) (274230) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:07:35,800::__init__::225::IOProcess::(_processLogs) (274230) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,802::__init__::225::IOProcess::(_processLogs) (274230) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:35,804::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 17:07:35,807::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 17:07:35,808::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 17:07:35,808::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 17:07:35,812::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,813::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:35,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,813::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:35,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,814::__init__::225::IOProcess::(_processLogs) (274231) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:35,814::__init__::225::IOProcess::(_processLogs) (274231) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:35,815::__init__::225::IOProcess::(_processLogs) (274231) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,815::__init__::225::IOProcess::(_processLogs) (274231) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,815::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:07:35,815::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:07:35,817::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::INFO::2014-07-08 17:07:35,968::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:07:35,971::task::1191::Storage.TaskManager.Task::(prepare) Task=`5bdd5e07-9a28-4e73-8b1a-c3c14abbf707`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:07:35,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bdd5e07-9a28-4e73-8b1a-c3c14abbf707`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:07:35,974::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:07:35,975::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:07:35,977::task::993::Storage.TaskManager.Task::(_decref) Task=`5bdd5e07-9a28-4e73-8b1a-c3c14abbf707`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 17:07:35,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000740579 s, 624 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:07:35,986::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:35,987::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:35,987::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:35,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:35,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:35,988::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:35,989::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:35,989::__init__::225::IOProcess::(_processLogs) (274232) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:35,989::__init__::225::IOProcess::(_processLogs) (274232) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:35,990::__init__::225::IOProcess::(_processLogs) (274232) Building response >Thread-18::DEBUG::2014-07-08 17:07:35,990::__init__::225::IOProcess::(_processLogs) (274232) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:35,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:35,991::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:07:36,001::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:36,003::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:07:36,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:36,007::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:36,008::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:36,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:36,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:36,014::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274233) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:07:36,013::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:07:36,016::__init__::225::IOProcess::(_processLogs) (274233) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:36,018::__init__::225::IOProcess::(_processLogs) (274233) Building response >Thread-18::DEBUG::2014-07-08 17:07:36,020::__init__::225::IOProcess::(_processLogs) (274233) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:36,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:36,024::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:07:36,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`938c80dd-2989-43e2-9bdf-0c7d827be404`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:07:36,028::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:07:36,034::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:36,035::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:07:36,037::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:36,038::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:07:36,037::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bf3bdf70-d827-4a61-b047-da0c1b88f0f2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:07:36,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:07:36,042::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:07:36,043::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:07:36,046::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:07:36,047::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:07:36,049::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bf3bdf70-d827-4a61-b047-da0c1b88f0f2`::Granted request >Thread-18::DEBUG::2014-07-08 17:07:36,050::__init__::225::IOProcess::(_processLogs) (274234) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:36,053::__init__::225::IOProcess::(_processLogs) (274234) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:07:36,054::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`938c80dd-2989-43e2-9bdf-0c7d827be404`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:07:36,057::__init__::225::IOProcess::(_processLogs) (274234) Building response >Thread-7083::DEBUG::2014-07-08 17:07:36,058::task::993::Storage.TaskManager.Task::(_decref) Task=`938c80dd-2989-43e2-9bdf-0c7d827be404`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:07:36,059::__init__::225::IOProcess::(_processLogs) (274234) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:36,062::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:36,066::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:36,081::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:36,083::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:07:36,086::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:36,088::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:36,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:36,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:36,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:36,100::__init__::225::IOProcess::(_processLogs) (274235) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:36,103::__init__::225::IOProcess::(_processLogs) (274235) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:36,107::__init__::225::IOProcess::(_processLogs) (274235) Building response >Thread-18::DEBUG::2014-07-08 17:07:36,110::__init__::225::IOProcess::(_processLogs) (274235) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:36,111::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:36,112::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:07:36,123::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:36,126::task::1191::Storage.TaskManager.Task::(prepare) Task=`938c80dd-2989-43e2-9bdf-0c7d827be404`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:36,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`938c80dd-2989-43e2-9bdf-0c7d827be404`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:07:36,132::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:07:36,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:07:36,144::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:07:36,148::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:07:36,150::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:07:36,152::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:07:36,155::task::993::Storage.TaskManager.Task::(_decref) Task=`938c80dd-2989-43e2-9bdf-0c7d827be404`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:07:38,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:38,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178798 s, 57.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:38,682::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:38,683::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:38,684::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:07:40,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:40,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178552 s, 57.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:07:41,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e9a8a24-5e53-4071-b867-d04edc227723`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:07:41,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:07:41,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740579', 'lastCheck': '5.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:07:41,378::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e9a8a24-5e53-4071-b867-d04edc227723`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740579', 'lastCheck': '5.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:07:41,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e9a8a24-5e53-4071-b867-d04edc227723`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:07:41,378::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:07:41,378::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:07:41,379::task::993::Storage.TaskManager.Task::(_decref) Task=`2e9a8a24-5e53-4071-b867-d04edc227723`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:07:41,412::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:07:42,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:42,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171914 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:43,692::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:43,693::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:43,694::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:07:43,906::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:07:43,906::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:07:44,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:45,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172956 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:07:46,139::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:46,139::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:46,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:46,140::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:46,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:46,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:46,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:46,141::__init__::225::IOProcess::(_processLogs) (274236) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:46,141::__init__::225::IOProcess::(_processLogs) (274236) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:46,141::__init__::225::IOProcess::(_processLogs) (274236) Building response >Thread-18::DEBUG::2014-07-08 17:07:46,142::__init__::225::IOProcess::(_processLogs) (274236) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:46,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:46,142::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:07:46,144::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:07:46,295::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:07:46,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`33928939-3040-469a-a56e-c3c7cfd5f32c`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:07:46,299::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 17:07:46,299::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000433006 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:07:46,303::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:46,303::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:46,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:46,304::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:46,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:46,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:46,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:46,305::__init__::225::IOProcess::(_processLogs) (274237) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:46,305::__init__::225::IOProcess::(_processLogs) (274237) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:46,305::__init__::225::IOProcess::(_processLogs) (274237) Building response >Thread-18::DEBUG::2014-07-08 17:07:46,305::__init__::225::IOProcess::(_processLogs) (274237) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:46,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:46,306::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:07:46,310::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:46,311::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:07:46,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:46,311::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:46,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:46,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:46,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:46,312::__init__::225::IOProcess::(_processLogs) (274238) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:46,312::__init__::225::IOProcess::(_processLogs) (274238) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:46,313::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274238) Building response >Thread-18::DEBUG::2014-07-08 17:07:46,313::__init__::225::IOProcess::(_processLogs) (274238) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:46,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:46,313::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:46,315::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:46,315::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:07:46,315::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:46,315::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:46,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::INFO::2014-07-08 17:07:46,316::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:07:46,317::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7087::DEBUG::2014-07-08 17:07:46,318::task::1191::Storage.TaskManager.Task::(prepare) Task=`33928939-3040-469a-a56e-c3c7cfd5f32c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:07:46,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`33928939-3040-469a-a56e-c3c7cfd5f32c`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:07:46,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::DEBUG::2014-07-08 17:07:46,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:07:46,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:07:46,321::__init__::225::IOProcess::(_processLogs) (274239) Finding callback 'access'... >Thread-7087::DEBUG::2014-07-08 17:07:46,322::task::993::Storage.TaskManager.Task::(_decref) Task=`33928939-3040-469a-a56e-c3c7cfd5f32c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:07:46,323::__init__::225::IOProcess::(_processLogs) (274239) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:46,325::__init__::225::IOProcess::(_processLogs) (274239) Building response >Thread-18::DEBUG::2014-07-08 17:07:46,326::__init__::225::IOProcess::(_processLogs) (274239) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:46,326::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:46,327::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:46,328::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:07:46,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:46,328::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:46,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:46,329::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:46,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:46,329::__init__::225::IOProcess::(_processLogs) (274240) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:46,330::__init__::225::IOProcess::(_processLogs) (274240) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:46,330::__init__::225::IOProcess::(_processLogs) (274240) Building response >Thread-18::DEBUG::2014-07-08 17:07:46,330::__init__::225::IOProcess::(_processLogs) (274240) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:46,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:46,331::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:07:46,338::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:07:46,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc3aeaa6-ef2a-43f2-bc8e-1ecc23de4d04`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:07:46,339::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:07:46,340::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e3276011-aef9-45df-a3b4-cb741c76e339`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:07:46,340::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:07:46,341::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:07:46,341::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e3276011-aef9-45df-a3b4-cb741c76e339`::Granted request >Thread-7083::DEBUG::2014-07-08 17:07:46,342::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dc3aeaa6-ef2a-43f2-bc8e-1ecc23de4d04`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:07:46,342::task::993::Storage.TaskManager.Task::(_decref) Task=`dc3aeaa6-ef2a-43f2-bc8e-1ecc23de4d04`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:07:46,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:46,364::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc3aeaa6-ef2a-43f2-bc8e-1ecc23de4d04`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:46,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc3aeaa6-ef2a-43f2-bc8e-1ecc23de4d04`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:07:46,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:07:46,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:07:46,371::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:07:46,373::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:07:46,374::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:07:46,375::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:07:46,378::task::993::Storage.TaskManager.Task::(_decref) Task=`dc3aeaa6-ef2a-43f2-bc8e-1ecc23de4d04`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:07:47,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:47,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174948 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:48,701::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:48,703::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:48,704::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:07:49,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:49,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174934 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:07:51,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:52,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357835 s, 28.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:07:53,631::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:53,710::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:53,712::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:53,713::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:07:54,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:54,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173272 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:07:56,333::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:56,334::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:56,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:56,334::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:56,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:56,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:56,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:56,335::__init__::225::IOProcess::(_processLogs) (274241) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:07:56,335::__init__::225::IOProcess::(_processLogs) (274241) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:07:56,336::__init__::225::IOProcess::(_processLogs) (274241) Building response >Thread-18::DEBUG::2014-07-08 17:07:56,336::__init__::225::IOProcess::(_processLogs) (274241) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:56,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:56,336::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:07:56,338::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:56,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:07:56,499::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:07:56,499::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000812372 s, 569 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:07:56,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fc746e4-a90a-427e-899e-d0291c3af395`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:07:56,683::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7087::INFO::2014-07-08 17:07:56,685::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:07:56,691::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:07:56,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:56,700::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:56,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::INFO::2014-07-08 17:07:56,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:07:56,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 17:07:56,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`b47f6a59-51ce-404a-9ae9-cc06450c1123`::moving from state init -> state preparing >Thread-7087::DEBUG::2014-07-08 17:07:56,720::task::1191::Storage.TaskManager.Task::(prepare) Task=`4fc746e4-a90a-427e-899e-d0291c3af395`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:07:56,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::DEBUG::2014-07-08 17:07:56,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fc746e4-a90a-427e-899e-d0291c3af395`::moving from state preparing -> state finished >Thread-7082::INFO::2014-07-08 17:07:56,729::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::DEBUG::2014-07-08 17:07:56,731::__init__::225::IOProcess::(_processLogs) (274242) Finding callback 'statvfs'... >Thread-7087::DEBUG::2014-07-08 17:07:56,734::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:07:56,741::__init__::225::IOProcess::(_processLogs) (274242) Got request for method 'statvfs' >Thread-7087::DEBUG::2014-07-08 17:07:56,741::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::INFO::2014-07-08 17:07:56,743::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433006', 'lastCheck': '10.4', 'valid': True}} >Thread-18::DEBUG::2014-07-08 17:07:56,747::__init__::225::IOProcess::(_processLogs) (274242) Building response >Thread-7087::DEBUG::2014-07-08 17:07:56,751::task::993::Storage.TaskManager.Task::(_decref) Task=`4fc746e4-a90a-427e-899e-d0291c3af395`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:07:56,753::task::1191::Storage.TaskManager.Task::(prepare) Task=`b47f6a59-51ce-404a-9ae9-cc06450c1123`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433006', 'lastCheck': '10.4', 'valid': True}} >Thread-18::DEBUG::2014-07-08 17:07:56,754::__init__::225::IOProcess::(_processLogs) (274242) Queuing response >Thread-7082::DEBUG::2014-07-08 17:07:56,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`b47f6a59-51ce-404a-9ae9-cc06450c1123`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:07:56,764::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 17:07:56,768::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:07:56,773::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 17:07:56,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:07:56,789::task::993::Storage.TaskManager.Task::(_decref) Task=`b47f6a59-51ce-404a-9ae9-cc06450c1123`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:07:56,793::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:07:56,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`ddde3b16-9b4c-4907-8e03-faa996931f4e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:07:56,812::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:07:56,819::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:07:56,830::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ca6df99b-e434-4d1d-9c58-6c37f84020b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:07:56,829::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:07:56,835::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:07:56,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:07:56,845::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:07:56,850::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ca6df99b-e434-4d1d-9c58-6c37f84020b8`::Granted request >Thread-18::DEBUG::2014-07-08 17:07:56,850::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:56,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:07:56,865::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ddde3b16-9b4c-4907-8e03-faa996931f4e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:07:56,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:56,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:07:56,937::task::993::Storage.TaskManager.Task::(_decref) Task=`ddde3b16-9b4c-4907-8e03-faa996931f4e`::ref 1 aborting False >Dummy-6860::DEBUG::2014-07-08 17:07:56,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.196012 s, 5.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:07:56,944::__init__::225::IOProcess::(_processLogs) (274243) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:56,951::__init__::225::IOProcess::(_processLogs) (274243) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:56,956::__init__::225::IOProcess::(_processLogs) (274243) Building response >Thread-18::DEBUG::2014-07-08 17:07:56,962::__init__::225::IOProcess::(_processLogs) (274243) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:56,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:56,974::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:07:56,998::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:57,006::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:07:57,012::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:57,017::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:57,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:57,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:57,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:57,045::__init__::225::IOProcess::(_processLogs) (274244) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:57,052::__init__::225::IOProcess::(_processLogs) (274244) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:57,054::__init__::225::IOProcess::(_processLogs) (274244) Building response >Thread-18::DEBUG::2014-07-08 17:07:57,059::__init__::225::IOProcess::(_processLogs) (274244) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:57,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::INFO::2014-07-08 17:07:57,069::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:07:57,070::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:07:57,073::task::1191::Storage.TaskManager.Task::(prepare) Task=`ddde3b16-9b4c-4907-8e03-faa996931f4e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:07:57,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`ddde3b16-9b4c-4907-8e03-faa996931f4e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:07:57,081::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:07:57,084::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:07:57,094::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:07:57,100::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:07:57,103::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:07:57,108::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:07:57,106::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:07:57,116::task::993::Storage.TaskManager.Task::(_decref) Task=`ddde3b16-9b4c-4907-8e03-faa996931f4e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:07:57,118::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:07:57,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:57,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:57,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:57,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:57,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:57,156::__init__::225::IOProcess::(_processLogs) (274245) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:07:57,160::__init__::225::IOProcess::(_processLogs) (274245) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:07:57,165::__init__::225::IOProcess::(_processLogs) DEBUG|(274245) Building response >Thread-18::DEBUG::2014-07-08 17:07:57,167::__init__::225::IOProcess::(_processLogs) (274245) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:57,170::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:57,174::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:07:57,203::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:58,719::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:58,721::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:07:58,722::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:07:58,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a6d1cd9-f85b-44ff-a01f-0770c0e47cce`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:07:58,939::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:07:58,941::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:58,941::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:07:58,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:58,942::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:58,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:58,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:58,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:58,943::__init__::225::IOProcess::(_processLogs) (274246) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:07:58,943::__init__::225::IOProcess::(_processLogs) (274246) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:07:58,943::__init__::225::IOProcess::(_processLogs) DEBUG|(274246) Building response >Thread-18::DEBUG::2014-07-08 17:07:58,944::__init__::225::IOProcess::(_processLogs) (274246) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:58,944::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:58,944::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:07:58,946::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:07:58,946::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:07:58,947::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:07:58,947::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:07:58,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:07:58,947::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:07:58,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:07:58,948::__init__::225::IOProcess::(_processLogs) (274247) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:07:58,948::__init__::225::IOProcess::(_processLogs) (274247) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:07:58,948::__init__::225::IOProcess::(_processLogs) (274247) Building response >Thread-18::DEBUG::2014-07-08 17:07:58,949::__init__::225::IOProcess::(_processLogs) (274247) Queuing response >Thread-18::DEBUG::2014-07-08 17:07:58,949::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:07:58,949::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:07:58,950::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:07:58,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a6d1cd9-f85b-44ff-a01f-0770c0e47cce`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:07:58,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a6d1cd9-f85b-44ff-a01f-0770c0e47cce`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:07:58,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:07:58,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:07:58,952::task::993::Storage.TaskManager.Task::(_decref) Task=`0a6d1cd9-f85b-44ff-a01f-0770c0e47cce`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:07:59,033::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:07:59,033::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:07:59,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:07:59,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174023 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:01,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:01,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176468 s, 58.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:03,730::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:03,732::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:03,733::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:08:03,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:04,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179658 s, 57.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:06,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:06,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0416601 s, 24.6 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:08:07,158::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:08:07,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`a085a513-1810-42d7-91b7-808481da0ff8`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:08:07,159::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:08:07,174::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:08:07,175::task::1191::Storage.TaskManager.Task::(prepare) Task=`a085a513-1810-42d7-91b7-808481da0ff8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:08:07,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`a085a513-1810-42d7-91b7-808481da0ff8`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:08:07,176::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:08:07,178::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:08:07,178::task::993::Storage.TaskManager.Task::(_decref) Task=`a085a513-1810-42d7-91b7-808481da0ff8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:08:07,184::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:07,184::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:08:07,184::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:07,185::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:07,185::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:07,185::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:07,185::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:07,186::__init__::225::IOProcess::(_processLogs) (274248) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:07,186::__init__::225::IOProcess::(_processLogs) (274248) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:07,186::__init__::225::IOProcess::(_processLogs) (274248) Building response >Thread-18::DEBUG::2014-07-08 17:08:07,186::__init__::225::IOProcess::(_processLogs) (274248) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:07,187::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:07,187::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:08:07,189::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:08:07,339::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:08:07,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000846735 s, 546 kB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:08:07,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`931e6b95-4c6d-49f9-85a7-f97f52e91a79`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:08:07,347::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:08:07,347::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:07,349::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:08:07,351::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:07,352::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:08:07,352::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1200ec2d-f496-4f24-a38e-63d78ecdfecb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:08:07,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:08:07,354::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:08:07,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:07,356::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:07,358::__init__::225::IOProcess::(_processLogs) (274249) Finding callback 'statvfs'... >Thread-7083::DEBUG::2014-07-08 17:08:07,357::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:08:07,359::__init__::225::IOProcess::(_processLogs) (274249) Got request for method 'statvfs' >Thread-7083::DEBUG::2014-07-08 17:08:07,359::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1200ec2d-f496-4f24-a38e-63d78ecdfecb`::Granted request >Thread-18::DEBUG::2014-07-08 17:08:07,360::__init__::225::IOProcess::(_processLogs) (274249) Building response >Thread-18::DEBUG::2014-07-08 17:08:07,366::__init__::225::IOProcess::(_processLogs) (274249) Queuing response >Thread-7083::DEBUG::2014-07-08 17:08:07,367::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`931e6b95-4c6d-49f9-85a7-f97f52e91a79`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:08:07,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:08:07,369::task::993::Storage.TaskManager.Task::(_decref) Task=`931e6b95-4c6d-49f9-85a7-f97f52e91a79`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:08:07,369::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:08:07,379::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:07,380::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:08:07,382::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:07,384::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:07,386::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:07,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:07,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:07,390::__init__::225::IOProcess::(_processLogs) (274250) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:07,390::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274250) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:07,391::__init__::225::IOProcess::(_processLogs) (274250) Building response >Thread-18::DEBUG::2014-07-08 17:08:07,391::__init__::225::IOProcess::(_processLogs) (274250) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:07,391::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:07,391::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:08:07,393::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:07,393::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:08:07,393::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:07,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:07,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:07,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:07,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:07,395::__init__::225::IOProcess::(_processLogs) (274251) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:07,395::__init__::225::IOProcess::(_processLogs) (274251) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:07,395::__init__::225::IOProcess::(_processLogs) (274251) Building response >Thread-18::DEBUG::2014-07-08 17:08:07,395::__init__::225::IOProcess::(_processLogs) (274251) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:07,395::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:07,396::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:08:07,397::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:07,397::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:08:07,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:07,398::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:07,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:07,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::INFO::2014-07-08 17:08:07,406::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:07,409::task::1191::Storage.TaskManager.Task::(prepare) Task=`931e6b95-4c6d-49f9-85a7-f97f52e91a79`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:08:07,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:08:07,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`931e6b95-4c6d-49f9-85a7-f97f52e91a79`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:08:07,413::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:08:07,413::__init__::225::IOProcess::(_processLogs) (274252) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:08:07,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:08:07,417::__init__::225::IOProcess::(_processLogs) (274252) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:07,421::__init__::225::IOProcess::(_processLogs) (274252) Building response >Thread-7083::DEBUG::2014-07-08 17:08:07,421::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:08:07,424::__init__::225::IOProcess::(_processLogs) (274252) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:07,427::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:08:07,427::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:08:07,430::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:08:07,430::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:08:07,432::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:08:07,438::task::993::Storage.TaskManager.Task::(_decref) Task=`931e6b95-4c6d-49f9-85a7-f97f52e91a79`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:08:08,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:08,746::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:08,754::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:08,759::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:08:08,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110917 s, 9.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:10,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:11,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170179 s, 60.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:08:12,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`62b6a149-0538-4cbf-aa97-efc8d93eb940`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:08:12,413::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:08:12,413::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000846735', 'lastCheck': '5.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:08:12,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`62b6a149-0538-4cbf-aa97-efc8d93eb940`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000846735', 'lastCheck': '5.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:08:12,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`62b6a149-0538-4cbf-aa97-efc8d93eb940`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:08:12,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:08:12,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:08:12,415::task::993::Storage.TaskManager.Task::(_decref) Task=`62b6a149-0538-4cbf-aa97-efc8d93eb940`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:08:12,470::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:08:13,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:13,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174115 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:13,769::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:13,770::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:13,771::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:08:14,277::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:08:14,279::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:08:15,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:15,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173196 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:08:17,440::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:08:17,441::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:17,441::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:17,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:17,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:17,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:17,442::__init__::225::IOProcess::(_processLogs) (274253) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:17,442::__init__::225::IOProcess::(_processLogs) (274253) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:17,443::__init__::225::IOProcess::(_processLogs) (274253) Building response >Thread-18::DEBUG::2014-07-08 17:08:17,443::__init__::225::IOProcess::(_processLogs) (274253) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:17,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:17,443::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:08:17,445::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:08:17,597::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000502846 s, 919 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:08:17,603::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:08:17,607::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:08:17,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:17,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 17:08:17,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ad5381e-4188-4766-ae65-bf3933fbb237`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:08:17,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::INFO::2014-07-08 17:08:17,619::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:08:17,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:17,625::__init__::225::IOProcess::(_processLogs) (274254) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:17,629::__init__::225::IOProcess::(_processLogs) (274254) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:17,631::__init__::225::IOProcess::(_processLogs) (274254) Building response >Thread-18::DEBUG::2014-07-08 17:08:17,633::__init__::225::IOProcess::(_processLogs) (274254) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:17,635::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:17,637::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::INFO::2014-07-08 17:08:17,638::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:08:17,641::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ad5381e-4188-4766-ae65-bf3933fbb237`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:08:17,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ad5381e-4188-4766-ae65-bf3933fbb237`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:08:17,648::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:08:17,650::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:08:17,656::task::993::Storage.TaskManager.Task::(_decref) Task=`4ad5381e-4188-4766-ae65-bf3933fbb237`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:08:17,658::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:08:17,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:17,665::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:17,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:17,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:17,672::__init__::225::IOProcess::(_processLogs) (274255) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:17,673::__init__::225::IOProcess::(_processLogs) (274255) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:17,674::__init__::225::IOProcess::(_processLogs) (274255) Building response >Thread-18::DEBUG::2014-07-08 17:08:17,675::__init__::225::IOProcess::(_processLogs) (274255) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:17,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:08:17,682::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:08:17,682::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:08:17,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fdf3e98-9446-425a-b2a2-ba310d7c1c24`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:08:17,699::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:08:17,703::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:08:17,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:08:17,707::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`eac7400b-9dec-4ff0-b4ff-d350417d2bd1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:08:17,709::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:08:17,709::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:17,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:08:17,714::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:08:17,717::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:08:17,717::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`eac7400b-9dec-4ff0-b4ff-d350417d2bd1`::Granted request >Thread-18::DEBUG::2014-07-08 17:08:17,720::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:17,723::__init__::225::IOProcess::(_processLogs) (274256) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:08:17,724::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5fdf3e98-9446-425a-b2a2-ba310d7c1c24`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:08:17,726::__init__::225::IOProcess::(_processLogs) (274256) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:08:17,726::task::993::Storage.TaskManager.Task::(_decref) Task=`5fdf3e98-9446-425a-b2a2-ba310d7c1c24`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:08:17,730::__init__::225::IOProcess::(_processLogs) (274256) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:17,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:17,737::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:08:17,746::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:08:17,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:17,759::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:17,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:17,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:17,763::__init__::225::IOProcess::(_processLogs) (274257) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:17,764::__init__::225::IOProcess::(_processLogs) (274257) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:17,766::__init__::225::IOProcess::(_processLogs) (274257) Building response >Thread-18::DEBUG::2014-07-08 17:08:17,767::__init__::225::IOProcess::(_processLogs) (274257) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:17,768::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:17,769::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:08:17,775::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:17,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fdf3e98-9446-425a-b2a2-ba310d7c1c24`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:17,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fdf3e98-9446-425a-b2a2-ba310d7c1c24`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:08:17,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:08:17,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:08:17,783::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:08:17,785::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:08:17,786::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:08:17,786::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:08:17,789::task::993::Storage.TaskManager.Task::(_decref) Task=`5fdf3e98-9446-425a-b2a2-ba310d7c1c24`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:08:17,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:18,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381952 s, 26.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:18,778::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:18,780::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:18,781::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:08:20,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:20,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173286 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:22,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:22,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455138 s, 22.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:23,788::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:23,790::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:23,791::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:08:23,992::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:08:24,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:25,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.152499 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:27,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:27,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175272 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:08:27,778::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:08:27,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:27,779::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:27,779::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:27,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:27,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:27,780::__init__::225::IOProcess::(_processLogs) (274258) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:27,781::__init__::225::IOProcess::(_processLogs) (274258) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:27,781::__init__::225::IOProcess::(_processLogs) (274258) Building response >Thread-18::DEBUG::2014-07-08 17:08:27,781::__init__::225::IOProcess::(_processLogs) (274258) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:27,781::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:27,781::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:08:27,783::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:08:27,934::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000431329 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:08:27,936::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:08:27,937::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:27,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:27,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:27,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:27,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:27,938::__init__::225::IOProcess::(_processLogs) (274259) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:27,938::__init__::225::IOProcess::(_processLogs) (274259) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:27,938::__init__::225::IOProcess::(_processLogs) (274259) Building response >Thread-18::DEBUG::2014-07-08 17:08:27,939::__init__::225::IOProcess::(_processLogs) (274259) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:27,939::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:27,939::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:08:27,941::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:27,942::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:08:27,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:27,942::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:27,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:27,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:27,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:27,943::__init__::225::IOProcess::(_processLogs) (274260) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:27,943::__init__::225::IOProcess::(_processLogs) (274260) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:27,944::__init__::225::IOProcess::(_processLogs) (274260) Building response >Thread-18::DEBUG::2014-07-08 17:08:27,944::__init__::225::IOProcess::(_processLogs) (274260) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:27,944::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:27,944::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:08:27,945::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:27,946::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:08:27,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:27,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:27,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:27,947::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:27,947::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:27,947::__init__::225::IOProcess::(_processLogs) (274261) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:27,948::__init__::225::IOProcess::(_processLogs) (274261) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:27,948::__init__::225::IOProcess::(_processLogs) (274261) Building response >Thread-18::DEBUG::2014-07-08 17:08:27,948::__init__::225::IOProcess::(_processLogs) (274261) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:27,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:27,948::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:08:27,950::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:27,950::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:08:27,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:27,950::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:27,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:27,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:27,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:27,951::__init__::225::IOProcess::(_processLogs) (274262) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:27,952::__init__::225::IOProcess::(_processLogs) (274262) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:27,952::__init__::225::IOProcess::(_processLogs) (274262) Building response >Thread-18::DEBUG::2014-07-08 17:08:27,952::__init__::225::IOProcess::(_processLogs) (274262) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:27,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:27,952::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:08:27,973::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:08:27,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1234561-ad09-4a5c-857a-31a6f14130d0`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:08:27,974::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:08:27,990::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:08:27,990::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1234561-ad09-4a5c-857a-31a6f14130d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:08:27,991::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1234561-ad09-4a5c-857a-31a6f14130d0`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:08:27,991::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:08:27,992::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:08:27,992::task::993::Storage.TaskManager.Task::(_decref) Task=`f1234561-ad09-4a5c-857a-31a6f14130d0`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:08:28,004::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:08:28,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d87836a-48c1-4b2c-92a2-f6fb96e5e92e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:08:28,005::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:08:28,006::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4e2765c1-1f5d-4731-9397-b0a7ad6e6749`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:08:28,006::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:08:28,007::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:08:28,007::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4e2765c1-1f5d-4731-9397-b0a7ad6e6749`::Granted request >Thread-7083::DEBUG::2014-07-08 17:08:28,008::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5d87836a-48c1-4b2c-92a2-f6fb96e5e92e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:08:28,008::task::993::Storage.TaskManager.Task::(_decref) Task=`5d87836a-48c1-4b2c-92a2-f6fb96e5e92e`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:08:28,028::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:28,028::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d87836a-48c1-4b2c-92a2-f6fb96e5e92e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:28,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d87836a-48c1-4b2c-92a2-f6fb96e5e92e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:08:28,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:08:28,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:08:28,029::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:08:28,030::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:08:28,030::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:08:28,030::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:08:28,031::task::993::Storage.TaskManager.Task::(_decref) Task=`5d87836a-48c1-4b2c-92a2-f6fb96e5e92e`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:08:28,100::task::595::Storage.TaskManager.Task::(_updateState) Task=`56caa0e2-2af8-4b4c-9e4c-60d13a33142b`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:08:28,100::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:08:28,101::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431329', 'lastCheck': '0.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:08:28,101::task::1191::Storage.TaskManager.Task::(prepare) Task=`56caa0e2-2af8-4b4c-9e4c-60d13a33142b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431329', 'lastCheck': '0.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:08:28,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`56caa0e2-2af8-4b4c-9e4c-60d13a33142b`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:08:28,101::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:08:28,102::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:08:28,102::task::993::Storage.TaskManager.Task::(_decref) Task=`56caa0e2-2af8-4b4c-9e4c-60d13a33142b`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:08:28,141::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:28,798::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:28,799::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:28,800::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:08:29,424::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:08:29,424::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:08:29,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:29,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175831 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:31,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:32,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176524 s, 58.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:33,802::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:33,804::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:33,806::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:08:34,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:34,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193782 s, 52.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:36,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:36,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172842 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:08:37,955::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:37,956::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:08:37,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:37,956::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:37,957::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:37,957::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:37,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:37,957::__init__::225::IOProcess::(_processLogs) (274263) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:37,957::__init__::225::IOProcess::(_processLogs) (274263) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:37,958::__init__::225::IOProcess::(_processLogs) (274263) Building response >Thread-18::DEBUG::2014-07-08 17:08:37,958::__init__::225::IOProcess::(_processLogs) (274263) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:37,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:37,958::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:08:37,960::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:08:38,113::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000470718 s, 981 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:08:38,114::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:08:38,118::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:38,121::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::DEBUG::2014-07-08 17:08:38,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`2424d042-b327-47bb-8926-9fee485ef17a`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:08:38,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:38,123::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::INFO::2014-07-08 17:08:38,123::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:08:38,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:38,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:38,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:38,126::__init__::225::IOProcess::(_processLogs) (274264) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:38,126::__init__::225::IOProcess::(_processLogs) (274264) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:38,127::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274264) Building response >Thread-18::DEBUG::2014-07-08 17:08:38,127::__init__::225::IOProcess::(_processLogs) (274264) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:38,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:38,127::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:08:38,130::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:38,130::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:08:38,130::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:38,131::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:38,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:38,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:38,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:38,132::__init__::225::IOProcess::(_processLogs) (274265) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:38,132::__init__::225::IOProcess::(_processLogs) (274265) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:38,132::__init__::225::IOProcess::(_processLogs) (274265) Building response >Thread-18::DEBUG::2014-07-08 17:08:38,132::__init__::225::IOProcess::(_processLogs) (274265) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:38,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:38,133::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:08:38,134::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:38,134::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:08:38,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:38,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:38,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:38,135::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:38,135::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:38,136::__init__::225::IOProcess::(_processLogs) (274266) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:38,136::__init__::225::IOProcess::(_processLogs) (274266) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:38,136::__init__::225::IOProcess::(_processLogs) (274266) Building response >Thread-18::DEBUG::2014-07-08 17:08:38,136::__init__::225::IOProcess::(_processLogs) (274266) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:38,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:38,137::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:08:38,138::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:38,138::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:08:38,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:38,139::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:38,139::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:38,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 17:08:38,140::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:08:38,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 17:08:38,142::task::1191::Storage.TaskManager.Task::(prepare) Task=`2424d042-b327-47bb-8926-9fee485ef17a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:08:38,143::task::595::Storage.TaskManager.Task::(_updateState) Task=`2424d042-b327-47bb-8926-9fee485ef17a`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:08:38,143::__init__::225::IOProcess::(_processLogs) (274267) Finding callback 'access'... >Thread-7082::DEBUG::2014-07-08 17:08:38,144::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:08:38,145::__init__::225::IOProcess::(_processLogs) (274267) Got request for method 'access' >Thread-7082::DEBUG::2014-07-08 17:08:38,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:08:38,147::__init__::225::IOProcess::(_processLogs) (274267) Building response >Thread-7082::DEBUG::2014-07-08 17:08:38,147::task::993::Storage.TaskManager.Task::(_decref) Task=`2424d042-b327-47bb-8926-9fee485ef17a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:08:38,148::__init__::225::IOProcess::(_processLogs) (274267) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:38,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:38,152::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:08:38,162::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:08:38,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`00305556-26e2-4e70-b42a-63f0d6fbc19f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:08:38,164::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:08:38,165::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`11969879-fea6-41c0-8be2-8efb3ed1fadd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:08:38,165::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:08:38,165::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:08:38,166::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`11969879-fea6-41c0-8be2-8efb3ed1fadd`::Granted request >Thread-7083::DEBUG::2014-07-08 17:08:38,166::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`00305556-26e2-4e70-b42a-63f0d6fbc19f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:08:38,167::task::993::Storage.TaskManager.Task::(_decref) Task=`00305556-26e2-4e70-b42a-63f0d6fbc19f`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:08:38,185::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:38,186::task::1191::Storage.TaskManager.Task::(prepare) Task=`00305556-26e2-4e70-b42a-63f0d6fbc19f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:38,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`00305556-26e2-4e70-b42a-63f0d6fbc19f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:08:38,186::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:08:38,187::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:08:38,187::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:08:38,187::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:08:38,188::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:08:38,188::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:08:38,188::task::993::Storage.TaskManager.Task::(_decref) Task=`00305556-26e2-4e70-b42a-63f0d6fbc19f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:08:38,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:38,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172884 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:38,825::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:38,831::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:38,835::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:08:40,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:41,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0907176 s, 11.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:08:43,359::task::595::Storage.TaskManager.Task::(_updateState) Task=`483fcbc1-b3f3-4268-86f7-520fecdba683`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:08:43,359::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:08:43,360::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470718', 'lastCheck': '5.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:08:43,360::task::1191::Storage.TaskManager.Task::(prepare) Task=`483fcbc1-b3f3-4268-86f7-520fecdba683`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470718', 'lastCheck': '5.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:08:43,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`483fcbc1-b3f3-4268-86f7-520fecdba683`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:08:43,361::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:08:43,361::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:08:43,361::task::993::Storage.TaskManager.Task::(_decref) Task=`483fcbc1-b3f3-4268-86f7-520fecdba683`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:08:43,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:43,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385704 s, 26.5 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:08:43,645::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:43,844::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:43,845::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:43,847::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:08:44,562::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:08:44,562::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:08:45,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:45,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172238 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:47,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:48,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176096 s, 58.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:08:48,190::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:08:48,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:48,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:48,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:48,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:48,197::__init__::225::IOProcess::(_processLogs) (274268) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:48,198::__init__::225::IOProcess::(_processLogs) (274268) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:48,199::__init__::225::IOProcess::(_processLogs) (274268) Building response >Thread-18::DEBUG::2014-07-08 17:08:48,200::__init__::225::IOProcess::(_processLogs) (274268) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:48,200::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:48,203::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 17:08:48,207::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:08:48,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`aafb30c4-b353-4033-9ab5-1684f02832e1`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:08:48,217::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 17:08:48,224::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::INFO::2014-07-08 17:08:48,378::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:08:48,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`aafb30c4-b353-4033-9ab5-1684f02832e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 17:08:48,392::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00081349 s, 568 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:08:48,392::task::595::Storage.TaskManager.Task::(_updateState) Task=`aafb30c4-b353-4033-9ab5-1684f02832e1`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:08:48,401::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:08:48,404::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::DEBUG::2014-07-08 17:08:48,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:08:48,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 17:08:48,412::task::993::Storage.TaskManager.Task::(_decref) Task=`aafb30c4-b353-4033-9ab5-1684f02832e1`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:08:48,414::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:48,419::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:48,424::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:48,428::__init__::225::IOProcess::(_processLogs) (274269) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:48,433::__init__::225::IOProcess::(_processLogs) (274269) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:48,435::__init__::225::IOProcess::(_processLogs) (274269) Building response >Thread-18::DEBUG::2014-07-08 17:08:48,438::__init__::225::IOProcess::(_processLogs) (274269) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:48,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:48,445::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:08:48,449::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:08:48,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`af27b250-0b70-4620-8cd9-046341ae2086`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:08:48,460::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:08:48,469::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`90372306-03fb-4c33-b275-a85c326104af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:08:48,470::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:08:48,474::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:08:48,476::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`90372306-03fb-4c33-b275-a85c326104af`::Granted request >Thread-18::DEBUG::2014-07-08 17:08:48,478::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:08:48,482::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af27b250-0b70-4620-8cd9-046341ae2086`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:08:48,485::task::993::Storage.TaskManager.Task::(_decref) Task=`af27b250-0b70-4620-8cd9-046341ae2086`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:08:48,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:48,495::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:48,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:48,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:48,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:48,529::__init__::225::IOProcess::(_processLogs) (274270) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:48,537::__init__::225::IOProcess::(_processLogs) (274270) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:48,543::__init__::225::IOProcess::(_processLogs) (274270) Building response >Thread-18::DEBUG::2014-07-08 17:08:48,550::__init__::225::IOProcess::(_processLogs) (274270) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:48,560::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:48,563::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:08:48,568::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:48,572::task::1191::Storage.TaskManager.Task::(prepare) Task=`af27b250-0b70-4620-8cd9-046341ae2086`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:48,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`af27b250-0b70-4620-8cd9-046341ae2086`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:08:48,580::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:08:48,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:08:48,581::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:08:48,587::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:48,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:08:48,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:08:48,594::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:48,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:48,601::__init__::225::IOProcess::(_processLogs) (274271) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:08:48,603::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:08:48,605::__init__::225::IOProcess::(_processLogs) (274271) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:48,609::__init__::225::IOProcess::(_processLogs) (274271) Building response >Thread-18::DEBUG::2014-07-08 17:08:48,612::__init__::225::IOProcess::(_processLogs) (274271) Queuing response >Thread-7083::DEBUG::2014-07-08 17:08:48,614::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:08:48,617::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:48,621::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:08:48,619::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:08:48,626::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:08:48,633::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:08:48,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:48,640::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:08:48,638::task::993::Storage.TaskManager.Task::(_decref) Task=`af27b250-0b70-4620-8cd9-046341ae2086`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:08:48,643::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:48,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:48,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:48,655::__init__::225::IOProcess::(_processLogs) (274272) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:48,659::__init__::225::IOProcess::(_processLogs) (274272) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:48,662::__init__::225::IOProcess::(_processLogs) (274272) Building response >Thread-18::DEBUG::2014-07-08 17:08:48,666::__init__::225::IOProcess::(_processLogs) (274272) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:48,670::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:48,674::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:48,852::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:48,853::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:48,854::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:08:50,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:51,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176007 s, 58.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:53,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:53,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175322 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:53,861::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:53,863::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:53,864::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:08:54,387::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:08:55,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:55,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172196 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:08:57,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:08:57,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047649 s, 21.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:08:58,682::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:08:58,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:58,682::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:58,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:58,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:58,683::__init__::225::IOProcess::(_processLogs) (274273) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:08:58,683::__init__::225::IOProcess::(_processLogs) (274273) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:08:58,684::__init__::225::IOProcess::(_processLogs) (274273) Building response >Thread-18::DEBUG::2014-07-08 17:08:58,684::__init__::225::IOProcess::(_processLogs) (274273) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:58,684::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:58,684::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:08:58,686::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:08:58,849::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000523796 s, 882 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:08:58,856::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:08:58,867::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::DEBUG::2014-07-08 17:08:58,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`7df72d47-81ff-4018-879d-d5c4a15cf231`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:08:58,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:58,880::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:08:58,886::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::INFO::2014-07-08 17:08:58,886::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::DEBUG::2014-07-08 17:08:58,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`2839b11a-8c12-4468-ab31-d84d99d18802`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:08:58,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::INFO::2014-07-08 17:08:58,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:58,908::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::INFO::2014-07-08 17:08:58,915::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081349', 'lastCheck': '10.2', 'valid': True}} >Thread-18::DEBUG::2014-07-08 17:08:58,912::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7087::DEBUG::2014-07-08 17:08:58,918::task::1191::Storage.TaskManager.Task::(prepare) Task=`2839b11a-8c12-4468-ab31-d84d99d18802`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081349', 'lastCheck': '10.2', 'valid': True}} >Thread-7082::INFO::2014-07-08 17:08:58,920::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:08:58,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::DEBUG::2014-07-08 17:08:58,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`2839b11a-8c12-4468-ab31-d84d99d18802`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:08:58,930::task::1191::Storage.TaskManager.Task::(prepare) Task=`7df72d47-81ff-4018-879d-d5c4a15cf231`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:08:58,932::__init__::225::IOProcess::(_processLogs) (274274) Finding callback 'statvfs'... >GuestMonitor-vm1::DEBUG::2014-07-08 17:08:58,933::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:08:58,934::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:08:58,938::__init__::225::IOProcess::(_processLogs) (274274) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 17:08:58,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`7df72d47-81ff-4018-879d-d5c4a15cf231`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:08:58,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:08:58,945::__init__::225::IOProcess::(_processLogs) (274274) Building response >Thread-7082::DEBUG::2014-07-08 17:08:58,946::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:08:58,951::task::993::Storage.TaskManager.Task::(_decref) Task=`2839b11a-8c12-4468-ab31-d84d99d18802`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:08:58,954::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:08:58,955::__init__::225::IOProcess::(_processLogs) (274274) Queuing response >Thread-7082::DEBUG::2014-07-08 17:08:58,958::task::993::Storage.TaskManager.Task::(_decref) Task=`7df72d47-81ff-4018-879d-d5c4a15cf231`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:08:58,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:58,965::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:08:58,980::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:08:58,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:58,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:58,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:58,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:58,988::__init__::225::IOProcess::(_processLogs) (274275) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:58,992::__init__::225::IOProcess::(_processLogs) (274275) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:08:58,995::__init__::225::IOProcess::(_processLogs) (274275) Building response >Thread-18::DEBUG::2014-07-08 17:08:58,998::__init__::225::IOProcess::(_processLogs) (274275) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:59,002::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:08:59,002::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:08:59,006::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:08:59,018::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::DEBUG::2014-07-08 17:08:59,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5824084-b5e9-4e73-b486-66a0d73d16db`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:08:59,023::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:59,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::INFO::2014-07-08 17:08:59,027::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:08:59,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:59,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:59,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:59,044::__init__::225::IOProcess::(_processLogs) (274276) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:59,048::__init__::225::IOProcess::(_processLogs) (274276) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:08:59,047::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`210aea1f-d35a-4214-8177-fc3e58afae8d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:08:59,052::__init__::225::IOProcess::(_processLogs) (274276) Building response >Thread-7083::DEBUG::2014-07-08 17:08:59,054::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:08:59,055::__init__::225::IOProcess::(_processLogs) (274276) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:59,060::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:59,063::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:08:59,064::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:08:59,072::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`210aea1f-d35a-4214-8177-fc3e58afae8d`::Granted request >Thread-18::DEBUG::2014-07-08 17:08:59,076::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:59,082::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:08:59,086::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:08:59,087::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b5824084-b5e9-4e73-b486-66a0d73d16db`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:08:59,090::task::993::Storage.TaskManager.Task::(_decref) Task=`b5824084-b5e9-4e73-b486-66a0d73d16db`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:08:59,090::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:59,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:59,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:59,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:59,107::__init__::225::IOProcess::(_processLogs) (274277) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:08:59,110::__init__::225::IOProcess::(_processLogs) (274277) Got request for method 'access' >Thread-7087::DEBUG::2014-07-08 17:08:59,121::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:08:59,122::__init__::225::IOProcess::(_processLogs) (274277) Building response >Thread-18::DEBUG::2014-07-08 17:08:59,137::__init__::225::IOProcess::(_processLogs) (274277) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:59,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:59,148::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:08:59,161::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:59,162::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5824084-b5e9-4e73-b486-66a0d73d16db`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:08:59,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5824084-b5e9-4e73-b486-66a0d73d16db`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:08:59,165::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:08:59,166::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:08:59,168::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:08:59,170::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:08:59,171::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:08:59,172::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:08:59,174::task::993::Storage.TaskManager.Task::(_decref) Task=`b5824084-b5e9-4e73-b486-66a0d73d16db`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:08:59,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`88ebe0a1-97c6-4816-94a1-feef1b6dbd34`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:08:59,583::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:08:59,584::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:59,585::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:08:59,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:59,585::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:59,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:59,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:59,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:59,586::__init__::225::IOProcess::(_processLogs) (274278) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:08:59,587::__init__::225::IOProcess::(_processLogs) (274278) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:08:59,587::__init__::225::IOProcess::(_processLogs) (274278) Building response >Thread-18::DEBUG::2014-07-08 17:08:59,587::__init__::225::IOProcess::(_processLogs) (274278) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:59,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:59,588::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:08:59,589::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:08:59,590::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:08:59,590::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:08:59,590::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:08:59,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:08:59,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:08:59,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:08:59,591::__init__::225::IOProcess::(_processLogs) (274279) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:08:59,591::__init__::225::IOProcess::(_processLogs) (274279) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:08:59,592::__init__::225::IOProcess::(_processLogs) (274279) Building response >Thread-18::DEBUG::2014-07-08 17:08:59,592::__init__::225::IOProcess::(_processLogs) (274279) Queuing response >Thread-18::DEBUG::2014-07-08 17:08:59,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:08:59,592::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:08:59,593::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:08:59,594::task::1191::Storage.TaskManager.Task::(prepare) Task=`88ebe0a1-97c6-4816-94a1-feef1b6dbd34`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:08:59,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`88ebe0a1-97c6-4816-94a1-feef1b6dbd34`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:08:59,594::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:08:59,594::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:08:59,595::task::993::Storage.TaskManager.Task::(_decref) Task=`88ebe0a1-97c6-4816-94a1-feef1b6dbd34`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:08:59,677::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:08:59,677::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:08:59,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:00,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173624 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:09:02,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:02,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175272 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:03,954::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:03,955::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:03,957::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:09:04,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:04,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177557 s, 57.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:09:06,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:07,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172241 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:08,964::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:08,966::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:08,967::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:09:09,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:09:09,266::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:09:09,268::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:09,276::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 17:09:09,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`88e8f32a-7521-448c-8cdc-dec3aef912e4`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:09:09,280::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::INFO::2014-07-08 17:09:09,286::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:09:09,288::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:09,292::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:09,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:09,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:09,300::__init__::225::IOProcess::(_processLogs) (274280) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:09:09,301::__init__::225::IOProcess::(_processLogs) (274280) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:09,303::__init__::225::IOProcess::(_processLogs) (274280) Building response >Thread-7087::INFO::2014-07-08 17:09:09,306::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:09:09,308::__init__::225::IOProcess::(_processLogs) (274280) Queuing response >Thread-7087::DEBUG::2014-07-08 17:09:09,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`88e8f32a-7521-448c-8cdc-dec3aef912e4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:09:09,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`88e8f32a-7521-448c-8cdc-dec3aef912e4`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:09:09,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:09:09,318::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:09:09,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::DEBUG::2014-07-08 17:09:09,321::task::993::Storage.TaskManager.Task::(_decref) Task=`88e8f32a-7521-448c-8cdc-dec3aef912e4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:09:09,326::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:09:09,344::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:09:09,503::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:09:09,506::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000573243 s, 806 kB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:09:09,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`9047dcbc-81d4-425b-9850-82aa0d073a72`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:09:09,523::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:09:09,523::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:09:09,533::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5192e709-9a32-487b-b660-05b712c73fcf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:09:09,532::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7083::DEBUG::2014-07-08 17:09:09,540::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:09:09,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:09:09,547::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:09:09,552::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5192e709-9a32-487b-b660-05b712c73fcf`::Granted request >Thread-18::DEBUG::2014-07-08 17:09:09,552::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:09,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:09:09,568::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9047dcbc-81d4-425b-9850-82aa0d073a72`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:09:09,571::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:09:09,572::task::993::Storage.TaskManager.Task::(_decref) Task=`9047dcbc-81d4-425b-9850-82aa0d073a72`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:09:09,576::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:09,580::__init__::225::IOProcess::(_processLogs) (274281) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:09:09,588::__init__::225::IOProcess::(_processLogs) (274281) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:09,657::__init__::225::IOProcess::(_processLogs) DEBUG|(274281) Building response >Dummy-6860::DEBUG::2014-07-08 17:09:09,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.323002 s, 3.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:09:09,662::__init__::225::IOProcess::(_processLogs) (274281) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:09,668::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:09,672::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:09:09,697::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:09,701::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:09:09,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:09,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:09,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:09,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:09,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:09,711::__init__::225::IOProcess::(_processLogs) (274282) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:09,712::__init__::225::IOProcess::(_processLogs) (274282) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:09,713::__init__::225::IOProcess::(_processLogs) DEBUG|(274282) Building response >Thread-18::DEBUG::2014-07-08 17:09:09,715::__init__::225::IOProcess::(_processLogs) (274282) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:09,716::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::INFO::2014-07-08 17:09:09,719::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:09:09,722::task::1191::Storage.TaskManager.Task::(prepare) Task=`9047dcbc-81d4-425b-9850-82aa0d073a72`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:09:09,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`9047dcbc-81d4-425b-9850-82aa0d073a72`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:09:09,722::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:09:09,726::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:09:09,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:09:09,732::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:09:09,736::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:09:09,739::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:09:09,744::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:09:09,747::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:09,751::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::DEBUG::2014-07-08 17:09:09,756::task::993::Storage.TaskManager.Task::(_decref) Task=`9047dcbc-81d4-425b-9850-82aa0d073a72`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:09:09,761::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:09,771::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:09,779::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:09,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:09,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:09,794::__init__::225::IOProcess::(_processLogs) (274283) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:09,796::__init__::225::IOProcess::(_processLogs) (274283) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:09,799::__init__::225::IOProcess::(_processLogs) (274283) Building response >Thread-18::DEBUG::2014-07-08 17:09:09,801::__init__::225::IOProcess::(_processLogs) (274283) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:09,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:09,805::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:09:09,816::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:09,820::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:09:09,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:09,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:09,829::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:09,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:09,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:09,837::__init__::225::IOProcess::(_processLogs) (274284) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:09,840::__init__::225::IOProcess::(_processLogs) (274284) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:09,843::__init__::225::IOProcess::(_processLogs) DEBUG|(274284) Building response >Thread-18::DEBUG::2014-07-08 17:09:09,845::__init__::225::IOProcess::(_processLogs) (274284) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:09,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:09,850::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:09:11,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:12,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409151 s, 25.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:13,975::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:13,976::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:13,977::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:09:14,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:09:14,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`b04a2291-4e36-4ed7-84ed-cf39a0f2737b`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:09:14,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:09:14,474::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573243', 'lastCheck': '4.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:09:14,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`b04a2291-4e36-4ed7-84ed-cf39a0f2737b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573243', 'lastCheck': '4.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:09:14,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`b04a2291-4e36-4ed7-84ed-cf39a0f2737b`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:09:14,478::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:09:14,479::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:09:14,481::task::993::Storage.TaskManager.Task::(_decref) Task=`b04a2291-4e36-4ed7-84ed-cf39a0f2737b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:09:14,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473682 s, 21.6 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:09:14,602::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:09:14,712::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:09:14,713::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:09:16,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:16,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171607 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:09:18,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:19,166::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:19,169::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:19,170::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:09:19,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017466 s, 58.6 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:09:19,811::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:09:19,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`12355931-d3a9-4c54-81c4-a31d7733a31d`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:09:19,812::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:09:19,837::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:09:19,837::task::1191::Storage.TaskManager.Task::(prepare) Task=`12355931-d3a9-4c54-81c4-a31d7733a31d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:09:19,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`12355931-d3a9-4c54-81c4-a31d7733a31d`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:09:19,838::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:09:19,838::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:09:19,838::task::993::Storage.TaskManager.Task::(_decref) Task=`12355931-d3a9-4c54-81c4-a31d7733a31d`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:09:19,853::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:09:19,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2dd1559-70e5-4629-862e-9392a84f297b`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:09:19,854::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:09:19,855::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`83f8a745-c79c-430a-8c71-3c6d1402c3a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:09:19,855::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:09:19,856::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:09:19,856::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`83f8a745-c79c-430a-8c71-3c6d1402c3a5`::Granted request >Thread-7083::DEBUG::2014-07-08 17:09:19,857::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a2dd1559-70e5-4629-862e-9392a84f297b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:09:19,857::task::993::Storage.TaskManager.Task::(_decref) Task=`a2dd1559-70e5-4629-862e-9392a84f297b`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:09:19,861::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:19,862::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:09:19,864::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:19,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:19,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:19,869::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:19,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:19,872::__init__::225::IOProcess::(_processLogs) (274285) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:09:19,874::__init__::225::IOProcess::(_processLogs) (274285) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:19,876::__init__::225::IOProcess::(_processLogs) (274285) Building response >Thread-18::DEBUG::2014-07-08 17:09:19,878::__init__::225::IOProcess::(_processLogs) (274285) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:19,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:19,879::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:09:19,881::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:09:20,032::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000611795 s, 755 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:09:20,042::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:20,043::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:09:20,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 17:09:20,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:09:20,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:20,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:09:20,053::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2dd1559-70e5-4629-862e-9392a84f297b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:09:20,056::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:09:20,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2dd1559-70e5-4629-862e-9392a84f297b`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:09:20,060::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:09:20,060::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:09:20,062::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:09:20,064::__init__::225::IOProcess::(_processLogs) (274286) Finding callback 'statvfs'... >Thread-7083::DEBUG::2014-07-08 17:09:20,068::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:09:20,068::__init__::225::IOProcess::(_processLogs) (274286) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:20,080::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274286) Building response >Thread-7083::DEBUG::2014-07-08 17:09:20,081::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:09:20,083::__init__::225::IOProcess::(_processLogs) (274286) Queuing response >Thread-7083::DEBUG::2014-07-08 17:09:20,084::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:09:20,087::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:09:20,087::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:09:20,090::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:09:20,094::task::993::Storage.TaskManager.Task::(_decref) Task=`a2dd1559-70e5-4629-862e-9392a84f297b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:09:20,111::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:20,113::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:09:20,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:20,116::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:20,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:20,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:20,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:20,123::__init__::225::IOProcess::(_processLogs) (274287) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:20,124::__init__::225::IOProcess::(_processLogs) (274287) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:20,126::__init__::225::IOProcess::(_processLogs) (274287) Building response >Thread-18::DEBUG::2014-07-08 17:09:20,127::__init__::225::IOProcess::(_processLogs) (274287) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:20,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:20,131::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:09:20,136::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:20,138::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:09:20,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:20,141::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:20,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:20,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:20,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:20,148::__init__::225::IOProcess::(_processLogs) (274288) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:20,153::__init__::225::IOProcess::(_processLogs) (274288) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:20,155::__init__::225::IOProcess::(_processLogs) (274288) Building response >Thread-18::DEBUG::2014-07-08 17:09:20,156::__init__::225::IOProcess::(_processLogs) (274288) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:20,158::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:20,159::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:09:20,164::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:20,165::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:09:20,166::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:20,168::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:20,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:20,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:20,172::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:20,173::__init__::225::IOProcess::(_processLogs) (274289) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:20,174::__init__::225::IOProcess::(_processLogs) (274289) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:20,176::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274289) Building response >Thread-18::DEBUG::2014-07-08 17:09:20,177::__init__::225::IOProcess::(_processLogs) (274289) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:20,179::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:20,181::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:09:21,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:21,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174928 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:09:23,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:23,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175982 s, 58.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:24,264::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:24,267::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:24,268::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:09:24,686::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:09:25,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:26,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173702 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:09:28,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:28,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185198 s, 55.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:29,276::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:29,277::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:29,279::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:09:29,792::task::595::Storage.TaskManager.Task::(_updateState) Task=`39b556c4-8ca8-4610-b1ee-13ed7c40f3b9`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:09:29,793::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:09:29,801::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611795', 'lastCheck': '9.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:09:29,801::task::1191::Storage.TaskManager.Task::(prepare) Task=`39b556c4-8ca8-4610-b1ee-13ed7c40f3b9`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611795', 'lastCheck': '9.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:09:29,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`39b556c4-8ca8-4610-b1ee-13ed7c40f3b9`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:09:29,802::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:09:29,802::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:09:29,803::task::993::Storage.TaskManager.Task::(_decref) Task=`39b556c4-8ca8-4610-b1ee-13ed7c40f3b9`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:09:29,822::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:09:29,822::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:09:29,872::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:09:30,126::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:09:30,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`8faef87a-64c7-4758-bc7e-4fb9321b11ac`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:09:30,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:09:30,158::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:09:30,158::task::1191::Storage.TaskManager.Task::(prepare) Task=`8faef87a-64c7-4758-bc7e-4fb9321b11ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:09:30,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`8faef87a-64c7-4758-bc7e-4fb9321b11ac`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:09:30,159::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:09:30,159::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:09:30,159::task::993::Storage.TaskManager.Task::(_decref) Task=`8faef87a-64c7-4758-bc7e-4fb9321b11ac`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:09:30,174::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:09:30,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9800a12-c82b-4c3b-bd5b-c8fbe6721ff5`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:09:30,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:09:30,176::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`47680519-e121-4472-bfdb-cb513d4c4558`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:09:30,176::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:09:30,177::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:09:30,177::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`47680519-e121-4472-bfdb-cb513d4c4558`::Granted request >Thread-7083::DEBUG::2014-07-08 17:09:30,178::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f9800a12-c82b-4c3b-bd5b-c8fbe6721ff5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:09:30,178::task::993::Storage.TaskManager.Task::(_decref) Task=`f9800a12-c82b-4c3b-bd5b-c8fbe6721ff5`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:09:30,186::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:30,187::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:09:30,187::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:30,187::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:30,188::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:30,188::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:30,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:30,188::__init__::225::IOProcess::(_processLogs) (274290) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:09:30,188::__init__::225::IOProcess::(_processLogs) (274290) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:30,189::__init__::225::IOProcess::(_processLogs) (274290) Building response >Thread-18::DEBUG::2014-07-08 17:09:30,189::__init__::225::IOProcess::(_processLogs) (274290) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:30,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:30,189::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:09:30,191::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::INFO::2014-07-08 17:09:30,349::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Dummy-6860::DEBUG::2014-07-08 17:09:30,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 17:09:30,353::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000715436 s, 646 kB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:09:30,517::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9800a12-c82b-4c3b-bd5b-c8fbe6721ff5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:09:30,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9800a12-c82b-4c3b-bd5b-c8fbe6721ff5`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:09:30,533::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:09:30,535::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:09:30,543::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7083::DEBUG::2014-07-08 17:09:30,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:09:30,552::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:09:30,559::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:09:30,563::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:09:30,570::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:09:30,572::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:09:30,576::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:09:30,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:09:30,582::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:09:30,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:09:30,595::task::993::Storage.TaskManager.Task::(_decref) Task=`f9800a12-c82b-4c3b-bd5b-c8fbe6721ff5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:09:30,598::__init__::225::IOProcess::(_processLogs) (274291) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:09:30,607::__init__::225::IOProcess::(_processLogs) (274291) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:30,621::__init__::225::IOProcess::(_processLogs) (274291) Building response >Thread-18::DEBUG::2014-07-08 17:09:30,632::__init__::225::IOProcess::(_processLogs) (274291) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:30,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:30,650::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:09:30,688::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:09:30,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:30,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:30,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:30,711::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:30,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 17:09:30,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.186119 s, 5.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:09:30,787::__init__::225::IOProcess::(_processLogs) (274292) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:30,793::__init__::225::IOProcess::(_processLogs) (274292) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:30,800::__init__::225::IOProcess::(_processLogs) (274292) Building response >Thread-18::DEBUG::2014-07-08 17:09:30,803::__init__::225::IOProcess::(_processLogs) (274292) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:30,806::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:30,810::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:09:30,821::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:09:30,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:30,828::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:30,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:30,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:30,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:30,839::__init__::225::IOProcess::(_processLogs) (274293) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:30,842::__init__::225::IOProcess::(_processLogs) (274293) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:30,845::__init__::225::IOProcess::(_processLogs) (274293) Building response >Thread-18::DEBUG::2014-07-08 17:09:30,848::__init__::225::IOProcess::(_processLogs) (274293) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:30,851::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:30,854::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:09:30,866::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:09:30,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:30,874::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:30,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:30,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:30,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:30,885::__init__::225::IOProcess::(_processLogs) (274294) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:30,890::__init__::225::IOProcess::(_processLogs) (274294) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:30,895::__init__::225::IOProcess::(_processLogs) (274294) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:30,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:30,901::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:09:33,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:33,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175806 s, 58.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:34,286::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:34,288::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:34,289::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:09:35,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:35,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037798 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:09:37,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:37,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171643 s, 59.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:39,296::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:39,298::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:39,299::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:09:39,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:40,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172523 s, 59.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:09:40,690::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:09:40,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`783cad44-332b-4f16-af72-a97bb1045162`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:09:40,692::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:09:40,707::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:09:40,708::task::1191::Storage.TaskManager.Task::(prepare) Task=`783cad44-332b-4f16-af72-a97bb1045162`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:09:40,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`783cad44-332b-4f16-af72-a97bb1045162`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:09:40,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:09:40,708::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:09:40,709::task::993::Storage.TaskManager.Task::(_decref) Task=`783cad44-332b-4f16-af72-a97bb1045162`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:09:40,734::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:09:40,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ab2aff0-a9cd-4dbe-9986-187730d688e7`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:09:40,735::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:09:40,736::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7186064f-1eda-412d-9990-a3de0d99451e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:09:40,736::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:09:40,737::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:09:40,737::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7186064f-1eda-412d-9990-a3de0d99451e`::Granted request >Thread-7083::DEBUG::2014-07-08 17:09:40,738::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0ab2aff0-a9cd-4dbe-9986-187730d688e7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:09:40,738::task::993::Storage.TaskManager.Task::(_decref) Task=`0ab2aff0-a9cd-4dbe-9986-187730d688e7`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:09:40,757::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:09:40,758::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ab2aff0-a9cd-4dbe-9986-187730d688e7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:09:40,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ab2aff0-a9cd-4dbe-9986-187730d688e7`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:09:40,758::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:09:40,759::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:09:40,759::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:09:40,759::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:09:40,760::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:09:40,760::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:09:40,760::task::993::Storage.TaskManager.Task::(_decref) Task=`0ab2aff0-a9cd-4dbe-9986-187730d688e7`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:09:40,912::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:09:40,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:40,916::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:40,917::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:40,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:40,922::__init__::225::IOProcess::(_processLogs) (274295) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:09:40,924::__init__::225::IOProcess::(_processLogs) (274295) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:40,926::__init__::225::IOProcess::(_processLogs) (274295) Building response >Thread-18::DEBUG::2014-07-08 17:09:40,928::__init__::225::IOProcess::(_processLogs) (274295) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:40,930::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:40,932::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:09:40,936::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:09:41,086::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000434681 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:09:41,098::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:09:41,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:41,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:41,111::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:41,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:41,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:41,121::__init__::225::IOProcess::(_processLogs) (274296) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:09:41,125::__init__::225::IOProcess::(_processLogs) (274296) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:41,129::__init__::225::IOProcess::(_processLogs) (274296) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:41,135::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:41,136::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:09:41,145::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:09:41,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:41,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:41,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:41,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:41,147::__init__::225::IOProcess::(_processLogs) (274297) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:41,147::__init__::225::IOProcess::(_processLogs) (274297) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:41,147::__init__::225::IOProcess::(_processLogs) (274297) Building response >Thread-18::DEBUG::2014-07-08 17:09:41,148::__init__::225::IOProcess::(_processLogs) (274297) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:41,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:41,149::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:09:41,156::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:09:41,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:41,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:41,157::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:41,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:41,158::__init__::225::IOProcess::(_processLogs) (274298) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:41,158::__init__::225::IOProcess::(_processLogs) (274298) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:41,159::__init__::225::IOProcess::(_processLogs) (274298) Building response >Thread-18::DEBUG::2014-07-08 17:09:41,159::__init__::225::IOProcess::(_processLogs) (274298) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:41,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:41,160::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:09:41,164::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:09:41,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:41,166::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:41,168::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:41,169::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:41,171::__init__::225::IOProcess::(_processLogs) (274299) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:41,172::__init__::225::IOProcess::(_processLogs) (274299) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:41,173::__init__::225::IOProcess::(_processLogs) (274299) Building response >Thread-18::DEBUG::2014-07-08 17:09:41,175::__init__::225::IOProcess::(_processLogs) (274299) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:41,176::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:41,178::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:09:42,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:42,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172691 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:44,303::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:44,304::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:44,305::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:09:44,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:44,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173641 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:09:44,853::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:09:44,854::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:09:45,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`af8f67a4-21f0-46e4-b4a7-d87f5bc1e51f`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:09:45,025::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:09:45,025::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434681', 'lastCheck': '3.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:09:45,026::task::1191::Storage.TaskManager.Task::(prepare) Task=`af8f67a4-21f0-46e4-b4a7-d87f5bc1e51f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434681', 'lastCheck': '3.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:09:45,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`af8f67a4-21f0-46e4-b4a7-d87f5bc1e51f`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:09:45,026::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:09:45,026::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:09:45,027::task::993::Storage.TaskManager.Task::(_decref) Task=`af8f67a4-21f0-46e4-b4a7-d87f5bc1e51f`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:09:45,057::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:09:46,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:46,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176241 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:09:48,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:49,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176032 s, 58.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:49,313::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:49,314::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:49,315::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:09:50,796::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:09:50,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c49f72d-bd4a-442f-9c6b-a18d3afcbbd0`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:09:50,797::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:09:50,812::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:09:50,812::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c49f72d-bd4a-442f-9c6b-a18d3afcbbd0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:09:50,813::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c49f72d-bd4a-442f-9c6b-a18d3afcbbd0`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:09:50,813::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:09:50,813::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:09:50,813::task::993::Storage.TaskManager.Task::(_decref) Task=`8c49f72d-bd4a-442f-9c6b-a18d3afcbbd0`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:09:50,826::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:09:50,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`51de8400-017f-47f6-83b4-91c54a0de62c`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:09:50,827::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:09:50,828::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3865f85c-b2d8-4f51-827f-8463bb9e25b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:09:50,828::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:09:50,829::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:09:50,829::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3865f85c-b2d8-4f51-827f-8463bb9e25b9`::Granted request >Thread-7083::DEBUG::2014-07-08 17:09:50,830::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`51de8400-017f-47f6-83b4-91c54a0de62c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:09:50,830::task::993::Storage.TaskManager.Task::(_decref) Task=`51de8400-017f-47f6-83b4-91c54a0de62c`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:09:50,849::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:09:50,849::task::1191::Storage.TaskManager.Task::(prepare) Task=`51de8400-017f-47f6-83b4-91c54a0de62c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:09:50,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`51de8400-017f-47f6-83b4-91c54a0de62c`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:09:50,850::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:09:50,850::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:09:50,851::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:09:50,851::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:09:50,851::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:09:50,851::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:09:50,852::task::993::Storage.TaskManager.Task::(_decref) Task=`51de8400-017f-47f6-83b4-91c54a0de62c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:09:51,193::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:09:51,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:51,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:51,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:51,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:51,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:51,195::__init__::225::IOProcess::(_processLogs) (274300) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:09:51,195::__init__::225::IOProcess::(_processLogs) (274300) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:51,199::__init__::225::IOProcess::(_processLogs) (274300) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:51,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:51,199::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:09:51,201::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:51,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 17:09:51,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00050061 s, 923 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:09:51,557::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:09:51,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:51,567::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:51,572::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:51,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:51,585::__init__::225::IOProcess::(_processLogs) (274301) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:09:51,589::__init__::225::IOProcess::(_processLogs) (274301) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:09:51,594::__init__::225::IOProcess::(_processLogs) (274301) Building response >Thread-18::DEBUG::2014-07-08 17:09:51,600::__init__::225::IOProcess::(_processLogs) (274301) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:51,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:51,610::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:09:51,646::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:09:51,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:51,662::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:51,672::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:51,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:51,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:51,681::__init__::225::IOProcess::(_processLogs) (274302) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:51,684::__init__::225::IOProcess::(_processLogs) (274302) Building response >Thread-18::DEBUG::2014-07-08 17:09:51,687::__init__::225::IOProcess::(_processLogs) (274302) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:51,752::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-6860::DEBUG::2014-07-08 17:09:51,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.160084 s, 6.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:09:51,756::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:09:51,768::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:09:51,770::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:51,773::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:51,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:51,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:51,781::__init__::225::IOProcess::(_processLogs) (274303) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:51,784::__init__::225::IOProcess::(_processLogs) (274303) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:51,786::__init__::225::IOProcess::(_processLogs) (274303) Building response >Thread-18::DEBUG::2014-07-08 17:09:51,788::__init__::225::IOProcess::(_processLogs) (274303) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:51,791::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:51,793::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:09:51,801::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:09:51,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:51,807::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:51,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:51,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:51,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:51,816::__init__::225::IOProcess::(_processLogs) (274304) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:09:51,819::__init__::225::IOProcess::(_processLogs) (274304) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:09:51,822::__init__::225::IOProcess::(_processLogs) (274304) Building response >Thread-18::DEBUG::2014-07-08 17:09:51,825::__init__::225::IOProcess::(_processLogs) (274304) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:51,828::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:51,831::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:09:53,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:54,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172163 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:54,318::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:54,319::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:54,320::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:09:54,871::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:09:56,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:56,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0882218 s, 11.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:09:58,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:09:58,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017347 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:59,328::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:59,329::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:09:59,331::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:09:59,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`9571f6a6-d1c2-4dce-b763-2496da80e923`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:09:59,861::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:09:59,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:09:59,863::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:09:59,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:09:59,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:59,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:59,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:59,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:59,864::__init__::225::IOProcess::(_processLogs) (274305) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:09:59,865::__init__::225::IOProcess::(_processLogs) (274305) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:09:59,865::__init__::225::IOProcess::(_processLogs) (274305) Building response >Thread-18::DEBUG::2014-07-08 17:09:59,865::__init__::225::IOProcess::(_processLogs) (274305) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:59,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:59,866::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:09:59,867::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:09:59,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:09:59,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:09:59,868::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:09:59,869::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:09:59,869::__init__::225::IOProcess::(_processLogs) (274306) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:09:59,869::__init__::225::IOProcess::(_processLogs) (274306) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:09:59,869::__init__::225::IOProcess::(_processLogs) (274306) Building response >Thread-18::DEBUG::2014-07-08 17:09:59,870::__init__::225::IOProcess::(_processLogs) (274306) Queuing response >Thread-18::DEBUG::2014-07-08 17:09:59,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:09:59,870::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:09:59,871::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:09:59,872::task::1191::Storage.TaskManager.Task::(prepare) Task=`9571f6a6-d1c2-4dce-b763-2496da80e923`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:09:59,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`9571f6a6-d1c2-4dce-b763-2496da80e923`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:09:59,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:09:59,872::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:09:59,873::task::993::Storage.TaskManager.Task::(_decref) Task=`9571f6a6-d1c2-4dce-b763-2496da80e923`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:09:59,955::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:09:59,956::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:10:00,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4a7f453-1b9c-4d65-851b-9ee2f9bbbaa5`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:00,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:10:00,276::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050061', 'lastCheck': '8.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:10:00,276::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4a7f453-1b9c-4d65-851b-9ee2f9bbbaa5`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050061', 'lastCheck': '8.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:10:00,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4a7f453-1b9c-4d65-851b-9ee2f9bbbaa5`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:00,277::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:00,277::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:00,277::task::993::Storage.TaskManager.Task::(_decref) Task=`c4a7f453-1b9c-4d65-851b-9ee2f9bbbaa5`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:10:00,313::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:10:00,867::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:10:00,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`68037502-0bf5-400f-ac0e-106ccc356dd2`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:00,868::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:10:00,883::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:00,884::task::1191::Storage.TaskManager.Task::(prepare) Task=`68037502-0bf5-400f-ac0e-106ccc356dd2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:00,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`68037502-0bf5-400f-ac0e-106ccc356dd2`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:00,884::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:00,884::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:00,884::task::993::Storage.TaskManager.Task::(_decref) Task=`68037502-0bf5-400f-ac0e-106ccc356dd2`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:10:00,896::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:10:00,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`39848cd8-3f39-44a0-9ba6-853874d9995b`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:10:00,897::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:10:00,898::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55ad1a89-7710-45cf-b658-4504932b00be`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:10:00,899::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:10:00,899::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:10:00,899::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`55ad1a89-7710-45cf-b658-4504932b00be`::Granted request >Thread-7083::DEBUG::2014-07-08 17:10:00,900::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`39848cd8-3f39-44a0-9ba6-853874d9995b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:10:00,900::task::993::Storage.TaskManager.Task::(_decref) Task=`39848cd8-3f39-44a0-9ba6-853874d9995b`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:10:00,919::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:00,920::task::1191::Storage.TaskManager.Task::(prepare) Task=`39848cd8-3f39-44a0-9ba6-853874d9995b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:00,920::task::595::Storage.TaskManager.Task::(_updateState) Task=`39848cd8-3f39-44a0-9ba6-853874d9995b`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:10:00,920::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:10:00,921::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:10:00,921::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:10:00,921::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:10:00,921::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:10:00,922::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:10:00,922::task::993::Storage.TaskManager.Task::(_decref) Task=`39848cd8-3f39-44a0-9ba6-853874d9995b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:10:00,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:01,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176733 s, 57.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:01,871::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:01,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:01,873::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:01,873::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:01,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:01,877::__init__::225::IOProcess::(_processLogs) (274307) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:01,877::__init__::225::IOProcess::(_processLogs) (274307) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:01,878::__init__::225::IOProcess::(_processLogs) (274307) Building response >Thread-18::DEBUG::2014-07-08 17:10:01,878::__init__::225::IOProcess::(_processLogs) (274307) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:01,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:01,879::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:10:01,884::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:10:02,128::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000534412 s, 865 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:02,138::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:02,141::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:02,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:02,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:02,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:02,152::__init__::225::IOProcess::(_processLogs) (274308) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:02,156::__init__::225::IOProcess::(_processLogs) (274308) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:02,158::__init__::225::IOProcess::(_processLogs) (274308) Building response >Thread-18::DEBUG::2014-07-08 17:10:02,159::__init__::225::IOProcess::(_processLogs) (274308) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:02,161::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:02,163::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:10:02,172::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:10:02,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:02,175::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:02,177::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:02,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:02,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:02,182::__init__::225::IOProcess::(_processLogs) (274309) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:02,183::__init__::225::IOProcess::(_processLogs) (274309) Building response >Thread-18::DEBUG::2014-07-08 17:10:02,184::__init__::225::IOProcess::(_processLogs) (274309) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:02,186::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:02,187::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:02,193::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:10:02,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:02,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:02,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:02,199::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:02,201::__init__::225::IOProcess::(_processLogs) (274310) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:02,202::__init__::225::IOProcess::(_processLogs) (274310) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:02,204::__init__::225::IOProcess::(_processLogs) (274310) Building response >Thread-18::DEBUG::2014-07-08 17:10:02,205::__init__::225::IOProcess::(_processLogs) (274310) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:02,210::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:02,212::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:02,217::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:10:02,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:02,219::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:02,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:02,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:02,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:02,228::__init__::225::IOProcess::(_processLogs) (274311) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:02,229::__init__::225::IOProcess::(_processLogs) (274311) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:02,230::__init__::225::IOProcess::(_processLogs) (274311) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:02,232::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:02,233::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:10:03,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:03,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181178 s, 56.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:04,338::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:04,339::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:04,341::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:05,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:05,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173529 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:10:07,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:08,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340898 s, 30.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:09,348::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:09,349::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:09,350::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:10,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:10,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171713 s, 59.6 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:10:10,936::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:10:10,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`66819d3b-5f4a-4049-8293-430befc62c7b`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:10,938::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:10:10,953::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:10,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`66819d3b-5f4a-4049-8293-430befc62c7b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:10,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`66819d3b-5f4a-4049-8293-430befc62c7b`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:10,954::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:10,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:10,955::task::993::Storage.TaskManager.Task::(_decref) Task=`66819d3b-5f4a-4049-8293-430befc62c7b`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:10:10,969::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:10:10,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6d5817d-7c83-4e85-9043-afb6c947aba4`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:10:10,971::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:10:10,972::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`09cecac7-2d08-4086-bd98-e4fe09990b63`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:10:10,972::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:10:10,972::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:10:10,973::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`09cecac7-2d08-4086-bd98-e4fe09990b63`::Granted request >Thread-7083::DEBUG::2014-07-08 17:10:10,973::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b6d5817d-7c83-4e85-9043-afb6c947aba4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:10:10,974::task::993::Storage.TaskManager.Task::(_decref) Task=`b6d5817d-7c83-4e85-9043-afb6c947aba4`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:10:10,994::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:10,995::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6d5817d-7c83-4e85-9043-afb6c947aba4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:10,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6d5817d-7c83-4e85-9043-afb6c947aba4`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:10:10,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:10:10,996::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:10:10,996::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:10:10,996::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:10:10,997::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:10:10,997::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:10:10,997::task::993::Storage.TaskManager.Task::(_decref) Task=`b6d5817d-7c83-4e85-9043-afb6c947aba4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:10:12,240::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:12,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:12,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:12,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:12,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:12,241::__init__::225::IOProcess::(_processLogs) (274312) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:12,242::__init__::225::IOProcess::(_processLogs) (274312) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:12,242::__init__::225::IOProcess::(_processLogs) (274312) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:12,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:12,242::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:10:12,244::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:10:12,401::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000555084 s, 832 kB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:10:12,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:10:12,575::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:12,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:12,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:12,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:12,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:12,695::__init__::225::IOProcess::(_processLogs) (274313) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:12,700::__init__::225::IOProcess::(_processLogs) (274313) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:12,704::__init__::225::IOProcess::(_processLogs) (274313) Building response >Thread-18::DEBUG::2014-07-08 17:10:12,707::__init__::225::IOProcess::(_processLogs) (274313) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:12,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:12,715::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:10:12,743::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:10:12,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:12,749::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:12,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 17:10:12,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.18384 s, 5.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:12,908::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:12,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:12,921::__init__::225::IOProcess::(_processLogs) (274314) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:12,926::__init__::225::IOProcess::(_processLogs) (274314) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:12,930::__init__::225::IOProcess::(_processLogs) (274314) Building response >Thread-18::DEBUG::2014-07-08 17:10:12,935::__init__::225::IOProcess::(_processLogs) (274314) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:12,940::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:12,954::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:10:12,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:12,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:12,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:12,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:12,970::__init__::225::IOProcess::(_processLogs) (274315) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:12,972::__init__::225::IOProcess::(_processLogs) (274315) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:12,977::__init__::225::IOProcess::(_processLogs) (274315) Building response >Thread-18::DEBUG::2014-07-08 17:10:12,982::__init__::225::IOProcess::(_processLogs) (274315) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:12,986::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:12,988::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:13,000::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:10:13,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:13,007::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:13,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:13,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:13,018::__init__::225::IOProcess::(_processLogs) (274316) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:13,020::__init__::225::IOProcess::(_processLogs) (274316) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:13,022::__init__::225::IOProcess::(_processLogs) (274316) Building response >Thread-18::DEBUG::2014-07-08 17:10:13,024::__init__::225::IOProcess::(_processLogs) (274316) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:13,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:13,029::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:14,358::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:14,359::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:14,360::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:15,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:15,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195461 s, 52.4 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:10:15,429::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:10:15,430::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:10:15,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4b52edf-4af5-49eb-8ef3-d9256c72d7f8`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:15,701::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:10:15,702::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555084', 'lastCheck': '2.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:10:15,702::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4b52edf-4af5-49eb-8ef3-d9256c72d7f8`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555084', 'lastCheck': '2.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:10:15,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4b52edf-4af5-49eb-8ef3-d9256c72d7f8`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:15,702::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:15,703::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:15,703::task::993::Storage.TaskManager.Task::(_decref) Task=`d4b52edf-4af5-49eb-8ef3-d9256c72d7f8`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:10:15,735::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:17,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:17,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173627 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:10:17,831::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5f', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '6c43566e-b734-485c-8708-1bf50caa8ff0', 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [59357cf2] >Thread-7087::DEBUG::2014-07-08 17:10:17,834::vm::3329::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug NIC xml: <interface type="bridge"> > <mac address="00:1a:4a:16:88:5f"/> > <model type="virtio"/> > <source bridge="ovirtmgmt"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Thread-7087::DEBUG::2014-07-08 17:10:18,587::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 1 edom: 0 level: 2 message: An error occurred, but the cause is unknown >Thread-7087::ERROR::2014-07-08 17:10:18,588::vm::3334::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug failed >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 3332, in hotplugNic > self._dom.attachDevice(nicXml) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 399, in attachDevice > if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) >libvirtError: An error occurred, but the cause is unknown >Thread-7087::DEBUG::2014-07-08 17:10:18,589::BindingXMLRPC::1114::vds::(wrapper) return vmHotplugNic with {'status': {'message': 'An error occurred, but the cause is unknown', 'code': 49}} >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:19,367::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:19,369::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:19,370::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:19,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:19,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173688 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:10:21,041::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:10:21,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`783f800f-df1f-4492-af04-9b82e76c1e4e`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:21,043::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:10:21,058::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:21,059::task::1191::Storage.TaskManager.Task::(prepare) Task=`783f800f-df1f-4492-af04-9b82e76c1e4e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:21,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`783f800f-df1f-4492-af04-9b82e76c1e4e`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:21,059::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:21,060::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:21,060::task::993::Storage.TaskManager.Task::(_decref) Task=`783f800f-df1f-4492-af04-9b82e76c1e4e`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:10:21,073::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:10:21,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`706e3012-73f5-41fd-bc0c-9694e0bf37be`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:10:21,074::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:10:21,075::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0585c1f0-7552-4566-b677-1a1ebd90580b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:10:21,075::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:10:21,076::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:10:21,076::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0585c1f0-7552-4566-b677-1a1ebd90580b`::Granted request >Thread-7083::DEBUG::2014-07-08 17:10:21,077::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`706e3012-73f5-41fd-bc0c-9694e0bf37be`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:10:21,077::task::993::Storage.TaskManager.Task::(_decref) Task=`706e3012-73f5-41fd-bc0c-9694e0bf37be`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:10:21,096::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:21,097::task::1191::Storage.TaskManager.Task::(prepare) Task=`706e3012-73f5-41fd-bc0c-9694e0bf37be`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576199168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:21,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`706e3012-73f5-41fd-bc0c-9694e0bf37be`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:10:21,097::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:10:21,097::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:10:21,098::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:10:21,098::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:10:21,098::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:10:21,099::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:10:21,099::task::993::Storage.TaskManager.Task::(_decref) Task=`706e3012-73f5-41fd-bc0c-9694e0bf37be`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:10:21,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:22,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173534 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:23,039::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:23,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:23,040::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:23,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:23,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:23,041::__init__::225::IOProcess::(_processLogs) (274317) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:23,041::__init__::225::IOProcess::(_processLogs) (274317) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:23,041::__init__::225::IOProcess::(_processLogs) (274317) Building response >Thread-18::DEBUG::2014-07-08 17:10:23,042::__init__::225::IOProcess::(_processLogs) (274317) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:23,042::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:23,042::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:10:23,044::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:10:23,192::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000560951 s, 824 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:23,194::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:23,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:23,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:23,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:23,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:23,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:23,195::__init__::225::IOProcess::(_processLogs) (274318) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:23,196::__init__::225::IOProcess::(_processLogs) (274318) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:23,196::__init__::225::IOProcess::(_processLogs) (274318) Building response >Thread-18::DEBUG::2014-07-08 17:10:23,196::__init__::225::IOProcess::(_processLogs) (274318) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:23,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:23,197::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:10:23,199::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:10:23,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:23,200::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:23,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:23,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:23,200::__init__::225::IOProcess::(_processLogs) (274319) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:23,201::__init__::225::IOProcess::(_processLogs) (274319) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:23,201::__init__::225::IOProcess::(_processLogs) (274319) Building response >Thread-18::DEBUG::2014-07-08 17:10:23,201::__init__::225::IOProcess::(_processLogs) (274319) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:23,201::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:23,202::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:23,203::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:10:23,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:23,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:23,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:23,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:23,211::__init__::225::IOProcess::(_processLogs) (274320) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:23,212::__init__::225::IOProcess::(_processLogs) (274320) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:23,213::__init__::225::IOProcess::(_processLogs) (274320) Building response >Thread-18::DEBUG::2014-07-08 17:10:23,214::__init__::225::IOProcess::(_processLogs) (274320) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:23,215::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:23,216::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:23,221::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:10:23,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:23,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:23,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:23,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:23,227::__init__::225::IOProcess::(_processLogs) (274321) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:23,229::__init__::225::IOProcess::(_processLogs) (274321) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:23,230::__init__::225::IOProcess::(_processLogs) (274321) Building response >Thread-18::DEBUG::2014-07-08 17:10:23,232::__init__::225::IOProcess::(_processLogs) (274321) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:23,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:23,234::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:10:24,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:24,416::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:24,417::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:24,418::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:24,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173099 s, 59.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:10:25,415::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:10:26,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:26,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178733 s, 57.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:10:28,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:29,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.087648 s, 11.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:29,426::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:29,427::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:29,428::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:10:30,524::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:10:30,524::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:10:30,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`96443cf6-5307-4f33-89b4-a8178d44e359`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:30,853::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:10:30,853::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560951', 'lastCheck': '7.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:10:30,854::task::1191::Storage.TaskManager.Task::(prepare) Task=`96443cf6-5307-4f33-89b4-a8178d44e359`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560951', 'lastCheck': '7.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:10:30,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`96443cf6-5307-4f33-89b4-a8178d44e359`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:30,854::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:30,854::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:30,855::task::993::Storage.TaskManager.Task::(_decref) Task=`96443cf6-5307-4f33-89b4-a8178d44e359`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:10:30,885::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:10:31,114::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:10:31,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f86fa4c-6011-4d9c-98e4-d0b675474617`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:31,115::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:10:31,131::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:31,132::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f86fa4c-6011-4d9c-98e4-d0b675474617`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:31,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f86fa4c-6011-4d9c-98e4-d0b675474617`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:31,132::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:31,132::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:31,133::task::993::Storage.TaskManager.Task::(_decref) Task=`2f86fa4c-6011-4d9c-98e4-d0b675474617`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:10:31,145::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:10:31,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf987a91-b592-4316-a487-fce50a5b0209`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:10:31,146::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:10:31,147::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`dbca82e2-033f-40a2-a13f-0fa87d02c241`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:10:31,147::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:10:31,147::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:10:31,148::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`dbca82e2-033f-40a2-a13f-0fa87d02c241`::Granted request >Thread-7083::DEBUG::2014-07-08 17:10:31,148::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cf987a91-b592-4316-a487-fce50a5b0209`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:10:31,149::task::993::Storage.TaskManager.Task::(_decref) Task=`cf987a91-b592-4316-a487-fce50a5b0209`::ref 1 aborting False >Dummy-6860::DEBUG::2014-07-08 17:10:31,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7083::INFO::2014-07-08 17:10:31,319::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:31,320::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf987a91-b592-4316-a487-fce50a5b0209`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:31,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf987a91-b592-4316-a487-fce50a5b0209`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:10:31,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:10:31,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:10:31,322::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:10:31,322::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:10:31,323::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:10:31,323::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:10:31,332::task::993::Storage.TaskManager.Task::(_decref) Task=`cf987a91-b592-4316-a487-fce50a5b0209`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:10:31,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319803 s, 32.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:33,240::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:33,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:33,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:33,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:33,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:33,242::__init__::225::IOProcess::(_processLogs) (274322) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:33,242::__init__::225::IOProcess::(_processLogs) (274322) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:33,242::__init__::225::IOProcess::(_processLogs) (274322) Building response >Thread-18::DEBUG::2014-07-08 17:10:33,242::__init__::225::IOProcess::(_processLogs) (274322) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:33,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:33,243::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:10:33,244::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:10:33,398::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000439709 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:33,404::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:33,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:33,407::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:33,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:33,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:33,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:33,414::__init__::225::IOProcess::(_processLogs) (274323) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:33,415::__init__::225::IOProcess::(_processLogs) (274323) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:33,417::__init__::225::IOProcess::(_processLogs) (274323) Building response >Thread-18::DEBUG::2014-07-08 17:10:33,418::__init__::225::IOProcess::(_processLogs) (274323) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:33,419::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:33,420::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:10:33,431::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:33,433::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:10:33,435::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:33,437::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:33,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:33,440::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:33,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:33,443::__init__::225::IOProcess::(_processLogs) (274324) Finding callback 'access'... >Dummy-6860::DEBUG::2014-07-08 17:10:33,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:10:33,447::__init__::225::IOProcess::(_processLogs) (274324) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:33,607::__init__::225::IOProcess::(_processLogs) (274324) Building response >Thread-18::DEBUG::2014-07-08 17:10:33,610::__init__::225::IOProcess::(_processLogs) (274324) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:33,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:33,613::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:33,621::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:33,626::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:10:33,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:33,634::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:33,638::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:33,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:33,644::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:33,647::__init__::225::IOProcess::(_processLogs) (274325) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:33,651::__init__::225::IOProcess::(_processLogs) (274325) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:33,654::__init__::225::IOProcess::(_processLogs) (274325) Building response >Thread-18::DEBUG::2014-07-08 17:10:33,658::__init__::225::IOProcess::(_processLogs) (274325) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:33,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:33,665::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:33,683::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:33,686::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:10:33,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:33,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:33,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:33,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-6860::DEBUG::2014-07-08 17:10:33,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896482 s, 11.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:33,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:33,774::__init__::225::IOProcess::(_processLogs) (274326) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:33,776::__init__::225::IOProcess::(_processLogs) (274326) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:33,778::__init__::225::IOProcess::(_processLogs) (274326) Building response >Thread-18::DEBUG::2014-07-08 17:10:33,780::__init__::225::IOProcess::(_processLogs) (274326) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:33,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:33,784::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:34,441::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:34,451::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:34,460::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:35,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:36,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173375 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:10:38,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:38,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170383 s, 60.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:39,471::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:39,472::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:39,474::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:40,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:40,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367733 s, 27.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:10:41,390::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:10:41,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef93e6d5-07fb-4bf0-92e6-f1d881395129`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:41,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:10:41,407::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:41,407::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef93e6d5-07fb-4bf0-92e6-f1d881395129`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:41,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef93e6d5-07fb-4bf0-92e6-f1d881395129`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:41,408::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:41,408::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:41,408::task::993::Storage.TaskManager.Task::(_decref) Task=`ef93e6d5-07fb-4bf0-92e6-f1d881395129`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:10:41,420::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:10:41,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbb3e54a-3d50-4201-b14a-bcf0aa3812fd`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:10:41,422::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:10:41,422::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9d89986d-bcaa-4248-b3bb-b1d69b2f772a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:10:41,423::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:10:41,423::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:10:41,423::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9d89986d-bcaa-4248-b3bb-b1d69b2f772a`::Granted request >Thread-7083::DEBUG::2014-07-08 17:10:41,424::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bbb3e54a-3d50-4201-b14a-bcf0aa3812fd`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:10:41,424::task::993::Storage.TaskManager.Task::(_decref) Task=`bbb3e54a-3d50-4201-b14a-bcf0aa3812fd`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:10:41,443::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:41,444::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbb3e54a-3d50-4201-b14a-bcf0aa3812fd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:41,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbb3e54a-3d50-4201-b14a-bcf0aa3812fd`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:10:41,444::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:10:41,444::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:10:41,445::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:10:41,445::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:10:41,445::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:10:41,446::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:10:41,446::task::993::Storage.TaskManager.Task::(_decref) Task=`bbb3e54a-3d50-4201-b14a-bcf0aa3812fd`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:10:42,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:43,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172889 s, 59.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:43,793::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:43,794::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:43,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:43,794::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:43,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:43,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:43,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:43,795::__init__::225::IOProcess::(_processLogs) (274327) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:43,796::__init__::225::IOProcess::(_processLogs) (274327) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:43,796::__init__::225::IOProcess::(_processLogs) (274327) Building response >Thread-18::DEBUG::2014-07-08 17:10:43,796::__init__::225::IOProcess::(_processLogs) (274327) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:43,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:43,796::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:10:43,798::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:10:43,950::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000500052 s, 924 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:43,952::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:43,953::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:43,953::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:43,953::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:43,954::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:43,954::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:43,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:43,955::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274328) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:43,955::__init__::225::IOProcess::(_processLogs) (274328) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:43,955::__init__::225::IOProcess::(_processLogs) (274328) Building response >Thread-18::DEBUG::2014-07-08 17:10:43,955::__init__::225::IOProcess::(_processLogs) (274328) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:43,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:43,956::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:10:43,958::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:43,958::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:10:43,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:43,959::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:43,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:43,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:43,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:43,960::__init__::225::IOProcess::(_processLogs) (274329) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:43,960::__init__::225::IOProcess::(_processLogs) (274329) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:43,960::__init__::225::IOProcess::(_processLogs) (274329) Building response >Thread-18::DEBUG::2014-07-08 17:10:43,961::__init__::225::IOProcess::(_processLogs) (274329) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:43,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:43,961::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:43,962::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:10:43,962::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:43,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:43,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:43,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:43,963::__init__::225::IOProcess::(_processLogs) (274330) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:43,964::__init__::225::IOProcess::(_processLogs) (274330) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:43,964::__init__::225::IOProcess::(_processLogs) (274330) Building response >Thread-18::DEBUG::2014-07-08 17:10:43,964::__init__::225::IOProcess::(_processLogs) (274330) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:43,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:43,965::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:43,966::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:10:43,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:43,966::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:43,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:43,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:43,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:43,967::__init__::225::IOProcess::(_processLogs) (274331) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:43,967::__init__::225::IOProcess::(_processLogs) (274331) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:43,968::__init__::225::IOProcess::(_processLogs) (274331) Building response >Thread-18::DEBUG::2014-07-08 17:10:43,968::__init__::225::IOProcess::(_processLogs) (274331) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:43,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:43,968::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:44,481::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:44,482::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:44,483::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:45,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:45,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174001 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:10:45,707::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:10:45,708::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:10:46,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`a49bdaba-4cd7-40e1-b309-720ee0eb3364`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:46,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:10:46,071::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500052', 'lastCheck': '2.1', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:10:46,071::task::1191::Storage.TaskManager.Task::(prepare) Task=`a49bdaba-4cd7-40e1-b309-720ee0eb3364`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500052', 'lastCheck': '2.1', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:10:46,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`a49bdaba-4cd7-40e1-b309-720ee0eb3364`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:46,071::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:46,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:46,072::task::993::Storage.TaskManager.Task::(_decref) Task=`a49bdaba-4cd7-40e1-b309-720ee0eb3364`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:10:46,106::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:47,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:47,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174222 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:49,491::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:49,492::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:49,493::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:10:49,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:49,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174155 s, 58.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:10:51,459::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:10:51,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba20e30d-6313-4ecf-bb52-533c2d83f904`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:10:51,461::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:10:51,476::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:51,476::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba20e30d-6313-4ecf-bb52-533c2d83f904`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:10:51,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba20e30d-6313-4ecf-bb52-533c2d83f904`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:10:51,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:10:51,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:10:51,477::task::993::Storage.TaskManager.Task::(_decref) Task=`ba20e30d-6313-4ecf-bb52-533c2d83f904`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:10:51,489::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:10:51,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5be69bb-2d43-4f6e-a754-6ba0d355d4ed`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:10:51,491::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:10:51,492::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`53aeb1d6-cc76-4374-b843-b78dd6a29207`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:10:51,492::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:10:51,493::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:10:51,493::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`53aeb1d6-cc76-4374-b843-b78dd6a29207`::Granted request >Thread-7083::DEBUG::2014-07-08 17:10:51,494::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e5be69bb-2d43-4f6e-a754-6ba0d355d4ed`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:10:51,494::task::993::Storage.TaskManager.Task::(_decref) Task=`e5be69bb-2d43-4f6e-a754-6ba0d355d4ed`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:10:51,513::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:51,513::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5be69bb-2d43-4f6e-a754-6ba0d355d4ed`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:10:51,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5be69bb-2d43-4f6e-a754-6ba0d355d4ed`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:10:51,514::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:10:51,514::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:10:51,514::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:10:51,515::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:10:51,515::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:10:51,515::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:10:51,516::task::993::Storage.TaskManager.Task::(_decref) Task=`e5be69bb-2d43-4f6e-a754-6ba0d355d4ed`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:10:51,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:52,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174104 s, 58.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:53,971::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:53,972::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:53,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:53,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:53,973::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:53,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:53,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:53,973::__init__::225::IOProcess::(_processLogs) (274332) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:53,974::__init__::225::IOProcess::(_processLogs) (274332) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:53,974::__init__::225::IOProcess::(_processLogs) (274332) Building response >Thread-18::DEBUG::2014-07-08 17:10:53,974::__init__::225::IOProcess::(_processLogs) (274332) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:53,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:53,975::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:10:53,976::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:10:54,125::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000449488 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:54,131::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:54,133::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:10:54,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:54,136::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:54,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:54,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:54,141::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:54,142::__init__::225::IOProcess::(_processLogs) (274333) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:10:54,143::__init__::225::IOProcess::(_processLogs) (274333) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:10:54,145::__init__::225::IOProcess::(_processLogs) (274333) Building response >Thread-18::DEBUG::2014-07-08 17:10:54,146::__init__::225::IOProcess::(_processLogs) (274333) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:54,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:54,149::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:10:54,157::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:54,158::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:10:54,159::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:54,161::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:54,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:54,163::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:54,165::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:54,167::__init__::225::IOProcess::(_processLogs) (274334) Finding callback 'access'... >Dummy-6860::DEBUG::2014-07-08 17:10:54,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:10:54,171::__init__::225::IOProcess::(_processLogs) (274334) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:54,340::__init__::225::IOProcess::(_processLogs) (274334) Building response >Thread-18::DEBUG::2014-07-08 17:10:54,344::__init__::225::IOProcess::(_processLogs) (274334) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:54,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:54,353::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:54,368::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:54,371::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:10:54,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:10:54,379::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:54,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:54,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:10:54,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:10:54,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274335) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:54,465::__init__::225::IOProcess::(_processLogs) (274335) Got request for method 'access' >Dummy-6860::DEBUG::2014-07-08 17:10:54,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0683754 s, 15.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:10:54,469::__init__::225::IOProcess::(_processLogs) (274335) Building response >Thread-18::DEBUG::2014-07-08 17:10:54,472::__init__::225::IOProcess::(_processLogs) (274335) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:54,474::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:54,477::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:10:54,489::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:10:54,491::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:10:54,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:54,502::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:10:54,501::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:10:54,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:10:54,514::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:54,516::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:10:54,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:54,528::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:10:54,528::__init__::225::IOProcess::(_processLogs) (274336) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:10:54,536::__init__::225::IOProcess::(_processLogs) (274336) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:10:54,542::__init__::225::IOProcess::(_processLogs) (274336) Building response >Thread-18::DEBUG::2014-07-08 17:10:54,545::__init__::225::IOProcess::(_processLogs) (274336) Queuing response >Thread-18::DEBUG::2014-07-08 17:10:54,548::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:10:54,551::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >VM Channels Listener::DEBUG::2014-07-08 17:10:55,544::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:10:56,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:56,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347865 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:10:59,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:10:59,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193095 s, 53.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:59,542::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:59,544::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:10:59,545::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:11:00,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2f9a4dc-454d-49da-984c-2830ccf677d7`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:11:00,714::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:11:00,715::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:00,716::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:11:00,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:00,716::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:00,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:00,717::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:00,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:00,718::__init__::225::IOProcess::(_processLogs) (274337) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:11:00,718::__init__::225::IOProcess::(_processLogs) (274337) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:11:00,718::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274337) Building response >Thread-18::DEBUG::2014-07-08 17:11:00,718::__init__::225::IOProcess::(_processLogs) (274337) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:00,719::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:00,719::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:11:00,721::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:00,721::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:11:00,722::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:00,722::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:00,722::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:00,722::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:00,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:00,723::__init__::225::IOProcess::(_processLogs) (274338) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:11:00,723::__init__::225::IOProcess::(_processLogs) (274338) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:11:00,723::__init__::225::IOProcess::(_processLogs) (274338) Building response >Thread-18::DEBUG::2014-07-08 17:11:00,723::__init__::225::IOProcess::(_processLogs) (274338) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:00,724::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:00,724::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:11:00,725::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:11:00,726::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2f9a4dc-454d-49da-984c-2830ccf677d7`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:11:00,726::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2f9a4dc-454d-49da-984c-2830ccf677d7`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:11:00,726::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:11:00,726::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:11:00,727::task::993::Storage.TaskManager.Task::(_decref) Task=`b2f9a4dc-454d-49da-984c-2830ccf677d7`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:11:00,806::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:11:00,807::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:11:01,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`f01ca7b1-bf50-423c-a6f6-facfa9de8770`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:01,231::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:11:01,237::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449488', 'lastCheck': '6.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:11:01,238::task::1191::Storage.TaskManager.Task::(prepare) Task=`f01ca7b1-bf50-423c-a6f6-facfa9de8770`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449488', 'lastCheck': '6.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:11:01,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`f01ca7b1-bf50-423c-a6f6-facfa9de8770`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:01,239::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:01,239::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:01,239::task::993::Storage.TaskManager.Task::(_decref) Task=`f01ca7b1-bf50-423c-a6f6-facfa9de8770`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:11:01,275::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:01,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:11:01,591::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:11:01,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3023475-6aff-427b-a692-dd1c288ca956`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:01,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:11:01,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 17:11:01,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0249291 s, 41.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:11:01,668::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3023475-6aff-427b-a692-dd1c288ca956`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:01,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3023475-6aff-427b-a692-dd1c288ca956`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:01,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:01,671::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:01,672::task::993::Storage.TaskManager.Task::(_decref) Task=`c3023475-6aff-427b-a692-dd1c288ca956`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:11:01,689::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:11:01,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`f19aad17-80bc-4772-9657-a356d0278bc5`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:11:01,693::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:11:01,696::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f2aa7465-0aa6-4dfe-bd6b-531b7143e593`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:11:01,697::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:11:01,700::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:11:01,701::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f2aa7465-0aa6-4dfe-bd6b-531b7143e593`::Granted request >Thread-7083::DEBUG::2014-07-08 17:11:01,705::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f19aad17-80bc-4772-9657-a356d0278bc5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:11:01,706::task::993::Storage.TaskManager.Task::(_decref) Task=`f19aad17-80bc-4772-9657-a356d0278bc5`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:11:01,738::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:01,738::task::1191::Storage.TaskManager.Task::(prepare) Task=`f19aad17-80bc-4772-9657-a356d0278bc5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:01,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`f19aad17-80bc-4772-9657-a356d0278bc5`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:11:01,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:11:01,739::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:11:01,740::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:11:01,740::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:11:01,740::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:11:01,741::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:11:01,741::task::993::Storage.TaskManager.Task::(_decref) Task=`f19aad17-80bc-4772-9657-a356d0278bc5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:11:03,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:03,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017868 s, 57.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:04,552::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:04,554::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:04,555::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:11:04,561::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:04,561::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:04,561::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:04,562::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:04,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:04,563::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:04,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:04,563::__init__::225::IOProcess::(_processLogs) (274339) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:04,563::__init__::225::IOProcess::(_processLogs) (274339) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:04,564::__init__::225::IOProcess::(_processLogs) (274339) Building response >Thread-18::DEBUG::2014-07-08 17:11:04,564::__init__::225::IOProcess::(_processLogs) (274339) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:04,564::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:04,564::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:11:04,566::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:11:04,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000495301 s, 933 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:11:04,730::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:04,731::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:04,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:04,734::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:04,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:04,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:04,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:04,739::__init__::225::IOProcess::(_processLogs) (274340) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:04,744::__init__::225::IOProcess::(_processLogs) (274340) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:04,749::__init__::225::IOProcess::(_processLogs) (274340) Building response >Thread-18::DEBUG::2014-07-08 17:11:04,752::__init__::225::IOProcess::(_processLogs) (274340) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:04,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:04,759::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:11:04,775::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:11:04,778::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:04,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:04,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:04,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:04,790::__init__::225::IOProcess::(_processLogs) (274341) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:04,793::__init__::225::IOProcess::(_processLogs) (274341) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:04,796::__init__::225::IOProcess::(_processLogs) (274341) Building response >Thread-18::DEBUG::2014-07-08 17:11:04,799::__init__::225::IOProcess::(_processLogs) (274341) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:04,802::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:04,805::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:04,819::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:11:04,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:04,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:04,830::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:04,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:04,836::__init__::225::IOProcess::(_processLogs) (274342) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:04,840::__init__::225::IOProcess::(_processLogs) (274342) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:04,843::__init__::225::IOProcess::(_processLogs) (274342) Building response >Thread-18::DEBUG::2014-07-08 17:11:04,847::__init__::225::IOProcess::(_processLogs) (274342) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:04,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:04,853::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:04,864::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:11:04,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:04,870::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:04,873::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:04,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:04,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:04,882::__init__::225::IOProcess::(_processLogs) (274343) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:04,884::__init__::225::IOProcess::(_processLogs) (274343) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:04,887::__init__::225::IOProcess::(_processLogs) (274343) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:04,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:04,894::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:11:05,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:06,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174437 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:11:08,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:08,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173196 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:09,562::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:09,564::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:09,565::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:10,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:10,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177289 s, 57.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:11:11,755::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:11:11,773::task::595::Storage.TaskManager.Task::(_updateState) Task=`f97fb2db-6022-42c5-90d9-41c6cf652576`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:11,774::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:11:11,811::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:11,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`f97fb2db-6022-42c5-90d9-41c6cf652576`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:11,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`f97fb2db-6022-42c5-90d9-41c6cf652576`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:11,812::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:11,812::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:11,812::task::993::Storage.TaskManager.Task::(_decref) Task=`f97fb2db-6022-42c5-90d9-41c6cf652576`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:11:11,824::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:11:11,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`35fcb2ce-2bf2-4edc-b19c-f467d7d30148`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:11:11,825::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:11:11,826::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`205ce3d1-6b26-4a3b-a414-0b5201a5b73c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:11:11,826::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:11:11,826::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:11:11,827::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`205ce3d1-6b26-4a3b-a414-0b5201a5b73c`::Granted request >Thread-7083::DEBUG::2014-07-08 17:11:11,827::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`35fcb2ce-2bf2-4edc-b19c-f467d7d30148`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:11:11,828::task::993::Storage.TaskManager.Task::(_decref) Task=`35fcb2ce-2bf2-4edc-b19c-f467d7d30148`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:11:11,854::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:11,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`35fcb2ce-2bf2-4edc-b19c-f467d7d30148`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:11,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`35fcb2ce-2bf2-4edc-b19c-f467d7d30148`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:11:11,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:11:11,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:11:11,857::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:11:11,858::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:11:11,858::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:11:11,858::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:11:11,858::task::993::Storage.TaskManager.Task::(_decref) Task=`35fcb2ce-2bf2-4edc-b19c-f467d7d30148`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:11:12,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:13,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171881 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:14,572::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:14,573::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:14,575::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:11:14,904::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:14,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:14,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:14,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:14,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:14,905::__init__::225::IOProcess::(_processLogs) (274344) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:14,905::__init__::225::IOProcess::(_processLogs) (274344) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:14,906::__init__::225::IOProcess::(_processLogs) (274344) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:14,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:14,906::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:11:14,908::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:11:15,056::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000670179 s, 689 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:11:15,058::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:15,059::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:15,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:15,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:15,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:15,060::__init__::225::IOProcess::(_processLogs) (274345) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:15,060::__init__::225::IOProcess::(_processLogs) (274345) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:15,060::__init__::225::IOProcess::(_processLogs) (274345) Building response >Thread-18::DEBUG::2014-07-08 17:11:15,060::__init__::225::IOProcess::(_processLogs) (274345) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:15,061::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:15,061::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:11:15,064::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:11:15,065::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:15,066::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:15,066::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:15,066::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:15,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:15,067::__init__::225::IOProcess::(_processLogs) (274346) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:15,067::__init__::225::IOProcess::(_processLogs) (274346) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:15,068::__init__::225::IOProcess::(_processLogs) (274346) Building response >Thread-18::DEBUG::2014-07-08 17:11:15,068::__init__::225::IOProcess::(_processLogs) (274346) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:15,069::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:15,069::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:11:15,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:11:15,243::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:11:15,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:15,258::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:15,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:15,270::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:15,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:15,282::__init__::225::IOProcess::(_processLogs) (274347) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:15,290::__init__::225::IOProcess::(_processLogs) (274347) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:15,297::__init__::225::IOProcess::(_processLogs) (274347) Building response >Thread-18::DEBUG::2014-07-08 17:11:15,304::__init__::225::IOProcess::(_processLogs) (274347) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:15,311::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:15,319::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:15,343::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:11:15,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:15,356::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:15,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:15,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:15,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:15,446::__init__::225::IOProcess::(_processLogs) (274348) Finding callback 'access'... >Dummy-6860::DEBUG::2014-07-08 17:11:15,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.14065 s, 7.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:11:15,455::__init__::225::IOProcess::(_processLogs) (274348) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:15,459::__init__::225::IOProcess::(_processLogs) (274348) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:15,463::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:15,466::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:11:16,136::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:11:16,138::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:11:16,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d0394f6-889b-4fba-b36f-c1555a89d6d6`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:16,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:11:16,378::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670179', 'lastCheck': '0.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:11:16,378::task::1191::Storage.TaskManager.Task::(prepare) Task=`0d0394f6-889b-4fba-b36f-c1555a89d6d6`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670179', 'lastCheck': '0.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:11:16,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d0394f6-889b-4fba-b36f-c1555a89d6d6`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:16,379::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:16,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:16,379::task::993::Storage.TaskManager.Task::(_decref) Task=`0d0394f6-889b-4fba-b36f-c1555a89d6d6`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:11:16,414::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:17,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:17,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0979932 s, 10.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:19,582::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:19,583::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:19,584::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:20,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:20,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172453 s, 59.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:11:21,890::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:11:21,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`f865209c-4959-4e2f-b908-ccd036f7cb90`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:21,892::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:11:21,908::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:21,908::task::1191::Storage.TaskManager.Task::(prepare) Task=`f865209c-4959-4e2f-b908-ccd036f7cb90`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:21,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`f865209c-4959-4e2f-b908-ccd036f7cb90`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:21,909::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:21,909::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:21,909::task::993::Storage.TaskManager.Task::(_decref) Task=`f865209c-4959-4e2f-b908-ccd036f7cb90`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:11:21,922::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:11:21,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`90108e76-9199-4004-9b91-332f3fff7f3d`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:11:21,923::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:11:21,924::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f9ae80cc-0a50-4e39-9169-f206a08c0643`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:11:21,924::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:11:21,925::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:11:21,925::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f9ae80cc-0a50-4e39-9169-f206a08c0643`::Granted request >Thread-7083::DEBUG::2014-07-08 17:11:21,926::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`90108e76-9199-4004-9b91-332f3fff7f3d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:11:21,926::task::993::Storage.TaskManager.Task::(_decref) Task=`90108e76-9199-4004-9b91-332f3fff7f3d`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:11:21,947::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:21,948::task::1191::Storage.TaskManager.Task::(prepare) Task=`90108e76-9199-4004-9b91-332f3fff7f3d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:21,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`90108e76-9199-4004-9b91-332f3fff7f3d`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:11:21,948::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:11:21,948::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:11:21,949::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:11:21,949::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:11:21,949::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:11:21,950::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:11:21,950::task::993::Storage.TaskManager.Task::(_decref) Task=`90108e76-9199-4004-9b91-332f3fff7f3d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:11:22,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:22,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174459 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:11:24,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:24,717::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:24,723::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:24,728::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:24,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307059 s, 33.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:11:25,492::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:25,493::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:25,493::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:25,493::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:25,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:25,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:25,494::__init__::225::IOProcess::(_processLogs) (274349) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:25,494::__init__::225::IOProcess::(_processLogs) (274349) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:25,495::__init__::225::IOProcess::(_processLogs) (274349) Building response >Thread-18::DEBUG::2014-07-08 17:11:25,495::__init__::225::IOProcess::(_processLogs) (274349) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:25,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:25,495::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:11:25,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:11:25,655::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000466249 s, 991 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:11:25,668::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:25,672::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:25,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:25,678::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:25,680::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:25,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:25,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:25,694::__init__::225::IOProcess::(_processLogs) (274350) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:25,699::__init__::225::IOProcess::(_processLogs) (274350) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:25,703::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274350) Building response >Thread-18::DEBUG::2014-07-08 17:11:25,706::__init__::225::IOProcess::(_processLogs) (274350) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:25,709::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:25,713::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:11:25,737::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:25,744::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:11:25,746::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:25,747::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:25,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:25,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:25,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:25,754::__init__::225::IOProcess::(_processLogs) (274351) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:25,755::__init__::225::IOProcess::(_processLogs) (274351) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:25,757::__init__::225::IOProcess::(_processLogs) (274351) Building response >Thread-18::DEBUG::2014-07-08 17:11:25,758::__init__::225::IOProcess::(_processLogs) (274351) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:25,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:25,761::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:25,766::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:25,767::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:11:25,767::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:25,773::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:25,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:25,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:25,782::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:25,783::__init__::225::IOProcess::(_processLogs) (274352) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:25,785::__init__::225::IOProcess::(_processLogs) (274352) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:25,787::__init__::225::IOProcess::(_processLogs) (274352) Building response >Thread-18::DEBUG::2014-07-08 17:11:25,788::__init__::225::IOProcess::(_processLogs) (274352) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:25,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:25,791::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:25,797::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:25,799::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:11:25,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:25,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:25,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:25,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:25,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:25,808::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274353) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:25,809::__init__::225::IOProcess::(_processLogs) (274353) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:25,811::__init__::225::IOProcess::(_processLogs) (274353) Building response >Thread-18::DEBUG::2014-07-08 17:11:25,812::__init__::225::IOProcess::(_processLogs) (274353) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:25,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:25,815::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >VM Channels Listener::DEBUG::2014-07-08 17:11:25,841::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:11:26,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:27,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174984 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:11:29,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:29,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177141 s, 57.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:29,738::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:29,740::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:29,741::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:11:31,268::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:11:31,268::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:11:31,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:31,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177552 s, 57.7 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:11:31,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`8821ea8f-979e-4b53-a056-5c54f29c71a6`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:31,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:11:31,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466249', 'lastCheck': '5.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:11:31,706::task::1191::Storage.TaskManager.Task::(prepare) Task=`8821ea8f-979e-4b53-a056-5c54f29c71a6`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466249', 'lastCheck': '5.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:11:31,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`8821ea8f-979e-4b53-a056-5c54f29c71a6`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:31,706::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:31,706::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:31,707::task::993::Storage.TaskManager.Task::(_decref) Task=`8821ea8f-979e-4b53-a056-5c54f29c71a6`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:11:31,740::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:11:31,964::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:11:31,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c02689a-d5d2-4087-8573-7baf9a7ce5ff`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:31,966::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:11:31,982::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:31,983::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c02689a-d5d2-4087-8573-7baf9a7ce5ff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:31,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c02689a-d5d2-4087-8573-7baf9a7ce5ff`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:31,983::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:31,984::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:31,984::task::993::Storage.TaskManager.Task::(_decref) Task=`8c02689a-d5d2-4087-8573-7baf9a7ce5ff`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:11:31,995::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:11:31,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4139daa-53f2-47fc-98bd-be4088288d9e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:11:31,997::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:11:31,997::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`989dc1e3-c0a3-4ac8-833b-b5235ba3fc15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:11:31,998::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:11:31,998::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:11:31,999::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`989dc1e3-c0a3-4ac8-833b-b5235ba3fc15`::Granted request >Thread-7083::DEBUG::2014-07-08 17:11:31,999::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d4139daa-53f2-47fc-98bd-be4088288d9e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:11:32,000::task::993::Storage.TaskManager.Task::(_decref) Task=`d4139daa-53f2-47fc-98bd-be4088288d9e`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:11:32,024::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:32,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4139daa-53f2-47fc-98bd-be4088288d9e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:32,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4139daa-53f2-47fc-98bd-be4088288d9e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:11:32,025::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:11:32,025::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:11:32,026::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:11:32,026::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:11:32,026::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:11:32,027::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:11:32,027::task::993::Storage.TaskManager.Task::(_decref) Task=`d4139daa-53f2-47fc-98bd-be4088288d9e`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:11:33,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:34,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.117907 s, 8.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:34,751::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:34,758::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:34,764::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:11:35,821::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:35,821::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:35,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:35,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:35,822::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:35,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:35,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:35,823::__init__::225::IOProcess::(_processLogs) (274354) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:35,823::__init__::225::IOProcess::(_processLogs) (274354) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:35,823::__init__::225::IOProcess::(_processLogs) (274354) Building response >Thread-18::DEBUG::2014-07-08 17:11:35,824::__init__::225::IOProcess::(_processLogs) (274354) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:35,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:35,824::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:11:35,826::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:11:35,979::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00051374 s, 899 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:11:35,990::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:35,996::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:36,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:36,006::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:36,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:36,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:36,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:36,029::__init__::225::IOProcess::(_processLogs) (274355) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:36,034::__init__::225::IOProcess::(_processLogs) (274355) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:36,040::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274355) Building response >Thread-18::DEBUG::2014-07-08 17:11:36,044::__init__::225::IOProcess::(_processLogs) (274355) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:36,049::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:36,054::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:11:36,079::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:36,081::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:11:36,082::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:36,084::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:36,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:36,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:36,090::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:36,092::__init__::225::IOProcess::(_processLogs) (274356) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:36,093::__init__::225::IOProcess::(_processLogs) (274356) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:36,094::__init__::225::IOProcess::(_processLogs) (274356) Building response >Thread-18::DEBUG::2014-07-08 17:11:36,096::__init__::225::IOProcess::(_processLogs) (274356) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:36,097::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:36,099::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:36,105::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:36,107::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:11:36,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:36,110::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:36,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:36,114::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:36,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:36,116::__init__::225::IOProcess::(_processLogs) (274357) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:36,118::__init__::225::IOProcess::(_processLogs) (274357) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:36,120::__init__::225::IOProcess::(_processLogs) (274357) Building response >Thread-18::DEBUG::2014-07-08 17:11:36,121::__init__::225::IOProcess::(_processLogs) (274357) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:36,122::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-6860::DEBUG::2014-07-08 17:11:36,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:11:36,125::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:36,293::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:36,297::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:11:36,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:36,306::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUGDEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:36,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:36,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:36,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:36,319::__init__::225::IOProcess::(_processLogs) (274358) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:36,322::__init__::225::IOProcess::(_processLogs) (274358) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:36,325::__init__::225::IOProcess::(_processLogs) (274358) Building response >Thread-18::DEBUG::2014-07-08 17:11:36,328::__init__::225::IOProcess::(_processLogs) (274358) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:36,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:36,335::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:11:36,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0651262 s, 15.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:11:38,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:38,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171512 s, 59.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:39,778::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:39,780::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:39,781::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:40,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:41,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171115 s, 59.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:11:42,043::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:11:42,044::task::595::Storage.TaskManager.Task::(_updateState) Task=`7818d422-d004-47e2-b98e-36fe32d6cf01`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:42,044::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:11:42,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:42,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`7818d422-d004-47e2-b98e-36fe32d6cf01`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:42,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`7818d422-d004-47e2-b98e-36fe32d6cf01`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:42,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:42,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:42,069::task::993::Storage.TaskManager.Task::(_decref) Task=`7818d422-d004-47e2-b98e-36fe32d6cf01`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:11:42,082::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:11:42,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5b2be13-c525-4fa7-bcb5-985926afe00f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:11:42,083::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:11:42,084::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`76557413-ffeb-4fe7-9a3d-1178f6e7012b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:11:42,084::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:11:42,085::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:11:42,085::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`76557413-ffeb-4fe7-9a3d-1178f6e7012b`::Granted request >Thread-7083::DEBUG::2014-07-08 17:11:42,086::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c5b2be13-c525-4fa7-bcb5-985926afe00f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:11:42,086::task::993::Storage.TaskManager.Task::(_decref) Task=`c5b2be13-c525-4fa7-bcb5-985926afe00f`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:11:42,109::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:42,109::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5b2be13-c525-4fa7-bcb5-985926afe00f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:42,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5b2be13-c525-4fa7-bcb5-985926afe00f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:11:42,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:11:42,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:11:42,110::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:11:42,111::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:11:42,111::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:11:42,111::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:11:42,112::task::993::Storage.TaskManager.Task::(_decref) Task=`c5b2be13-c525-4fa7-bcb5-985926afe00f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:11:43,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:43,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017368 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:44,800::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:44,803::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:44,804::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:45,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:45,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173448 s, 59.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:11:46,347::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUGDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:46,347::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:46,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:46,348::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:46,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:46,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:46,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:46,349::__init__::225::IOProcess::(_processLogs) (274359) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:46,350::__init__::225::IOProcess::(_processLogs) (274359) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:46,350::__init__::225::IOProcess::(_processLogs) (274359) Building response >Thread-18::DEBUG::2014-07-08 17:11:46,350::__init__::225::IOProcess::(_processLogs) (274359) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:46,350::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:46,351::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:11:46,353::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:11:46,506::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000753149 s, 613 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:11:46,508::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:46,508::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:46,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:46,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:46,509::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:46,510::__init__::225::IOProcess::(_processLogs) (274360) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:46,510::__init__::225::IOProcess::(_processLogs) (274360) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:46,510::__init__::225::IOProcess::(_processLogs) (274360) Building response >Thread-18::DEBUG::2014-07-08 17:11:46,510::__init__::225::IOProcess::(_processLogs) (274360) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:46,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:46,511::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:11:46,514::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:11:46,514::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:46,515::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:46,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:46,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:46,515::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:46,516::__init__::225::IOProcess::(_processLogs) (274361) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:46,516::__init__::225::IOProcess::(_processLogs) (274361) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:46,516::__init__::225::IOProcess::(_processLogs) (274361) Building response >Thread-18::DEBUG::2014-07-08 17:11:46,516::__init__::225::IOProcess::(_processLogs) (274361) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:46,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:46,517::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:46,519::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:46,519::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:11:46,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:46,520::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:46,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:46,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:46,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7086::DEBUG::2014-07-08 17:11:46,521::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:11:46,521::__init__::225::IOProcess::(_processLogs) (274362) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:46,524::__init__::225::IOProcess::(_processLogs) (274362) Got request for method 'access' >Thread-7086::ERROR::2014-07-08 17:11:46,523::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:11:46,525::__init__::225::IOProcess::(_processLogs) (274362) Building response >Thread-18::DEBUG::2014-07-08 17:11:46,526::__init__::225::IOProcess::(_processLogs) (274362) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:46,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:46,527::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:46,528::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:46,528::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:11:46,528::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:46,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:46,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:46,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:46,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:46,530::__init__::225::IOProcess::(_processLogs) (274363) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:46,530::__init__::225::IOProcess::(_processLogs) (274363) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:46,530::__init__::225::IOProcess::(_processLogs) (274363) Building response >Thread-18::DEBUG::2014-07-08 17:11:46,530::__init__::225::IOProcess::(_processLogs) (274363) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:46,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:46,531::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:11:47,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`06c34d06-50a3-43d1-8b05-46a913b9d37d`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:47,025::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:11:47,026::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753149', 'lastCheck': '0.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:11:47,026::task::1191::Storage.TaskManager.Task::(prepare) Task=`06c34d06-50a3-43d1-8b05-46a913b9d37d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753149', 'lastCheck': '0.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:11:47,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`06c34d06-50a3-43d1-8b05-46a913b9d37d`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:47,026::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:47,027::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:47,027::task::993::Storage.TaskManager.Task::(_decref) Task=`06c34d06-50a3-43d1-8b05-46a913b9d37d`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:11:47,066::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:47,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:47,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173914 s, 58.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:49,811::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:49,813::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:49,814::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:49,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:50,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.151998 s, 6.7 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:11:52,129::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:11:52,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`8304d2b5-070e-485d-86c9-7374f6ffb5b4`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:11:52,130::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:11:52,145::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:52,146::task::1191::Storage.TaskManager.Task::(prepare) Task=`8304d2b5-070e-485d-86c9-7374f6ffb5b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:11:52,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`8304d2b5-070e-485d-86c9-7374f6ffb5b4`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:11:52,146::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:11:52,146::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:11:52,147::task::993::Storage.TaskManager.Task::(_decref) Task=`8304d2b5-070e-485d-86c9-7374f6ffb5b4`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:11:52,158::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:11:52,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`13c0920f-ce57-48fa-b2fe-d0e7ceda7cd7`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:11:52,159::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:11:52,160::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e928a0c5-35d7-4561-8ac2-d52b17f3a18d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:11:52,160::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:11:52,161::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:11:52,161::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e928a0c5-35d7-4561-8ac2-d52b17f3a18d`::Granted request >Thread-7083::DEBUG::2014-07-08 17:11:52,162::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`13c0920f-ce57-48fa-b2fe-d0e7ceda7cd7`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:11:52,162::task::993::Storage.TaskManager.Task::(_decref) Task=`13c0920f-ce57-48fa-b2fe-d0e7ceda7cd7`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:11:52,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:52,182::task::1191::Storage.TaskManager.Task::(prepare) Task=`13c0920f-ce57-48fa-b2fe-d0e7ceda7cd7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:11:52,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`13c0920f-ce57-48fa-b2fe-d0e7ceda7cd7`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:11:52,182::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:11:52,183::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:11:52,183::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:11:52,183::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:11:52,184::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:11:52,184::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:11:52,184::task::993::Storage.TaskManager.Task::(_decref) Task=`13c0920f-ce57-48fa-b2fe-d0e7ceda7cd7`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:11:52,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:52,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173492 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:11:54,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:54,819::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:54,826::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:54,831::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:11:54,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300779 s, 34.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:11:56,143::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-18::DEBUG::2014-07-08 17:11:56,534::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:56,534::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:56,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:56,534::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:56,535::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:56,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:56,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:56,535::__init__::225::IOProcess::(_processLogs) (274364) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:56,536::__init__::225::IOProcess::(_processLogs) (274364) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:56,536::__init__::225::IOProcess::(_processLogs) (274364) Building response >Thread-18::DEBUG::2014-07-08 17:11:56,536::__init__::225::IOProcess::(_processLogs) (274364) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:56,536::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:56,537::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:11:56,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:11:56,692::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00053972 s, 856 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:11:56,698::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:56,700::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:11:56,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:56,703::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:56,706::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:56,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:56,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:56,709::__init__::225::IOProcess::(_processLogs) (274365) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:11:56,711::__init__::225::IOProcess::(_processLogs) (274365) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:11:56,712::__init__::225::IOProcess::(_processLogs) (274365) Building response >Thread-18::DEBUG::2014-07-08 17:11:56,713::__init__::225::IOProcess::(_processLogs) (274365) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:56,714::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:56,715::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:11:56,724::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:56,725::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:11:56,726::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:56,727::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:56,729::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:56,730::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:56,732::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:56,733::__init__::225::IOProcess::(_processLogs) (274366) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:56,734::__init__::225::IOProcess::(_processLogs) (274366) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:56,735::__init__::225::IOProcess::(_processLogs) (274366) Building response >Thread-18::DEBUG::2014-07-08 17:11:56,737::__init__::225::IOProcess::(_processLogs) (274366) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:56,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:56,740::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:56,746::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:56,748::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:11:56,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:56,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:56,752::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:56,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:56,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:56,756::__init__::225::IOProcess::(_processLogs) (274367) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:56,757::__init__::225::IOProcess::(_processLogs) (274367) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:56,759::__init__::225::IOProcess::(_processLogs) (274367) Building response >Thread-18::DEBUG::2014-07-08 17:11:56,759::__init__::225::IOProcess::(_processLogs) (274367) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:56,761::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:56,762::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:11:56,766::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:11:56,767::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:11:56,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:11:56,770::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:11:56,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:11:56,773::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:11:56,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:11:56,775::__init__::225::IOProcess::(_processLogs) (274368) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:11:56,776::__init__::225::IOProcess::(_processLogs) (274368) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:11:56,778::__init__::225::IOProcess::(_processLogs) (274368) Building response >Thread-18::DEBUG::2014-07-08 17:11:56,779::__init__::225::IOProcess::(_processLogs) (274368) Queuing response >Thread-18::DEBUG::2014-07-08 17:11:56,780::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:11:56,781::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:11:56,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:57,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172819 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:11:59,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:11:59,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0197914 s, 51.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:59,839::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:59,840::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:11:59,841::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:01,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7086::DEBUG::2014-07-08 17:12:01,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`78e971ef-092c-41dd-acde-016c08872a14`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:12:01,611::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:12:01,613::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:01,613::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:12:01,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:01,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:01,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:01,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:01,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:01,615::__init__::225::IOProcess::(_processLogs) (274369) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:12:01,615::__init__::225::IOProcess::(_processLogs) (274369) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:12:01,627::__init__::225::IOProcess::(_processLogs) DEBUG|(274369) Building response >Thread-18::DEBUG::2014-07-08 17:12:01,629::__init__::225::IOProcess::(_processLogs) (274369) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:01,631::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:12:01,632::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:12:01,642::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:01,643::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:12:01,645::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:01,646::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:01,648::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:01,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:01,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:01,652::__init__::225::IOProcess::(_processLogs) (274370) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:12:01,653::__init__::225::IOProcess::(_processLogs) (274370) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:12:01,655::__init__::225::IOProcess::(_processLogs) (274370) Building response >Thread-18::DEBUG::2014-07-08 17:12:01,656::__init__::225::IOProcess::(_processLogs) (274370) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:01,659::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-6860::DEBUG::2014-07-08 17:12:01,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472403 s, 21.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:12:01,724::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:12:01,730::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:12:01,731::task::1191::Storage.TaskManager.Task::(prepare) Task=`78e971ef-092c-41dd-acde-016c08872a14`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:12:01,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`78e971ef-092c-41dd-acde-016c08872a14`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:12:01,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:12:01,734::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:12:01,735::task::993::Storage.TaskManager.Task::(_decref) Task=`78e971ef-092c-41dd-acde-016c08872a14`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:12:01,832::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:12:01,833::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:12:02,198::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:12:02,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`d468f810-f847-4d04-9b61-ad196f6c84d3`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:12:02,199::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:12:02,218::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:02,218::task::1191::Storage.TaskManager.Task::(prepare) Task=`d468f810-f847-4d04-9b61-ad196f6c84d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:02,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`d468f810-f847-4d04-9b61-ad196f6c84d3`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:02,219::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:12:02,219::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:12:02,219::task::993::Storage.TaskManager.Task::(_decref) Task=`d468f810-f847-4d04-9b61-ad196f6c84d3`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:12:02,231::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:12:02,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`be5e2a99-1db2-4460-a566-6b4d55dd60d0`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:12:02,232::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:12:02,233::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d4007a82-9b2f-483f-97f2-528efdfc6f81`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:12:02,234::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:12:02,234::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:12:02,234::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d4007a82-9b2f-483f-97f2-528efdfc6f81`::Granted request >Thread-7083::DEBUG::2014-07-08 17:12:02,235::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`be5e2a99-1db2-4460-a566-6b4d55dd60d0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:12:02,235::task::993::Storage.TaskManager.Task::(_decref) Task=`be5e2a99-1db2-4460-a566-6b4d55dd60d0`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:12:02,255::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:02,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`be5e2a99-1db2-4460-a566-6b4d55dd60d0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:02,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`be5e2a99-1db2-4460-a566-6b4d55dd60d0`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:12:02,256::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:12:02,256::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:12:02,256::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:12:02,257::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:12:02,257::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:12:02,257::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:12:02,258::task::993::Storage.TaskManager.Task::(_decref) Task=`be5e2a99-1db2-4460-a566-6b4d55dd60d0`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:12:02,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`7055ea4a-0ced-40ab-82a5-2258370b86e7`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:12:02,375::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:12:02,375::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053972', 'lastCheck': '5.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:12:02,375::task::1191::Storage.TaskManager.Task::(prepare) Task=`7055ea4a-0ced-40ab-82a5-2258370b86e7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053972', 'lastCheck': '5.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:12:02,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`7055ea4a-0ced-40ab-82a5-2258370b86e7`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:02,376::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:12:02,376::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:12:02,376::task::993::Storage.TaskManager.Task::(_decref) Task=`7055ea4a-0ced-40ab-82a5-2258370b86e7`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:12:02,436::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:03,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:04,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242215 s, 42.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:04,851::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:04,857::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:04,862::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:06,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:06,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101994 s, 10.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:12:06,788::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:06,788::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:06,789::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:06,789::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:06,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:06,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:06,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:06,790::__init__::225::IOProcess::(_processLogs) (274371) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:06,790::__init__::225::IOProcess::(_processLogs) (274371) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:06,790::__init__::225::IOProcess::(_processLogs) (274371) Building response >Thread-18::DEBUG::2014-07-08 17:12:06,791::__init__::225::IOProcess::(_processLogs) (274371) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:06,791::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:12:06,791::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:12:06,794::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:12:06,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000691411 s, 668 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:12:06,958::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:06,960::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:06,961::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:06,962::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:06,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:06,965::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:06,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:06,968::__init__::225::IOProcess::(_processLogs) DEBUG|(274372) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:06,969::__init__::225::IOProcess::(_processLogs) (274372) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:06,970::__init__::225::IOProcess::(_processLogs) (274372) Building response >Thread-18::DEBUG::2014-07-08 17:12:06,971::__init__::225::IOProcess::(_processLogs) (274372) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:06,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:06,974::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:12:06,982::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:06,984::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:12:06,985::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:06,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:06,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:06,990::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:06,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:06,992::__init__::225::IOProcess::(_processLogs) (274373) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:06,993::__init__::225::IOProcess::(_processLogs) (274373) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:06,994::__init__::225::IOProcess::(_processLogs) (274373) Building response >Thread-18::DEBUG::2014-07-08 17:12:06,996::__init__::225::IOProcess::(_processLogs) (274373) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:06,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:06,999::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:07,005::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:07,007::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:12:07,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:07,010::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:07,011::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:07,013::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:07,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:07,016::__init__::225::IOProcess::(_processLogs) (274374) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:07,017::__init__::225::IOProcess::(_processLogs) (274374) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:07,018::__init__::225::IOProcess::(_processLogs) (274374) Building response >Thread-18::DEBUG::2014-07-08 17:12:07,020::__init__::225::IOProcess::(_processLogs) (274374) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:07,021::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:07,023::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:07,028::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:07,029::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:12:07,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:07,032::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:07,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:07,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:07,037::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:07,038::__init__::225::IOProcess::(_processLogs) (274375) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:07,039::__init__::225::IOProcess::(_processLogs) (274375) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:07,040::__init__::225::IOProcess::(_processLogs) (274375) Building response >Thread-18::DEBUG::2014-07-08 17:12:07,042::__init__::225::IOProcess::(_processLogs) (274375) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:07,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:07,045::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:12:08,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:08,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034582 s, 29.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:09,872::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:09,874::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:09,875::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:10,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:10,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177742 s, 57.6 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:12:12,272::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:12:12,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`3dc173b4-7fe8-4de9-abd1-a1f578813f86`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:12:12,274::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:12:12,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:12,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`3dc173b4-7fe8-4de9-abd1-a1f578813f86`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:12,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`3dc173b4-7fe8-4de9-abd1-a1f578813f86`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:12,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:12:12,294::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:12:12,294::task::993::Storage.TaskManager.Task::(_decref) Task=`3dc173b4-7fe8-4de9-abd1-a1f578813f86`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:12:12,306::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:12:12,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`a515974f-f519-48e2-8991-17217bbcb270`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:12:12,307::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:12:12,308::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f6a0b0e3-5cb7-49b4-b853-9579aef92ce7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:12:12,308::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:12:12,309::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:12:12,309::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f6a0b0e3-5cb7-49b4-b853-9579aef92ce7`::Granted request >Thread-7083::DEBUG::2014-07-08 17:12:12,310::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a515974f-f519-48e2-8991-17217bbcb270`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:12:12,310::task::993::Storage.TaskManager.Task::(_decref) Task=`a515974f-f519-48e2-8991-17217bbcb270`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:12:12,329::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:12,329::task::1191::Storage.TaskManager.Task::(prepare) Task=`a515974f-f519-48e2-8991-17217bbcb270`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:12,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`a515974f-f519-48e2-8991-17217bbcb270`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:12:12,330::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:12:12,330::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:12:12,331::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:12:12,331::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:12:12,331::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:12:12,331::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:12:12,332::task::993::Storage.TaskManager.Task::(_decref) Task=`a515974f-f519-48e2-8991-17217bbcb270`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:12:13,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:13,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172216 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:14,882::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:14,884::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:14,885::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:15,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:15,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171445 s, 59.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:12:17,043::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:12:17,044::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:12:17,050::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:17,051::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:17,051::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:17,051::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:17,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:17,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:17,052::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:17,052::__init__::225::IOProcess::(_processLogs) (274376) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:17,053::__init__::225::IOProcess::(_processLogs) (274376) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:17,053::__init__::225::IOProcess::(_processLogs) (274376) Building response >Thread-18::DEBUG::2014-07-08 17:12:17,053::__init__::225::IOProcess::(_processLogs) (274376) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:17,053::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:17,054::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:12:17,055::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:12:17,297::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000532176 s, 868 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:12:17,313::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:17,315::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:17,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:17,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:17,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:17,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:17,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:17,325::__init__::225::IOProcess::(_processLogs) (274377) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:17,327::__init__::225::IOProcess::(_processLogs) (274377) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:17,329::__init__::225::IOProcess::(_processLogs) DEBUG|(274377) Building response >Thread-18::DEBUG::2014-07-08 17:12:17,330::__init__::225::IOProcess::(_processLogs) (274377) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:17,333::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:17,335::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:12:17,359::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:17,361::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:12:17,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:17,364::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:17,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:17,367::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:17,368::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:17,370::__init__::225::IOProcess::(_processLogs) (274378) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:17,371::__init__::225::IOProcess::(_processLogs) (274378) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:17,373::__init__::225::IOProcess::(_processLogs) (274378) Building response >Thread-18::DEBUG::2014-07-08 17:12:17,374::__init__::225::IOProcess::(_processLogs) (274378) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:17,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:17,376::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:17,380::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:17,381::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:12:17,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:17,382::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:17,382::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:17,382::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:17,383::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:17,383::__init__::225::IOProcess::(_processLogs) (274379) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:17,384::__init__::225::IOProcess::(_processLogs) (274379) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:17,384::__init__::225::IOProcess::(_processLogs) (274379) Building response >Thread-18::DEBUG::2014-07-08 17:12:17,384::__init__::225::IOProcess::(_processLogs) (274379) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:17,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:17,389::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:17,393::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:17,394::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:12:17,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:17,397::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:17,399::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:17,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:17,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:17,402::__init__::225::IOProcess::(_processLogs) (274380) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:17,403::__init__::225::IOProcess::(_processLogs) (274380) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:17,404::__init__::225::IOProcess::(_processLogs) (274380) Building response >Thread-18::DEBUG::2014-07-08 17:12:17,406::__init__::225::IOProcess::(_processLogs) (274380) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:17,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:17,409::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:12:17,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:12:17,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d3f72c8-cb64-4606-bbee-1653ed7a59a8`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:12:17,716::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:12:17,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532176', 'lastCheck': '0.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:12:17,720::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d3f72c8-cb64-4606-bbee-1653ed7a59a8`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532176', 'lastCheck': '0.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:12:17,721::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d3f72c8-cb64-4606-bbee-1653ed7a59a8`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:17,723::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:12:17,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:12:17,725::task::993::Storage.TaskManager.Task::(_decref) Task=`4d3f72c8-cb64-4606-bbee-1653ed7a59a8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:12:17,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428731 s, 23.9 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:12:17,843::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:19,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:20,014::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:20,016::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:20,019::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:20,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274947 s, 37.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:12:22,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:22,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172897 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:12:22,359::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:12:22,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8ba438d-7de7-4bfd-9c49-578de09de586`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:12:22,364::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:12:22,382::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:22,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8ba438d-7de7-4bfd-9c49-578de09de586`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:22,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8ba438d-7de7-4bfd-9c49-578de09de586`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:22,385::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:12:22,386::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:12:22,386::task::993::Storage.TaskManager.Task::(_decref) Task=`d8ba438d-7de7-4bfd-9c49-578de09de586`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:12:22,487::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:12:22,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e07b407-f87a-4b4a-bfe2-eadda16a967c`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:12:22,491::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:12:22,492::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7d8800a8-c331-4b35-b68b-ddaf60eed1e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:12:22,492::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:12:22,493::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:12:22,493::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`7d8800a8-c331-4b35-b68b-ddaf60eed1e9`::Granted request >Thread-7083::DEBUG::2014-07-08 17:12:22,494::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5e07b407-f87a-4b4a-bfe2-eadda16a967c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:12:22,494::task::993::Storage.TaskManager.Task::(_decref) Task=`5e07b407-f87a-4b4a-bfe2-eadda16a967c`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:12:22,518::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:22,518::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e07b407-f87a-4b4a-bfe2-eadda16a967c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:22,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e07b407-f87a-4b4a-bfe2-eadda16a967c`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:12:22,519::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:12:22,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:12:22,520::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:12:22,520::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:12:22,520::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:12:22,520::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:12:22,521::task::993::Storage.TaskManager.Task::(_decref) Task=`5e07b407-f87a-4b4a-bfe2-eadda16a967c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:12:24,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:24,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173649 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:25,029::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:25,030::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:25,031::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:12:26,361::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:12:26,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:27,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0434614 s, 23.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:12:27,414::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:27,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:27,414::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:27,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:27,415::__init__::225::IOProcess::(_processLogs) (274381) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:27,416::__init__::225::IOProcess::(_processLogs) (274381) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:27,416::__init__::225::IOProcess::(_processLogs) (274381) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:27,416::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:27,416::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:12:27,418::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:12:27,570::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00048273 s, 957 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:12:27,575::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:27,576::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:27,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:27,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:27,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:27,586::__init__::225::IOProcess::(_processLogs) (274382) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:27,588::__init__::225::IOProcess::(_processLogs) (274382) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:27,589::__init__::225::IOProcess::(_processLogs) (274382) Building response >Thread-18::DEBUG::2014-07-08 17:12:27,590::__init__::225::IOProcess::(_processLogs) (274382) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:27,591::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:27,593::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:12:27,600::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:12:27,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:27,603::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:27,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:27,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:27,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:27,608::__init__::225::IOProcess::(_processLogs) (274383) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:27,610::__init__::225::IOProcess::(_processLogs) (274383) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:27,611::__init__::225::IOProcess::(_processLogs) (274383) Building response >Thread-18::DEBUG::2014-07-08 17:12:27,612::__init__::225::IOProcess::(_processLogs) (274383) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:27,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:27,614::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:27,620::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:12:27,622::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:27,624::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:27,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:27,627::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:27,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:27,629::__init__::225::IOProcess::(_processLogs) (274384) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:27,631::__init__::225::IOProcess::(_processLogs) (274384) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:27,632::__init__::225::IOProcess::(_processLogs) (274384) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:27,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:27,635::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:27,639::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:12:27,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:27,643::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:27,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:27,646::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:27,648::__init__::225::IOProcess::(_processLogs) (274385) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:27,649::__init__::225::IOProcess::(_processLogs) (274385) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:27,651::__init__::225::IOProcess::(_processLogs) (274385) Building response >Thread-18::DEBUG::2014-07-08 17:12:27,652::__init__::225::IOProcess::(_processLogs) (274385) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:27,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:27,656::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:12:29,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:29,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174912 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:30,039::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:30,040::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:30,041::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:31,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:31,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180976 s, 56.6 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:12:32,122::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:12:32,123::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:12:32,535::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:12:32,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2cdcecf-4608-4230-87ec-89ca43b428a8`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:12:32,537::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:12:32,553::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:32,553::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2cdcecf-4608-4230-87ec-89ca43b428a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:32,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2cdcecf-4608-4230-87ec-89ca43b428a8`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:32,554::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:12:32,554::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:12:32,554::task::993::Storage.TaskManager.Task::(_decref) Task=`a2cdcecf-4608-4230-87ec-89ca43b428a8`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:12:32,569::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:12:32,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb9298d4-db9e-4da4-af82-b0e0bdce1f9d`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:12:32,570::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:12:32,571::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f3b16e37-d1ce-48c3-95ec-4e6e63f305d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:12:32,571::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:12:32,572::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:12:32,572::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f3b16e37-d1ce-48c3-95ec-4e6e63f305d8`::Granted request >Thread-7083::DEBUG::2014-07-08 17:12:32,573::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fb9298d4-db9e-4da4-af82-b0e0bdce1f9d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:12:32,573::task::993::Storage.TaskManager.Task::(_decref) Task=`fb9298d4-db9e-4da4-af82-b0e0bdce1f9d`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:12:32,592::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:32,593::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb9298d4-db9e-4da4-af82-b0e0bdce1f9d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:32,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb9298d4-db9e-4da4-af82-b0e0bdce1f9d`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:12:32,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:12:32,594::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:12:32,594::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:12:32,594::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:12:32,595::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:12:32,595::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:12:32,595::task::993::Storage.TaskManager.Task::(_decref) Task=`fb9298d4-db9e-4da4-af82-b0e0bdce1f9d`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:12:32,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`85e491eb-c7c9-48be-b8cc-6bfa67289fd9`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:12:32,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:12:32,972::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048273', 'lastCheck': '5.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:12:32,973::task::1191::Storage.TaskManager.Task::(prepare) Task=`85e491eb-c7c9-48be-b8cc-6bfa67289fd9`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048273', 'lastCheck': '5.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:12:32,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`85e491eb-c7c9-48be-b8cc-6bfa67289fd9`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:32,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:12:32,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:12:32,974::task::993::Storage.TaskManager.Task::(_decref) Task=`85e491eb-c7c9-48be-b8cc-6bfa67289fd9`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:12:33,013::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:33,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:33,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175638 s, 58.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:35,051::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:35,059::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:35,065::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:35,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:36,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173057 s, 59.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 17:12:37,661::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:12:37,667::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 17:12:37,670::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,672::__init__::225::IOProcess::(_processLogs) (274386) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:12:37,672::__init__::225::IOProcess::(_processLogs) (274386) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:12:37,672::__init__::225::IOProcess::(_processLogs) (274386) Building response >Thread-18::DEBUG::2014-07-08 17:12:37,673::__init__::225::IOProcess::(_processLogs) (274386) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,673::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:12:37,674::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:12:37,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,676::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,677::__init__::225::IOProcess::(_processLogs) (274387) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:12:37,677::__init__::225::IOProcess::(_processLogs) (274387) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:12:37,677::__init__::225::IOProcess::(_processLogs) (274387) Building response >Thread-18::DEBUG::2014-07-08 17:12:37,677::__init__::225::IOProcess::(_processLogs) (274387) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,678::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:12:37,678::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:12:37,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,680::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:37,680::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,680::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,681::__init__::225::IOProcess::(_processLogs) (274388) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:12:37,681::__init__::225::IOProcess::(_processLogs) (274388) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:12:37,681::__init__::225::IOProcess::(_processLogs) (274388) Building response >Thread-18::DEBUG::2014-07-08 17:12:37,681::__init__::225::IOProcess::(_processLogs) (274388) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,682::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,682::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 17:12:37,683::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 17:12:37,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:37,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,692::__init__::225::IOProcess::(_processLogs) (274389) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:12:37,694::__init__::225::IOProcess::(_processLogs) (274389) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:12:37,696::__init__::225::IOProcess::(_processLogs) (274389) Building response >Thread-37::DEBUG::2014-07-08 17:12:37,698::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:12:37,698::__init__::225::IOProcess::(_processLogs) (274389) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,700::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,700::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 17:12:37,701::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 17:12:37,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:37,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,703::__init__::225::IOProcess::(_processLogs) (274390) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 17:12:37,703::__init__::225::IOProcess::(_processLogs) (274390) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 17:12:37,703::__init__::225::IOProcess::(_processLogs) (274390) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,704::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 17:12:37,705::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 17:12:37,706::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 17:12:37,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,706::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,707::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,707::__init__::225::IOProcess::(_processLogs) (274391) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 17:12:37,707::__init__::225::IOProcess::(_processLogs) (274391) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 17:12:37,708::__init__::225::IOProcess::(_processLogs) (274391) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,708::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 17:12:37,709::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 17:12:37,710::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 17:12:37,711::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:37,711::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,711::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,712::__init__::225::IOProcess::(_processLogs) (274392) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:37,712::__init__::225::IOProcess::(_processLogs) (274392) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:37,712::__init__::225::IOProcess::(_processLogs) (274392) Building response >Thread-18::DEBUG::2014-07-08 17:12:37,712::__init__::225::IOProcess::(_processLogs) (274392) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,713::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,715::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:37,721::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 17:12:37,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,724::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,727::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,728::__init__::225::IOProcess::(_processLogs) (274393) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:12:37,730::__init__::225::IOProcess::(_processLogs) (274393) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:12:37,731::__init__::225::IOProcess::(_processLogs) (274393) Building response >Thread-18::DEBUG::2014-07-08 17:12:37,732::__init__::225::IOProcess::(_processLogs) (274393) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,735::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 17:12:37,738::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 17:12:37,739::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 17:12:37,739::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 17:12:37,742::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:37,744::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:37,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,751::__init__::225::IOProcess::(_processLogs) (274394) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:37,753::__init__::225::IOProcess::(_processLogs) (274394) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:37,755::__init__::225::IOProcess::(_processLogs) (274394) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,758::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:12:37,768::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:12:37,917::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000505917 s, 913 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:12:37,922::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:37,924::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,925::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:37,927::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,928::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,930::__init__::225::IOProcess::(_processLogs) (274395) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:37,931::__init__::225::IOProcess::(_processLogs) (274395) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:37,932::__init__::225::IOProcess::(_processLogs) (274395) Building response >Thread-18::DEBUG::2014-07-08 17:12:37,934::__init__::225::IOProcess::(_processLogs) (274395) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,935::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,937::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:12:37,945::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:12:37,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,947::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:37,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,952::__init__::225::IOProcess::(_processLogs) (274396) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:37,953::__init__::225::IOProcess::(_processLogs) (274396) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:37,955::__init__::225::IOProcess::(_processLogs) (274396) Building response >Thread-18::DEBUG::2014-07-08 17:12:37,957::__init__::225::IOProcess::(_processLogs) (274396) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,959::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:37,965::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:12:37,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,968::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:37,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,972::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,974::__init__::225::IOProcess::(_processLogs) (274397) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:37,975::__init__::225::IOProcess::(_processLogs) (274397) Building response >Thread-18::DEBUG::2014-07-08 17:12:37,976::__init__::225::IOProcess::(_processLogs) (274397) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:37,978::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:37,980::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:37,984::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:12:37,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:37,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:37,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:37,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:37,992::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:37,993::__init__::225::IOProcess::(_processLogs) (274398) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:37,995::__init__::225::IOProcess::(_processLogs) (274398) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:37,996::__init__::225::IOProcess::(_processLogs) (274398) Building response >Thread-18::DEBUG::2014-07-08 17:12:37,998::__init__::225::IOProcess::(_processLogs) (274398) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:38,000::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:12:38,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:38,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173314 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:40,076::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:40,077::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:40,079::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:40,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:40,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179954 s, 56.9 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:12:42,609::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:12:42,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`2521789a-b894-4f76-8a2d-01f6e808dd2b`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:12:42,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:12:42,626::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 17:12:42,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:12:42,628::task::1191::Storage.TaskManager.Task::(prepare) Task=`2521789a-b894-4f76-8a2d-01f6e808dd2b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:42,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`2521789a-b894-4f76-8a2d-01f6e808dd2b`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:42,797::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:12:42,799::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:12:42,799::task::993::Storage.TaskManager.Task::(_decref) Task=`2521789a-b894-4f76-8a2d-01f6e808dd2b`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:12:42,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0201194 s, 50.9 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:12:42,876::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:12:42,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`9abadd1c-4edd-4bec-93ce-104df9b9ef07`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:12:42,880::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:12:42,884::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c6a8a9fa-e08a-4eeb-bacf-756b2c23df87`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:12:42,884::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:12:42,887::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:12:42,888::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c6a8a9fa-e08a-4eeb-bacf-756b2c23df87`::Granted request >Thread-7083::DEBUG::2014-07-08 17:12:42,890::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9abadd1c-4edd-4bec-93ce-104df9b9ef07`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:12:42,891::task::993::Storage.TaskManager.Task::(_decref) Task=`9abadd1c-4edd-4bec-93ce-104df9b9ef07`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:12:42,923::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:42,924::task::1191::Storage.TaskManager.Task::(prepare) Task=`9abadd1c-4edd-4bec-93ce-104df9b9ef07`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:42,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`9abadd1c-4edd-4bec-93ce-104df9b9ef07`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:12:42,926::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:12:42,927::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:12:42,929::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:12:42,930::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:12:42,931::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:12:42,932::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:12:42,933::task::993::Storage.TaskManager.Task::(_decref) Task=`9abadd1c-4edd-4bec-93ce-104df9b9ef07`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:12:44,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:45,104::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:45,105::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:45,106::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:45,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174032 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:12:47,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:47,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193925 s, 52.8 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:12:47,498::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:12:47,500::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:12:48,007::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:48,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:48,008::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:48,008::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:48,008::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:48,008::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:48,009::__init__::225::IOProcess::(_processLogs) (274399) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:48,009::__init__::225::IOProcess::(_processLogs) (274399) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:48,009::__init__::225::IOProcess::(_processLogs) (274399) Building response >Thread-18::DEBUG::2014-07-08 17:12:48,009::__init__::225::IOProcess::(_processLogs) (274399) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:48,010::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:48,010::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:12:48,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:12:48,161::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000795891 s, 580 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:12:48,166::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:48,168::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:48,169::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:48,170::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:48,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:48,172::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:48,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:48,174::__init__::225::IOProcess::(_processLogs) (274400) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:48,176::__init__::225::IOProcess::(_processLogs) (274400) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:48,177::__init__::225::IOProcess::(_processLogs) (274400) Building response >Thread-18::DEBUG::2014-07-08 17:12:48,179::__init__::225::IOProcess::(_processLogs) (274400) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:48,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:48,181::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:12:48,188::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:48,190::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:12:48,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:48,193::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:48,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:48,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:48,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:48,199::__init__::225::IOProcess::(_processLogs) (274401) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:48,200::__init__::225::IOProcess::(_processLogs) (274401) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:48,201::__init__::225::IOProcess::(_processLogs) (274401) Building response >Thread-18::DEBUG::2014-07-08 17:12:48,203::__init__::225::IOProcess::(_processLogs) (274401) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:48,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:48,205::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:48,211::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:48,218::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7087::DEBUG::2014-07-08 17:12:48,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cf783eb-2dcb-448c-8391-62ad72ccc895`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:12:48,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::INFO::2014-07-08 17:12:48,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::DEBUG::2014-07-08 17:12:48,225::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::INFO::2014-07-08 17:12:48,227::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505917', 'lastCheck': '10.2', 'valid': True}} >Thread-18::DEBUG::2014-07-08 17:12:48,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::DEBUG::2014-07-08 17:12:48,229::task::1191::Storage.TaskManager.Task::(prepare) Task=`9cf783eb-2dcb-448c-8391-62ad72ccc895`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505917', 'lastCheck': '10.2', 'valid': True}} >Thread-18::DEBUG::2014-07-08 17:12:48,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7087::DEBUG::2014-07-08 17:12:48,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cf783eb-2dcb-448c-8391-62ad72ccc895`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:48,234::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:12:48,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::DEBUG::2014-07-08 17:12:48,237::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:12:48,237::__init__::225::IOProcess::(_processLogs) (274402) Finding callback 'access'... >Thread-7087::DEBUG::2014-07-08 17:12:48,240::task::993::Storage.TaskManager.Task::(_decref) Task=`9cf783eb-2dcb-448c-8391-62ad72ccc895`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:12:48,241::__init__::225::IOProcess::(_processLogs) (274402) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:48,244::__init__::225::IOProcess::(_processLogs) (274402) Building response >Thread-18::DEBUG::2014-07-08 17:12:48,249::__init__::225::IOProcess::(_processLogs) (274402) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:48,254::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:48,259::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:48,269::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:48,272::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:12:48,274::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:48,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:48,280::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:48,284::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:48,287::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:48,290::__init__::225::IOProcess::(_processLogs) (274403) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:48,292::__init__::225::IOProcess::(_processLogs) (274403) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:48,300::__init__::225::IOProcess::(_processLogs) (274403) Building response >Thread-18::DEBUG::2014-07-08 17:12:48,303::__init__::225::IOProcess::(_processLogs) (274403) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:48,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:48,309::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:12:48,351::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:49,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:49,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174805 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:50,114::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:50,115::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:50,116::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:51,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:52,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242606 s, 42.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:12:52,950::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:12:52,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bf3d8bf-e23d-41f8-aad3-61a1946bee5f`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:12:52,952::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:12:52,967::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:52,968::task::1191::Storage.TaskManager.Task::(prepare) Task=`0bf3d8bf-e23d-41f8-aad3-61a1946bee5f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:12:52,968::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bf3d8bf-e23d-41f8-aad3-61a1946bee5f`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:12:52,968::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:12:52,968::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:12:52,969::task::993::Storage.TaskManager.Task::(_decref) Task=`0bf3d8bf-e23d-41f8-aad3-61a1946bee5f`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:12:52,980::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:12:52,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fc1b726-dbfd-462a-a848-433ab70e29fe`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:12:52,981::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:12:52,982::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3efa9ab8-7714-47b5-8802-e387657e3b91`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:12:52,982::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:12:52,983::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:12:52,983::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3efa9ab8-7714-47b5-8802-e387657e3b91`::Granted request >Thread-7083::DEBUG::2014-07-08 17:12:52,984::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8fc1b726-dbfd-462a-a848-433ab70e29fe`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:12:52,984::task::993::Storage.TaskManager.Task::(_decref) Task=`8fc1b726-dbfd-462a-a848-433ab70e29fe`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:12:53,003::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:53,004::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fc1b726-dbfd-462a-a848-433ab70e29fe`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:12:53,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fc1b726-dbfd-462a-a848-433ab70e29fe`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:12:53,004::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:12:53,005::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:12:53,005::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:12:53,005::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:12:53,006::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:12:53,006::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:12:53,006::task::993::Storage.TaskManager.Task::(_decref) Task=`8fc1b726-dbfd-462a-a848-433ab70e29fe`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:12:54,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:54,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178149 s, 57.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:55,123::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:55,124::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:12:55,125::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:12:56,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:56,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174825 s, 58.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:12:56,760::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-18::DEBUG::2014-07-08 17:12:58,318::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:58,318::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:58,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:58,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:58,319::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:58,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:58,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:58,320::__init__::225::IOProcess::(_processLogs) (274404) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:58,320::__init__::225::IOProcess::(_processLogs) (274404) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:58,320::__init__::225::IOProcess::(_processLogs) (274404) Building response >Thread-18::DEBUG::2014-07-08 17:12:58,321::__init__::225::IOProcess::(_processLogs) (274404) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:58,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:58,321::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:12:58,323::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:12:58,474::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00046597 s, 991 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:12:58,479::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:58,481::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:12:58,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:58,484::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:58,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:58,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:58,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:58,488::__init__::225::IOProcess::(_processLogs) (274405) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:12:58,489::__init__::225::IOProcess::(_processLogs) (274405) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:12:58,490::__init__::225::IOProcess::(_processLogs) (274405) Building response >Thread-18::DEBUG::2014-07-08 17:12:58,492::__init__::225::IOProcess::(_processLogs) (274405) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:58,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:58,494::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:12:58,503::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:58,505::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:12:58,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:58,507::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:58,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:58,510::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:58,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:58,512::__init__::225::IOProcess::(_processLogs) (274406) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:58,513::__init__::225::IOProcess::(_processLogs) (274406) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:58,515::__init__::225::IOProcess::(_processLogs) (274406) Building response >Thread-18::DEBUG::2014-07-08 17:12:58,516::__init__::225::IOProcess::(_processLogs) (274406) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:58,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:58,519::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:58,524::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:58,525::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:12:58,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:58,528::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:58,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:58,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:58,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:58,534::__init__::225::IOProcess::(_processLogs) (274407) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:58,535::__init__::225::IOProcess::(_processLogs) (274407) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:58,537::__init__::225::IOProcess::(_processLogs) (274407) Building response >Thread-18::DEBUG::2014-07-08 17:12:58,539::__init__::225::IOProcess::(_processLogs) (274407) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:58,540::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:58,541::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:12:58,545::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:12:58,547::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:12:58,548::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:12:58,550::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:12:58,551::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:12:58,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:12:58,553::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:12:58,555::__init__::225::IOProcess::(_processLogs) (274408) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:12:58,556::__init__::225::IOProcess::(_processLogs) (274408) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:12:58,558::__init__::225::IOProcess::(_processLogs) (274408) Building response >Thread-18::DEBUG::2014-07-08 17:12:58,559::__init__::225::IOProcess::(_processLogs) (274408) Queuing response >Thread-18::DEBUG::2014-07-08 17:12:58,560::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:12:58,561::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:12:58,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:12:58,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244882 s, 41.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:00,136::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:00,139::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:00,140::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:00,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:01,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0212209 s, 48.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:13:02,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`60219b79-6319-44a7-8716-10fd47cf98bb`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:13:02,590::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:13:02,591::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:02,592::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:13:02,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:02,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:02,593::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:02,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:02,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:02,594::__init__::225::IOProcess::(_processLogs) (274409) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:13:02,594::__init__::225::IOProcess::(_processLogs) (274409) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:13:02,594::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274409) Building response >Thread-18::DEBUG::2014-07-08 17:13:02,594::__init__::225::IOProcess::(_processLogs) (274409) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:02,595::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:02,595::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:13:02,597::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:02,597::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:13:02,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:02,598::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:02,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:02,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:02,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:02,599::__init__::225::IOProcess::(_processLogs) (274410) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:13:02,599::__init__::225::IOProcess::(_processLogs) (274410) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:13:02,599::__init__::225::IOProcess::(_processLogs) (274410) Building response >Thread-18::DEBUG::2014-07-08 17:13:02,600::__init__::225::IOProcess::(_processLogs) (274410) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:02,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:02,600::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:13:02,601::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:13:02,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`60219b79-6319-44a7-8716-10fd47cf98bb`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:13:02,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`60219b79-6319-44a7-8716-10fd47cf98bb`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:13:02,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:13:02,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:13:02,603::task::993::Storage.TaskManager.Task::(_decref) Task=`60219b79-6319-44a7-8716-10fd47cf98bb`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:13:02,685::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:13:02,685::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:13:03,020::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:13:03,021::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f5cf7eb-8c91-4ad0-a901-a20fec43e32e`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:03,022::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:13:03,036::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:03,037::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f5cf7eb-8c91-4ad0-a901-a20fec43e32e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:03,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f5cf7eb-8c91-4ad0-a901-a20fec43e32e`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:03,037::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:03,037::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:03,038::task::993::Storage.TaskManager.Task::(_decref) Task=`4f5cf7eb-8c91-4ad0-a901-a20fec43e32e`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:13:03,050::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:13:03,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`21c2b925-3168-4733-98c6-4bfb957efb30`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:13:03,051::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:13:03,052::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a1bd1b8a-07f8-4834-81a2-c48220414520`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:13:03,053::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:13:03,053::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:13:03,053::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a1bd1b8a-07f8-4834-81a2-c48220414520`::Granted request >Thread-7083::DEBUG::2014-07-08 17:13:03,054::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`21c2b925-3168-4733-98c6-4bfb957efb30`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:13:03,054::task::993::Storage.TaskManager.Task::(_decref) Task=`21c2b925-3168-4733-98c6-4bfb957efb30`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:13:03,073::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:03,074::task::1191::Storage.TaskManager.Task::(prepare) Task=`21c2b925-3168-4733-98c6-4bfb957efb30`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:03,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`21c2b925-3168-4733-98c6-4bfb957efb30`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:13:03,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:13:03,075::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:13:03,075::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:13:03,075::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:13:03,076::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:13:03,076::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:13:03,076::task::993::Storage.TaskManager.Task::(_decref) Task=`21c2b925-3168-4733-98c6-4bfb957efb30`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:13:03,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:03,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179691 s, 57.0 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:13:03,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`9770e1f1-06bb-4e1c-a800-fe374f3e187f`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:03,478::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:13:03,478::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046597', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:13:03,478::task::1191::Storage.TaskManager.Task::(prepare) Task=`9770e1f1-06bb-4e1c-a800-fe374f3e187f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046597', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:13:03,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`9770e1f1-06bb-4e1c-a800-fe374f3e187f`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:03,479::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:03,479::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:03,479::task::993::Storage.TaskManager.Task::(_decref) Task=`9770e1f1-06bb-4e1c-a800-fe374f3e187f`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:13:03,516::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:05,149::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:05,154::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:05,158::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:05,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:05,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479524 s, 21.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:13:07,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:08,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175437 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:08,567::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:08,567::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:08,568::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:08,568::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:08,568::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:08,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:08,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:08,569::__init__::225::IOProcess::(_processLogs) (274411) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:08,569::__init__::225::IOProcess::(_processLogs) (274411) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:08,570::__init__::225::IOProcess::(_processLogs) (274411) Building response >Thread-18::DEBUG::2014-07-08 17:13:08,570::__init__::225::IOProcess::(_processLogs) (274411) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:08,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:08,570::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:13:08,572::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:13:08,723::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000469601 s, 984 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:08,725::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:08,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:08,726::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:08,726::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:08,726::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:08,727::__init__::225::IOProcess::(_processLogs) (274412) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:08,727::__init__::225::IOProcess::(_processLogs) (274412) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:08,727::__init__::225::IOProcess::(_processLogs) (274412) Building response >Thread-18::DEBUG::2014-07-08 17:13:08,727::__init__::225::IOProcess::(_processLogs) (274412) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:08,728::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:08,728::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:13:08,730::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:13:08,730::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:08,730::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:08,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:08,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:08,731::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:08,731::__init__::225::IOProcess::(_processLogs) (274413) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:08,732::__init__::225::IOProcess::(_processLogs) (274413) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:08,732::__init__::225::IOProcess::(_processLogs) (274413) Building response >Thread-18::DEBUG::2014-07-08 17:13:08,732::__init__::225::IOProcess::(_processLogs) (274413) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:08,732::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:08,733::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:08,734::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:08,734::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:13:08,734::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:08,734::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:08,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:08,735::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:08,735::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:08,735::__init__::225::IOProcess::(_processLogs) (274414) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:08,736::__init__::225::IOProcess::(_processLogs) (274414) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:08,736::__init__::225::IOProcess::(_processLogs) (274414) Building response >Thread-18::DEBUG::2014-07-08 17:13:08,736::__init__::225::IOProcess::(_processLogs) (274414) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:08,736::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:08,737::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:08,738::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:08,738::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:13:08,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:08,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:08,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:08,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:08,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:08,739::__init__::225::IOProcess::(_processLogs) (274415) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:08,740::__init__::225::IOProcess::(_processLogs) (274415) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:08,740::__init__::225::IOProcess::(_processLogs) (274415) Building response >Thread-18::DEBUG::2014-07-08 17:13:08,740::__init__::225::IOProcess::(_processLogs) (274415) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:08,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:08,741::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:13:10,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:10,208::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:10,215::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:10,220::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:10,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320192 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:13:12,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:12,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176102 s, 58.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:13:13,096::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [30742acc] >Thread-7087::DEBUG::2014-07-08 17:13:13,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`67ed9274-46e2-492a-9f3c-3e2816df79f5`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:13,098::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:13:13,113::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:13,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`67ed9274-46e2-492a-9f3c-3e2816df79f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:13,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`67ed9274-46e2-492a-9f3c-3e2816df79f5`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:13,114::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:13,114::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:13,114::task::993::Storage.TaskManager.Task::(_decref) Task=`67ed9274-46e2-492a-9f3c-3e2816df79f5`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:13:13,126::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [30742acc] >Thread-7083::DEBUG::2014-07-08 17:13:13,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a32c09a-fe32-4fbf-8f06-3fe45d5b654f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:13:13,127::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:13:13,128::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f45d4ed0-e368-4158-880c-ffc0f0e214a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:13:13,129::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:13:13,129::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:13:13,129::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f45d4ed0-e368-4158-880c-ffc0f0e214a2`::Granted request >Thread-7083::DEBUG::2014-07-08 17:13:13,130::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0a32c09a-fe32-4fbf-8f06-3fe45d5b654f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:13:13,130::task::993::Storage.TaskManager.Task::(_decref) Task=`0a32c09a-fe32-4fbf-8f06-3fe45d5b654f`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:13:13,149::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:13,150::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a32c09a-fe32-4fbf-8f06-3fe45d5b654f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:13,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a32c09a-fe32-4fbf-8f06-3fe45d5b654f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:13:13,150::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:13:13,151::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:13:13,151::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:13:13,151::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:13:13,152::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:13:13,152::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:13:13,152::task::993::Storage.TaskManager.Task::(_decref) Task=`0a32c09a-fe32-4fbf-8f06-3fe45d5b654f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:13:14,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:14,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171545 s, 59.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:15,230::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:15,231::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:15,232::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:16,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:17,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173649 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:13:17,764::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:13:17,765::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:13:18,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`bca6c4df-91ac-4c3d-ab61-228291007966`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:18,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:13:18,626::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469601', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:13:18,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`bca6c4df-91ac-4c3d-ab61-228291007966`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469601', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:13:18,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`bca6c4df-91ac-4c3d-ab61-228291007966`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:18,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:18,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:18,627::task::993::Storage.TaskManager.Task::(_decref) Task=`bca6c4df-91ac-4c3d-ab61-228291007966`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:13:18,658::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:13:18,743::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:18,744::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:18,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:18,744::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:18,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:18,745::__init__::225::IOProcess::(_processLogs) (274416) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:18,745::__init__::225::IOProcess::(_processLogs) (274416) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:18,745::__init__::225::IOProcess::(_processLogs) (274416) Building response >Thread-18::DEBUG::2014-07-08 17:13:18,746::__init__::225::IOProcess::(_processLogs) (274416) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:18,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:18,746::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:13:18,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:13:18,901::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000571287 s, 809 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:18,910::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:18,912::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:18,913::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:18,914::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:18,921::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:18,923::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:18,924::__init__::225::IOProcess::(_processLogs) (274417) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:18,925::__init__::225::IOProcess::(_processLogs) (274417) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:18,927::__init__::225::IOProcess::(_processLogs) (274417) Building response >Thread-18::DEBUG::2014-07-08 17:13:18,929::__init__::225::IOProcess::(_processLogs) (274417) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:18,930::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:18,932::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:13:18,939::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:18,940::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:13:18,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:18,941::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:18,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:18,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:18,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:18,942::__init__::225::IOProcess::(_processLogs) (274418) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:18,942::__init__::225::IOProcess::(_processLogs) (274418) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:18,943::__init__::225::IOProcess::(_processLogs) (274418) Building response >Thread-18::DEBUG::2014-07-08 17:13:18,943::__init__::225::IOProcess::(_processLogs) (274418) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:18,944::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:18,945::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:18,949::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:18,950::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:13:18,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:18,951::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:18,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:18,952::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:18,952::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:18,952::__init__::225::IOProcess::(_processLogs) (274419) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:18,953::__init__::225::IOProcess::(_processLogs) (274419) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:18,953::__init__::225::IOProcess::(_processLogs) (274419) Building response >Thread-18::DEBUG::2014-07-08 17:13:18,953::__init__::225::IOProcess::(_processLogs) (274419) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:18,954::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:18,954::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:18,957::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:18,957::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:13:18,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:18,958::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:18,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:18,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:18,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:18,960::__init__::225::IOProcess::(_processLogs) (274420) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:18,962::__init__::225::IOProcess::(_processLogs) (274420) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:18,963::__init__::225::IOProcess::(_processLogs) (274420) Building response >Thread-18::DEBUG::2014-07-08 17:13:18,964::__init__::225::IOProcess::(_processLogs) (274420) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:18,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:18,967::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:13:19,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:19,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173576 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:20,239::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:20,241::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:20,242::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:21,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:21,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899966 s, 11.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:13:23,167::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:13:23,168::task::595::Storage.TaskManager.Task::(_updateState) Task=`9952d66b-8f35-489f-a4e0-70e875132911`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:23,168::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:13:23,183::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:23,184::task::1191::Storage.TaskManager.Task::(prepare) Task=`9952d66b-8f35-489f-a4e0-70e875132911`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:23,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`9952d66b-8f35-489f-a4e0-70e875132911`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:23,184::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:23,184::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:23,185::task::993::Storage.TaskManager.Task::(_decref) Task=`9952d66b-8f35-489f-a4e0-70e875132911`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:13:23,196::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:13:23,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`6719ffcb-c230-4cf2-b154-b15794b2360f`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:13:23,198::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:13:23,199::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`23155713-7e7a-4d90-8141-96ae4ae008fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:13:23,199::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:13:23,199::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:13:23,200::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`23155713-7e7a-4d90-8141-96ae4ae008fb`::Granted request >Thread-7083::DEBUG::2014-07-08 17:13:23,200::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6719ffcb-c230-4cf2-b154-b15794b2360f`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:13:23,201::task::993::Storage.TaskManager.Task::(_decref) Task=`6719ffcb-c230-4cf2-b154-b15794b2360f`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:13:23,220::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:23,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`6719ffcb-c230-4cf2-b154-b15794b2360f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:23,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`6719ffcb-c230-4cf2-b154-b15794b2360f`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:13:23,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:13:23,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:13:23,222::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:13:23,222::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:13:23,222::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:13:23,222::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:13:23,223::task::993::Storage.TaskManager.Task::(_decref) Task=`6719ffcb-c230-4cf2-b154-b15794b2360f`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:13:23,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:24,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362425 s, 28.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:25,248::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:25,250::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:25,251::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:26,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:26,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175769 s, 58.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:13:27,064::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:13:28,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:28,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176054 s, 58.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:28,973::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:28,974::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:28,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:28,975::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:28,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:28,975::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:28,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:28,976::__init__::225::IOProcess::(_processLogs) (274421) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:28,976::__init__::225::IOProcess::(_processLogs) (274421) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:28,976::__init__::225::IOProcess::(_processLogs) (274421) Building response >Thread-18::DEBUG::2014-07-08 17:13:28,976::__init__::225::IOProcess::(_processLogs) (274421) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:28,977::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:28,977::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:13:28,979::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:13:29,143::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000717112 s, 644 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:29,149::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:29,149::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:29,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:29,150::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:29,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:29,151::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:29,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:29,152::__init__::225::IOProcess::(_processLogs) (274422) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:29,152::__init__::225::IOProcess::(_processLogs) (274422) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:29,153::__init__::225::IOProcess::(_processLogs) (274422) Building response >Thread-18::DEBUG::2014-07-08 17:13:29,153::__init__::225::IOProcess::(_processLogs) (274422) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:29,153::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:29,154::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:13:29,161::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:29,163::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:13:29,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:29,166::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:29,167::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:29,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:29,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:29,172::__init__::225::IOProcess::(_processLogs) DEBUG|(274423) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:29,174::__init__::225::IOProcess::(_processLogs) (274423) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:29,175::__init__::225::IOProcess::(_processLogs) (274423) Building response >Thread-18::DEBUG::2014-07-08 17:13:29,177::__init__::225::IOProcess::(_processLogs) (274423) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:29,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:29,180::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:29,185::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:29,186::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:13:29,188::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:29,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:29,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:29,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:29,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:29,194::__init__::225::IOProcess::(_processLogs) (274424) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:29,195::__init__::225::IOProcess::(_processLogs) (274424) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:29,197::__init__::225::IOProcess::(_processLogs) DEBUG|(274424) Building response >Thread-18::DEBUG::2014-07-08 17:13:29,198::__init__::225::IOProcess::(_processLogs) (274424) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:29,200::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:29,201::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:29,206::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:29,207::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:13:29,208::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:29,210::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:29,211::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:29,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:29,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:29,218::__init__::225::IOProcess::(_processLogs) (274425) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:29,219::__init__::225::IOProcess::(_processLogs) (274425) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:29,221::__init__::225::IOProcess::(_processLogs) (274425) Building response >Thread-18::DEBUG::2014-07-08 17:13:29,222::__init__::225::IOProcess::(_processLogs) (274425) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:29,224::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:29,226::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:30,258::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:30,259::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:30,260::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:30,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:30,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174305 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:13:32,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:33,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0213865 s, 47.9 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:13:33,163::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:13:33,164::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:13:33,238::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:13:33,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`d648e027-e991-4621-b3c5-38eba1bd0dee`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:33,240::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:13:33,257::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:33,258::task::1191::Storage.TaskManager.Task::(prepare) Task=`d648e027-e991-4621-b3c5-38eba1bd0dee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:33,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`d648e027-e991-4621-b3c5-38eba1bd0dee`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:33,258::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:33,259::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:33,259::task::993::Storage.TaskManager.Task::(_decref) Task=`d648e027-e991-4621-b3c5-38eba1bd0dee`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:13:33,272::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:13:33,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`7068f4dd-6581-4990-a743-31fadedcc7f0`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:13:33,273::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:13:33,274::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a98ad221-35d2-4438-ada5-a686bd89085a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:13:33,274::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:13:33,275::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:13:33,275::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a98ad221-35d2-4438-ada5-a686bd89085a`::Granted request >Thread-7083::DEBUG::2014-07-08 17:13:33,276::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7068f4dd-6581-4990-a743-31fadedcc7f0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:13:33,276::task::993::Storage.TaskManager.Task::(_decref) Task=`7068f4dd-6581-4990-a743-31fadedcc7f0`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:13:33,295::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:33,295::task::1191::Storage.TaskManager.Task::(prepare) Task=`7068f4dd-6581-4990-a743-31fadedcc7f0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:33,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`7068f4dd-6581-4990-a743-31fadedcc7f0`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:13:33,296::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:13:33,296::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:13:33,297::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:13:33,297::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:13:33,297::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:13:33,297::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:13:33,298::task::993::Storage.TaskManager.Task::(_decref) Task=`7068f4dd-6581-4990-a743-31fadedcc7f0`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:13:33,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6319b9d-fa25-4d59-89b7-4f8bd60f0900`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:33,821::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:13:33,821::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717112', 'lastCheck': '4.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:13:33,822::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6319b9d-fa25-4d59-89b7-4f8bd60f0900`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717112', 'lastCheck': '4.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:13:33,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6319b9d-fa25-4d59-89b7-4f8bd60f0900`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:33,822::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:33,822::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:33,823::task::993::Storage.TaskManager.Task::(_decref) Task=`b6319b9d-fa25-4d59-89b7-4f8bd60f0900`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:13:33,853::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:35,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:35,354::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:35,356::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:35,358::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:35,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037422 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:13:37,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:38,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101368 s, 10.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:39,233::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:39,233::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:39,234::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:39,235::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:39,235::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:39,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:39,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:39,236::__init__::225::IOProcess::(_processLogs) (274426) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:39,236::__init__::225::IOProcess::(_processLogs) (274426) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:39,236::__init__::225::IOProcess::(_processLogs) (274426) Building response >Thread-18::DEBUG::2014-07-08 17:13:39,236::__init__::225::IOProcess::(_processLogs) (274426) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:39,237::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:39,237::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:13:39,238::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:13:39,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00046541 s, 993 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:39,394::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:39,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:39,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:39,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:39,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:39,402::__init__::225::IOProcess::(_processLogs) (274427) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:39,404::__init__::225::IOProcess::(_processLogs) (274427) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:39,405::__init__::225::IOProcess::(_processLogs) (274427) Building response >Thread-18::DEBUG::2014-07-08 17:13:39,407::__init__::225::IOProcess::(_processLogs) (274427) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:39,408::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:39,409::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:13:39,419::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:13:39,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:39,423::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:39,424::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:39,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:39,427::__init__::225::IOProcess::(_processLogs) (274428) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:39,429::__init__::225::IOProcess::(_processLogs) (274428) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:39,430::__init__::225::IOProcess::(_processLogs) (274428) Building response >Thread-18::DEBUG::2014-07-08 17:13:39,432::__init__::225::IOProcess::(_processLogs) (274428) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:39,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:39,434::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:39,439::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:13:39,441::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:39,443::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:39,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:39,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:39,448::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:39,449::__init__::225::IOProcess::(_processLogs) (274429) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:39,451::__init__::225::IOProcess::(_processLogs) (274429) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:39,453::__init__::225::IOProcess::(_processLogs) (274429) Building response >Thread-18::DEBUG::2014-07-08 17:13:39,454::__init__::225::IOProcess::(_processLogs) (274429) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:39,456::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:39,457::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:39,462::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:39,463::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:13:39,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:39,466::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:39,468::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:39,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:39,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:39,472::__init__::225::IOProcess::(_processLogs) (274430) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:39,474::__init__::225::IOProcess::(_processLogs) (274430) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:39,476::__init__::225::IOProcess::(_processLogs) (274430) Building response >Thread-18::DEBUG::2014-07-08 17:13:39,477::__init__::225::IOProcess::(_processLogs) (274430) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:39,479::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:39,480::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:13:40,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:40,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398513 s, 25.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:40,367::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:40,371::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:40,375::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:42,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:42,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174026 s, 58.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:13:43,341::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:13:43,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a9898ee-5327-493b-a043-63aab3d97ee1`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:43,344::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:13:43,370::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:43,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a9898ee-5327-493b-a043-63aab3d97ee1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:43,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a9898ee-5327-493b-a043-63aab3d97ee1`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:43,371::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:43,371::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:43,372::task::993::Storage.TaskManager.Task::(_decref) Task=`5a9898ee-5327-493b-a043-63aab3d97ee1`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:13:43,384::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:13:43,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`82b21d3d-6837-4f3f-9ec1-405629bd2bfe`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:13:43,385::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:13:43,386::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e50bd5b6-e8b3-489d-8d74-bb887631f6c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:13:43,386::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:13:43,387::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:13:43,387::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e50bd5b6-e8b3-489d-8d74-bb887631f6c6`::Granted request >Thread-7083::DEBUG::2014-07-08 17:13:43,388::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`82b21d3d-6837-4f3f-9ec1-405629bd2bfe`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:13:43,388::task::993::Storage.TaskManager.Task::(_decref) Task=`82b21d3d-6837-4f3f-9ec1-405629bd2bfe`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:13:43,415::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:43,415::task::1191::Storage.TaskManager.Task::(prepare) Task=`82b21d3d-6837-4f3f-9ec1-405629bd2bfe`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:43,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`82b21d3d-6837-4f3f-9ec1-405629bd2bfe`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:13:43,416::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:13:43,416::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:13:43,416::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:13:43,417::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:13:43,417::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:13:43,417::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:13:43,418::task::993::Storage.TaskManager.Task::(_decref) Task=`82b21d3d-6837-4f3f-9ec1-405629bd2bfe`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:13:44,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:44,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174744 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:45,384::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:45,385::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:45,386::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:46,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:47,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175783 s, 58.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:13:48,199::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:13:48,199::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:13:48,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6e46ce0-a9a9-406c-b976-6562adff72b7`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:48,958::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:13:48,958::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046541', 'lastCheck': '9.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:13:48,959::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6e46ce0-a9a9-406c-b976-6562adff72b7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046541', 'lastCheck': '9.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:13:48,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6e46ce0-a9a9-406c-b976-6562adff72b7`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:48,959::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:48,959::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:48,960::task::993::Storage.TaskManager.Task::(_decref) Task=`e6e46ce0-a9a9-406c-b976-6562adff72b7`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:13:48,991::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:49,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:49,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174725 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:49,485::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:49,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:49,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:49,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:49,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:49,487::__init__::225::IOProcess::(_processLogs) (274431) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:49,487::__init__::225::IOProcess::(_processLogs) (274431) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:49,487::__init__::225::IOProcess::(_processLogs) (274431) Building response >Thread-18::DEBUG::2014-07-08 17:13:49,488::__init__::225::IOProcess::(_processLogs) (274431) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:49,488::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:13:49,489::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:13:49,640::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0004615 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:49,645::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:49,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:49,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:49,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:49,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:49,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:49,654::__init__::225::IOProcess::(_processLogs) (274432) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:49,656::__init__::225::IOProcess::(_processLogs) (274432) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:49,658::__init__::225::IOProcess::(_processLogs) (274432) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:49,659::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:49,660::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:13:49,669::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:13:49,670::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:49,672::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:49,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:49,676::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:49,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:49,679::__init__::225::IOProcess::(_processLogs) (274433) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:49,681::__init__::225::IOProcess::(_processLogs) (274433) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:49,682::__init__::225::IOProcess::(_processLogs) (274433) Building response >Thread-18::DEBUG::2014-07-08 17:13:49,684::__init__::225::IOProcess::(_processLogs) (274433) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:49,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:49,687::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:49,692::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:49,694::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:13:49,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:49,696::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:49,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:49,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:49,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:49,703::__init__::225::IOProcess::(_processLogs) (274434) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:49,704::__init__::225::IOProcess::(_processLogs) (274434) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:49,706::__init__::225::IOProcess::(_processLogs) (274434) Building response >Thread-18::DEBUG::2014-07-08 17:13:49,707::__init__::225::IOProcess::(_processLogs) (274434) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:49,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:49,711::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:49,717::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:49,718::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:13:49,720::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:49,722::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:49,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:49,725::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:49,727::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:49,728::__init__::225::IOProcess::(_processLogs) (274435) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:49,730::__init__::225::IOProcess::(_processLogs) (274435) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:49,732::__init__::225::IOProcess::(_processLogs) (274435) Building response >Thread-18::DEBUG::2014-07-08 17:13:49,733::__init__::225::IOProcess::(_processLogs) (274435) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:49,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:49,736::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:50,394::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:50,395::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:50,396::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:51,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:51,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173149 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:13:53,432::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:13:53,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`80d6d1ce-828f-4f4d-b109-fc639b529463`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:13:53,434::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:13:53,453::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:53,453::task::1191::Storage.TaskManager.Task::(prepare) Task=`80d6d1ce-828f-4f4d-b109-fc639b529463`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:13:53,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`80d6d1ce-828f-4f4d-b109-fc639b529463`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:13:53,454::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:13:53,454::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:13:53,454::task::993::Storage.TaskManager.Task::(_decref) Task=`80d6d1ce-828f-4f4d-b109-fc639b529463`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:13:53,466::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:13:53,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eecc94c-fca9-475d-ae96-6139ca63ca77`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:13:53,467::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:13:53,468::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`669acf51-69e4-4738-8a30-cee4d146d800`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:13:53,468::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:13:53,472::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:13:53,473::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`669acf51-69e4-4738-8a30-cee4d146d800`::Granted request >Thread-7083::DEBUG::2014-07-08 17:13:53,473::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3eecc94c-fca9-475d-ae96-6139ca63ca77`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:13:53,474::task::993::Storage.TaskManager.Task::(_decref) Task=`3eecc94c-fca9-475d-ae96-6139ca63ca77`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:13:53,492::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:53,493::task::1191::Storage.TaskManager.Task::(prepare) Task=`3eecc94c-fca9-475d-ae96-6139ca63ca77`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:13:53,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eecc94c-fca9-475d-ae96-6139ca63ca77`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:13:53,493::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:13:53,494::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:13:53,494::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:13:53,494::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:13:53,495::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:13:53,495::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:13:53,495::task::993::Storage.TaskManager.Task::(_decref) Task=`3eecc94c-fca9-475d-ae96-6139ca63ca77`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:13:53,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:54,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0889348 s, 11.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:55,402::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:55,404::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:13:55,405::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:13:56,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:56,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205806 s, 49.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:13:57,389::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:13:58,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:13:58,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173171 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:59,743::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:59,744::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:59,744::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:59,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:59,744::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:59,745::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:59,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:59,745::__init__::225::IOProcess::(_processLogs) (274436) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:59,745::__init__::225::IOProcess::(_processLogs) (274436) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:59,746::__init__::225::IOProcess::(_processLogs) (274436) Building response >Thread-18::DEBUG::2014-07-08 17:13:59,746::__init__::225::IOProcess::(_processLogs) (274436) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:59,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:59,746::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:13:59,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:13:59,898::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000956801 s, 483 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:13:59,903::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:59,905::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:13:59,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:59,908::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:59,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:59,912::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:59,914::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:59,915::__init__::225::IOProcess::(_processLogs) (274437) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:13:59,917::__init__::225::IOProcess::(_processLogs) (274437) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:13:59,919::__init__::225::IOProcess::(_processLogs) DEBUG|(274437) Building response >Thread-18::DEBUG::2014-07-08 17:13:59,920::__init__::225::IOProcess::(_processLogs) (274437) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:59,922::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:59,923::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:13:59,932::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:59,933::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:13:59,934::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:59,936::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:59,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:59,938::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:59,940::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:59,942::__init__::225::IOProcess::(_processLogs) (274438) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:59,943::__init__::225::IOProcess::(_processLogs) (274438) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:59,945::__init__::225::IOProcess::(_processLogs) (274438) Building response >Thread-18::DEBUG::2014-07-08 17:13:59,946::__init__::225::IOProcess::(_processLogs) (274438) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:59,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:59,949::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:59,954::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:59,955::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:13:59,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:59,958::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:59,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:59,961::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:59,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:59,964::__init__::225::IOProcess::(_processLogs) (274439) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:59,965::__init__::225::IOProcess::(_processLogs) (274439) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:59,967::__init__::225::IOProcess::(_processLogs) (274439) Building response >Thread-18::DEBUG::2014-07-08 17:13:59,968::__init__::225::IOProcess::(_processLogs) (274439) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:59,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:59,972::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:13:59,976::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:13:59,978::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:13:59,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:13:59,981::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:13:59,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:13:59,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:13:59,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:13:59,988::__init__::225::IOProcess::(_processLogs) (274440) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:13:59,989::__init__::225::IOProcess::(_processLogs) (274440) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:13:59,990::__init__::225::IOProcess::(_processLogs) (274440) Building response >Thread-18::DEBUG::2014-07-08 17:13:59,991::__init__::225::IOProcess::(_processLogs) (274440) Queuing response >Thread-18::DEBUG::2014-07-08 17:13:59,992::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:13:59,993::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:00,412::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:00,414::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:00,415::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:00,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:00,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175085 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:14:02,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:03,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175658 s, 58.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:14:03,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fc0e6be-6080-4a17-9163-076321065176`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:14:03,360::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:14:03,362::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:03,362::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:14:03,363::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:03,363::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:03,363::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:03,363::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:03,364::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:03,364::__init__::225::IOProcess::(_processLogs) (274441) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:14:03,364::__init__::225::IOProcess::(_processLogs) (274441) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:14:03,364::__init__::225::IOProcess::(_processLogs) (274441) Building response >Thread-18::DEBUG::2014-07-08 17:14:03,365::__init__::225::IOProcess::(_processLogs) (274441) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:03,365::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:03,365::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:14:03,367::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:03,367::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:14:03,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:03,368::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:03,368::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:03,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:03,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:03,369::__init__::225::IOProcess::(_processLogs) (274442) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:14:03,369::__init__::225::IOProcess::(_processLogs) (274442) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:14:03,370::__init__::225::IOProcess::(_processLogs) (274442) Building response >Thread-18::DEBUG::2014-07-08 17:14:03,370::__init__::225::IOProcess::(_processLogs) (274442) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:03,370::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:03,370::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:14:03,371::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:14:03,372::task::1191::Storage.TaskManager.Task::(prepare) Task=`1fc0e6be-6080-4a17-9163-076321065176`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:14:03,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fc0e6be-6080-4a17-9163-076321065176`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:14:03,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:14:03,373::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:14:03,373::task::993::Storage.TaskManager.Task::(_decref) Task=`1fc0e6be-6080-4a17-9163-076321065176`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:14:03,454::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:14:03,455::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:14:03,511::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:14:03,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f649a05-8ec9-47b4-ae10-c4b112ff59da`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:03,512::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:14:03,527::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:03,528::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f649a05-8ec9-47b4-ae10-c4b112ff59da`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:03,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f649a05-8ec9-47b4-ae10-c4b112ff59da`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:03,528::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:03,528::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:03,529::task::993::Storage.TaskManager.Task::(_decref) Task=`1f649a05-8ec9-47b4-ae10-c4b112ff59da`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:14:03,541::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:14:03,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`1840ffb0-023d-4cbf-8464-dca6b7af211e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:14:03,542::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:14:03,543::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1a253565-70be-4434-8f1e-c11e96afc0a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:14:03,543::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:14:03,544::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:14:03,544::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1a253565-70be-4434-8f1e-c11e96afc0a5`::Granted request >Thread-7083::DEBUG::2014-07-08 17:14:03,545::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1840ffb0-023d-4cbf-8464-dca6b7af211e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:14:03,545::task::993::Storage.TaskManager.Task::(_decref) Task=`1840ffb0-023d-4cbf-8464-dca6b7af211e`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:14:03,564::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:03,564::task::1191::Storage.TaskManager.Task::(prepare) Task=`1840ffb0-023d-4cbf-8464-dca6b7af211e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:03,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`1840ffb0-023d-4cbf-8464-dca6b7af211e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:14:03,565::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:14:03,565::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:14:03,566::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:14:03,566::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:14:03,566::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:14:03,566::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:14:03,567::task::993::Storage.TaskManager.Task::(_decref) Task=`1840ffb0-023d-4cbf-8464-dca6b7af211e`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:14:04,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`03ac239e-80e9-4687-a11a-5f43cdfaf705`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:04,098::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:14:04,099::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000956801', 'lastCheck': '4.1', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:14:04,099::task::1191::Storage.TaskManager.Task::(prepare) Task=`03ac239e-80e9-4687-a11a-5f43cdfaf705`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000956801', 'lastCheck': '4.1', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:14:04,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`03ac239e-80e9-4687-a11a-5f43cdfaf705`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:04,099::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:04,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:04,100::task::993::Storage.TaskManager.Task::(_decref) Task=`03ac239e-80e9-4687-a11a-5f43cdfaf705`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:14:04,135::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:05,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:05,425::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:05,433::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:05,440::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:05,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045772 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:14:07,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:07,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171582 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:14:09,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:14:10,163::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:10,170::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:10,175::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:10,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:10,185::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:10,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:10,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:10,207::__init__::225::IOProcess::(_processLogs) (274443) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:10,217::__init__::225::IOProcess::(_processLogs) (274443) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:10,222::__init__::225::IOProcess::(_processLogs) (274443) Building response >Thread-18::DEBUG::2014-07-08 17:14:10,227::__init__::225::IOProcess::(_processLogs) (274443) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:10,231::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:10,246::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:14:10,365::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:10,670::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-37::DEBUG::2014-07-08 17:14:10,673::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000586373 s, 788 kB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:14:10,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.595022 s, 1.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:14:10,750::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:10,754::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:10,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:10,758::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:10,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:10,761::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:14:10,765::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:10,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:10,770::__init__::225::IOProcess::(_processLogs) (274444) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:10,773::__init__::225::IOProcess::(_processLogs) (274444) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:10,775::__init__::225::IOProcess::(_processLogs) (274444) Building response >Thread-18::DEBUG::2014-07-08 17:14:10,778::__init__::225::IOProcess::(_processLogs) (274444) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:10,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:10,787::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:10,789::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:14:10,807::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:10,810::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:14:10,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:10,816::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:10,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:10,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:10,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:10,825::__init__::225::IOProcess::(_processLogs) (274445) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:10,829::__init__::225::IOProcess::(_processLogs) (274445) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:10,831::__init__::225::IOProcess::(_processLogs) (274445) Building response >Thread-18::DEBUG::2014-07-08 17:14:10,834::__init__::225::IOProcess::(_processLogs) (274445) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:10,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:10,839::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:10,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:10,851::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:14:10,852::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:10,855::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:10,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:10,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:10,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:10,866::__init__::225::IOProcess::(_processLogs) (274446) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:10,868::__init__::225::IOProcess::(_processLogs) (274446) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:10,871::__init__::225::IOProcess::(_processLogs) (274446) Building response >Thread-18::DEBUG::2014-07-08 17:14:10,874::__init__::225::IOProcess::(_processLogs) (274446) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:10,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:14:10,879::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:10,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:10,891::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:14:10,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:10,896::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:10,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:10,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:10,903::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:10,905::__init__::225::IOProcess::(_processLogs) (274447) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:10,907::__init__::225::IOProcess::(_processLogs) (274447) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:10,910::__init__::225::IOProcess::(_processLogs) (274447) Building response >Thread-18::DEBUG::2014-07-08 17:14:10,913::__init__::225::IOProcess::(_processLogs) (274447) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:10,915::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:10,917::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:14:13,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:13,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171559 s, 59.7 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:14:13,580::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:14:13,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`b861ef40-438c-47d0-8e28-5213c4fde6d8`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:13,582::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:14:13,597::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:13,597::task::1191::Storage.TaskManager.Task::(prepare) Task=`b861ef40-438c-47d0-8e28-5213c4fde6d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:13,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`b861ef40-438c-47d0-8e28-5213c4fde6d8`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:13,598::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:13,598::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:13,599::task::993::Storage.TaskManager.Task::(_decref) Task=`b861ef40-438c-47d0-8e28-5213c4fde6d8`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:14:13,611::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:14:13,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d1415d9-76eb-42c6-b915-b5fd19d03303`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:14:13,612::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:14:13,613::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6aa77c8c-518e-4802-98bb-0e993bc6bb72`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:14:13,613::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:14:13,614::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:14:13,614::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`6aa77c8c-518e-4802-98bb-0e993bc6bb72`::Granted request >Thread-7083::DEBUG::2014-07-08 17:14:13,615::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d1415d9-76eb-42c6-b915-b5fd19d03303`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:14:13,615::task::993::Storage.TaskManager.Task::(_decref) Task=`8d1415d9-76eb-42c6-b915-b5fd19d03303`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:14:13,634::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:13,634::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d1415d9-76eb-42c6-b915-b5fd19d03303`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:13,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d1415d9-76eb-42c6-b915-b5fd19d03303`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:14:13,635::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:14:13,635::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:14:13,636::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:14:13,636::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:14:13,636::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:14:13,636::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:14:13,637::task::993::Storage.TaskManager.Task::(_decref) Task=`8d1415d9-76eb-42c6-b915-b5fd19d03303`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:14:15,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:15,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017342 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:15,813::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:15,815::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:15,816::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:17,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:17,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176336 s, 58.1 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:14:18,564::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:14:18,564::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:14:19,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`774d570f-5e95-4f7e-8d65-4f64ff40a8f0`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:19,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:14:19,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586373', 'lastCheck': '8.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:14:19,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`774d570f-5e95-4f7e-8d65-4f64ff40a8f0`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586373', 'lastCheck': '8.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:14:19,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`774d570f-5e95-4f7e-8d65-4f64ff40a8f0`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:19,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:19,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:19,315::task::993::Storage.TaskManager.Task::(_decref) Task=`774d570f-5e95-4f7e-8d65-4f64ff40a8f0`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:14:19,345::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:19,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:20,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174822 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:20,823::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:20,825::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:20,826::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:14:20,924::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:20,925::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:20,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:20,925::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:20,926::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:20,926::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:20,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:20,926::__init__::225::IOProcess::(_processLogs) (274448) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:20,927::__init__::225::IOProcess::(_processLogs) (274448) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:20,927::__init__::225::IOProcess::(_processLogs) (274448) Building response >Thread-18::DEBUG::2014-07-08 17:14:20,927::__init__::225::IOProcess::(_processLogs) (274448) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:20,927::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:20,928::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:14:20,929::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:14:21,078::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000495581 s, 932 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:14:21,186::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:21,197::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:21,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:21,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:21,210::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:21,220::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:21,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:21,230::__init__::225::IOProcess::(_processLogs) (274449) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:21,234::__init__::225::IOProcess::(_processLogs) (274449) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:21,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(274449) Building response >Thread-18::DEBUG::2014-07-08 17:14:21,248::__init__::225::IOProcess::(_processLogs) (274449) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:21,253::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:21,258::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:14:21,374::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:21,382::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:14:21,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:21,389::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:21,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:21,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:21,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:21,408::__init__::225::IOProcess::(_processLogs) (274450) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:21,411::__init__::225::IOProcess::(_processLogs) (274450) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:21,413::__init__::225::IOProcess::(_processLogs) (274450) Building response >Thread-18::DEBUG::2014-07-08 17:14:21,414::__init__::225::IOProcess::(_processLogs) (274450) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:21,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:21,416::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:21,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:21,424::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:14:21,425::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:21,426::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:21,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:21,428::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:21,429::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:21,431::__init__::225::IOProcess::(_processLogs) (274451) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:21,432::__init__::225::IOProcess::(_processLogs) (274451) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:21,438::__init__::225::IOProcess::(_processLogs) (274451) Building response >Thread-18::DEBUG::2014-07-08 17:14:21,439::__init__::225::IOProcess::(_processLogs) (274451) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:21,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:21,444::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:21,451::__init__::225::IOProcess::(_processLogs) (274451) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:21,452::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:14:21,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:21,456::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:21,457::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:21,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:21,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:21,461::__init__::225::IOProcess::(_processLogs) (274452) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:21,463::__init__::225::IOProcess::(_processLogs) (274452) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:21,464::__init__::225::IOProcess::(_processLogs) (274452) Building response >Thread-18::DEBUG::2014-07-08 17:14:21,466::__init__::225::IOProcess::(_processLogs) (274452) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:21,467::__init__::225::IOProcess::(_processLogs) (274451) Finding callback 'access'...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:14:21,469::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:14:22,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:22,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175565 s, 58.3 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:14:23,651::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:14:23,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`231a5efb-4761-42e7-9c34-66e333cba9fe`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:23,652::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:14:23,667::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:23,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`231a5efb-4761-42e7-9c34-66e333cba9fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:23,668::task::595::Storage.TaskManager.Task::(_updateState) Task=`231a5efb-4761-42e7-9c34-66e333cba9fe`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:23,668::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:23,668::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:23,668::task::993::Storage.TaskManager.Task::(_decref) Task=`231a5efb-4761-42e7-9c34-66e333cba9fe`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:14:23,681::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:14:23,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`76929cb1-41d5-466f-ae30-1b228baa0195`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:14:23,682::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:14:23,683::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ae9ffc51-21ea-4566-ba32-0ad17f0e8006`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:14:23,683::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:14:23,683::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:14:23,684::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ae9ffc51-21ea-4566-ba32-0ad17f0e8006`::Granted request >Thread-7083::DEBUG::2014-07-08 17:14:23,684::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`76929cb1-41d5-466f-ae30-1b228baa0195`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:14:23,685::task::993::Storage.TaskManager.Task::(_decref) Task=`76929cb1-41d5-466f-ae30-1b228baa0195`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:14:23,703::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:23,704::task::1191::Storage.TaskManager.Task::(prepare) Task=`76929cb1-41d5-466f-ae30-1b228baa0195`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:23,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`76929cb1-41d5-466f-ae30-1b228baa0195`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:14:23,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:14:23,705::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:14:23,705::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:14:23,705::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:14:23,706::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:14:23,706::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:14:23,706::task::993::Storage.TaskManager.Task::(_decref) Task=`76929cb1-41d5-466f-ae30-1b228baa0195`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:14:24,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:24,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172898 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:25,833::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:25,835::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:25,836::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:26,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:26,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177317 s, 57.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:14:27,873::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:14:28,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:29,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177518 s, 57.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:30,843::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:30,844::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:30,845::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:31,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:31,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0217254 s, 47.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:14:31,498::__init__::225::IOProcess::(_processLogs) (274451) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:31,506::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:31,515::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:31,521::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:31,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:31,532::__init__::225::IOProcess::(_processLogs) (274451) Finding callback 'access'...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:31,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:31,552::__init__::225::IOProcess::(_processLogs) (274453) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:31,561::__init__::225::IOProcess::(_processLogs) (274453) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:31,570::__init__::225::IOProcess::(_processLogs) (274453) Building response >Thread-18::DEBUG::2014-07-08 17:14:31,577::__init__::225::IOProcess::(_processLogs) (274453) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:31,583::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:31,589::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:14:31,616::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:14:31,777::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000610956 s, 756 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:14:31,794::__init__::225::IOProcess::(_processLogs) (274451) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:31,802::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:31,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:31,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:31,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:31,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:31,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:31,819::__init__::225::IOProcess::(_processLogs) (274454) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:31,821::__init__::225::IOProcess::(_processLogs) (274454) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:31,823::__init__::225::IOProcess::(_processLogs) (274454) Building response >Thread-18::DEBUG::2014-07-08 17:14:31,827::__init__::225::IOProcess::(_processLogs) (274454) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:31,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:31,832::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:14:31,847::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:31,851::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:14:31,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:31,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:31,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:31,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:31,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:31,867::__init__::225::IOProcess::(_processLogs) (274455) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:31,870::__init__::225::IOProcess::(_processLogs) (274455) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:31,873::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(274455) Building response >Thread-18::DEBUG::2014-07-08 17:14:31,875::__init__::225::IOProcess::(_processLogs) (274455) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:31,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:31,884::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:31,984::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:31,987::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:14:32,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:32,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:32,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:32,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:32,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:32,015::__init__::225::IOProcess::(_processLogs) (274456) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:32,018::__init__::225::IOProcess::(_processLogs) (274456) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:32,021::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(274456) Building response >Thread-18::DEBUG::2014-07-08 17:14:32,027::__init__::225::IOProcess::(_processLogs) (274456) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:32,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:32,033::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:32,042::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:32,046::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:14:32,049::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:32,052::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:32,055::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:32,142::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:32,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:32,152::__init__::225::IOProcess::(_processLogs) (274457) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:32,167::__init__::225::IOProcess::(_processLogs) (274457) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:32,170::__init__::225::IOProcess::(_processLogs) (274457) Building response >Thread-18::DEBUG::2014-07-08 17:14:32,173::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(274457) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:32,175::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:32,178::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:14:33,600::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:14:33,601::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:14:33,725::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:14:33,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cab8827-3b60-487c-96bd-11f26d71e558`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:33,727::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:14:33,743::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:33,743::task::1191::Storage.TaskManager.Task::(prepare) Task=`0cab8827-3b60-487c-96bd-11f26d71e558`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:33,744::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cab8827-3b60-487c-96bd-11f26d71e558`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:33,744::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:33,744::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:33,745::task::993::Storage.TaskManager.Task::(_decref) Task=`0cab8827-3b60-487c-96bd-11f26d71e558`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:14:33,758::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:14:33,759::task::595::Storage.TaskManager.Task::(_updateState) Task=`a819b48b-3688-47c9-b47c-c813b526068d`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:14:33,759::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:14:33,760::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9fd3bbcf-126a-4e22-9ac8-a0857d2ad52a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:14:33,761::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:14:33,761::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:14:33,761::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9fd3bbcf-126a-4e22-9ac8-a0857d2ad52a`::Granted request >Thread-7083::DEBUG::2014-07-08 17:14:33,762::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a819b48b-3688-47c9-b47c-c813b526068d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:14:33,762::task::993::Storage.TaskManager.Task::(_decref) Task=`a819b48b-3688-47c9-b47c-c813b526068d`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:14:33,782::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:33,782::task::1191::Storage.TaskManager.Task::(prepare) Task=`a819b48b-3688-47c9-b47c-c813b526068d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:33,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`a819b48b-3688-47c9-b47c-c813b526068d`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:14:33,783::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:14:33,783::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:14:33,784::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:14:33,784::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:14:33,784::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:14:33,784::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:14:33,785::task::993::Storage.TaskManager.Task::(_decref) Task=`a819b48b-3688-47c9-b47c-c813b526068d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:14:34,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:34,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177524 s, 57.7 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:14:34,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`e778adcb-af9f-403b-947f-b209be640197`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:34,590::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:14:34,592::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610956', 'lastCheck': '2.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:14:34,593::task::1191::Storage.TaskManager.Task::(prepare) Task=`e778adcb-af9f-403b-947f-b209be640197`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610956', 'lastCheck': '2.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:14:34,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`e778adcb-af9f-403b-947f-b209be640197`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:34,595::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:34,595::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:34,596::task::993::Storage.TaskManager.Task::(_decref) Task=`e778adcb-af9f-403b-947f-b209be640197`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:14:34,645::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:35,852::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:35,854::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:35,855::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:36,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:36,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017302 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:14:38,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:39,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172699 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:40,859::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:40,860::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:40,861::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:41,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:41,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172724 s, 59.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:14:42,188::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:42,189::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:42,189::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:42,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:42,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:42,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:42,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:42,190::__init__::225::IOProcess::(_processLogs) (274458) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:42,191::__init__::225::IOProcess::(_processLogs) (274458) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:42,191::__init__::225::IOProcess::(_processLogs) (274458) Building response >Thread-18::DEBUG::2014-07-08 17:14:42,191::__init__::225::IOProcess::(_processLogs) (274458) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:42,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:42,192::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:14:42,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:14:42,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000429653 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:14:42,343::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:42,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:42,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:42,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:42,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:42,344::__init__::225::IOProcess::(_processLogs) (274459) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:42,345::__init__::225::IOProcess::(_processLogs) (274459) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:42,345::__init__::225::IOProcess::(_processLogs) (274459) Building response >Thread-18::DEBUG::2014-07-08 17:14:42,345::__init__::225::IOProcess::(_processLogs) (274459) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:42,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:42,346::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:14:42,348::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:14:42,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:42,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:42,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:42,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:42,349::__init__::225::IOProcess::(_processLogs) (274460) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:42,349::__init__::225::IOProcess::(_processLogs) (274460) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:42,350::__init__::225::IOProcess::(_processLogs) (274460) Building response >Thread-18::DEBUG::2014-07-08 17:14:42,350::__init__::225::IOProcess::(_processLogs) (274460) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:42,350::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:42,350::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:42,351::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:14:42,352::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:42,352::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:42,352::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:42,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:42,353::__init__::225::IOProcess::(_processLogs) (274461) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:42,353::__init__::225::IOProcess::(_processLogs) (274461) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:42,353::__init__::225::IOProcess::(_processLogs) (274461) Building response >Thread-18::DEBUG::2014-07-08 17:14:42,354::__init__::225::IOProcess::(_processLogs) (274461) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:42,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:42,354::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:42,359::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:14:42,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:42,362::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:42,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:42,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:42,366::__init__::225::IOProcess::(_processLogs) (274462) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:42,367::__init__::225::IOProcess::(_processLogs) (274462) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:42,368::__init__::225::IOProcess::(_processLogs) (274462) Building response >Thread-18::DEBUG::2014-07-08 17:14:42,370::__init__::225::IOProcess::(_processLogs) (274462) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:42,371::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:42,372::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:14:43,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:43,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0192671 s, 53.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:14:43,800::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:14:43,801::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa984613-88cf-4bf6-b2b7-77ae8f6348bf`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:43,801::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:14:43,817::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:43,817::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa984613-88cf-4bf6-b2b7-77ae8f6348bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:43,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa984613-88cf-4bf6-b2b7-77ae8f6348bf`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:43,818::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:43,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:43,818::task::993::Storage.TaskManager.Task::(_decref) Task=`aa984613-88cf-4bf6-b2b7-77ae8f6348bf`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:14:43,830::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:14:43,830::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd8370b8-f05a-44a7-b9b6-e8789dd02a78`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:14:43,831::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:14:43,832::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`613a3bf4-0395-4e6f-98c2-7aec0bf689af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:14:43,832::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:14:43,836::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:14:43,836::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`613a3bf4-0395-4e6f-98c2-7aec0bf689af`::Granted request >Thread-7083::DEBUG::2014-07-08 17:14:43,837::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bd8370b8-f05a-44a7-b9b6-e8789dd02a78`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:14:43,837::task::993::Storage.TaskManager.Task::(_decref) Task=`bd8370b8-f05a-44a7-b9b6-e8789dd02a78`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:14:43,856::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:43,857::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd8370b8-f05a-44a7-b9b6-e8789dd02a78`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:43,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd8370b8-f05a-44a7-b9b6-e8789dd02a78`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:14:43,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:14:43,858::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:14:43,858::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:14:43,859::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:14:43,859::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:14:43,859::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:14:43,859::task::993::Storage.TaskManager.Task::(_decref) Task=`bd8370b8-f05a-44a7-b9b6-e8789dd02a78`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:14:45,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:45,869::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:45,871::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:45,872::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:45,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173169 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:14:48,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:48,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.143525 s, 7.1 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:14:48,634::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:14:48,634::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:14:49,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`86cc5830-f598-4d1e-93df-89cdb92bcff5`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:49,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:14:49,750::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429653', 'lastCheck': '7.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:14:49,750::task::1191::Storage.TaskManager.Task::(prepare) Task=`86cc5830-f598-4d1e-93df-89cdb92bcff5`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429653', 'lastCheck': '7.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:14:49,751::task::595::Storage.TaskManager.Task::(_updateState) Task=`86cc5830-f598-4d1e-93df-89cdb92bcff5`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:49,751::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:49,751::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:49,751::task::993::Storage.TaskManager.Task::(_decref) Task=`86cc5830-f598-4d1e-93df-89cdb92bcff5`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:14:49,782::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:50,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:50,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172892 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:50,880::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:50,881::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:50,882::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:14:52,378::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:52,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:52,379::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:52,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:52,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:52,380::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:52,380::__init__::225::IOProcess::(_processLogs) (274463) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:52,380::__init__::225::IOProcess::(_processLogs) (274463) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:52,380::__init__::225::IOProcess::(_processLogs) (274463) Building response >Thread-18::DEBUG::2014-07-08 17:14:52,381::__init__::225::IOProcess::(_processLogs) (274463) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:52,381::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:52,381::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:14:52,383::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:14:52,541::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00550252 s, 84.0 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:14:52,544::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:52,545::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:14:52,552::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:52,554::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:52,556::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:52,557::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:52,559::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:52,561::__init__::225::IOProcess::(_processLogs) (274464) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:14:52,562::__init__::225::IOProcess::(_processLogs) (274464) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:14:52,564::__init__::225::IOProcess::(_processLogs) (274464) Building response >Thread-18::DEBUG::2014-07-08 17:14:52,566::__init__::225::IOProcess::(_processLogs) (274464) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:52,568::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:52,569::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:14:52,578::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:52,578::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:14:52,579::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:52,579::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:52,580::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:52,580::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:52,581::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:52,581::__init__::225::IOProcess::(_processLogs) (274465) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:52,581::__init__::225::IOProcess::(_processLogs) (274465) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:52,582::__init__::225::IOProcess::(_processLogs) (274465) Building response >Thread-18::DEBUG::2014-07-08 17:14:52,582::__init__::225::IOProcess::(_processLogs) (274465) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:52,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:52,583::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:52,586::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:52,588::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:14:52,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:52,594::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:52,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:52,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:52,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:52,616::__init__::225::IOProcess::(_processLogs) DEBUG|(274466) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:52,619::__init__::225::IOProcess::(_processLogs) (274466) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:52,621::__init__::225::IOProcess::(_processLogs) (274466) Building response >Thread-18::DEBUG::2014-07-08 17:14:52,624::__init__::225::IOProcess::(_processLogs) (274466) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:52,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:52,631::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:14:52,640::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:14:52,644::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:14:52,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:14:52,653::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:14:52,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:14:52,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:14:52,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:14:52,672::__init__::225::IOProcess::(_processLogs) (274467) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:14:52,676::__init__::225::IOProcess::(_processLogs) (274467) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:14:52,681::__init__::225::IOProcess::(_processLogs) DEBUG|(274467) Building response >Thread-18::DEBUG::2014-07-08 17:14:52,682::__init__::225::IOProcess::(_processLogs) (274467) Queuing response >Thread-18::DEBUG::2014-07-08 17:14:52,684::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:14:52,686::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:14:52,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:52,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456524 s, 22.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:14:53,874::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:14:53,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e1e026c-caeb-4836-8e0b-ded56069bf02`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:14:53,876::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:14:53,891::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:53,891::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e1e026c-caeb-4836-8e0b-ded56069bf02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:14:53,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e1e026c-caeb-4836-8e0b-ded56069bf02`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:14:53,892::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:14:53,892::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:14:53,892::task::993::Storage.TaskManager.Task::(_decref) Task=`6e1e026c-caeb-4836-8e0b-ded56069bf02`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:14:53,904::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:14:53,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`3491d2d0-dd71-4c9a-9f16-6e4671d4f582`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:14:53,905::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:14:53,906::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0de4c06b-e363-41bb-a754-d3822cee1f08`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:14:53,906::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:14:53,907::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:14:53,907::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0de4c06b-e363-41bb-a754-d3822cee1f08`::Granted request >Thread-7083::DEBUG::2014-07-08 17:14:53,908::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3491d2d0-dd71-4c9a-9f16-6e4671d4f582`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:14:53,908::task::993::Storage.TaskManager.Task::(_decref) Task=`3491d2d0-dd71-4c9a-9f16-6e4671d4f582`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:14:53,927::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:53,927::task::1191::Storage.TaskManager.Task::(prepare) Task=`3491d2d0-dd71-4c9a-9f16-6e4671d4f582`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:14:53,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`3491d2d0-dd71-4c9a-9f16-6e4671d4f582`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:14:53,928::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:14:53,928::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:14:53,929::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:14:53,929::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:14:53,929::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:14:53,929::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:14:53,930::task::993::Storage.TaskManager.Task::(_decref) Task=`3491d2d0-dd71-4c9a-9f16-6e4671d4f582`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:14:55,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:55,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174859 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:55,886::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:55,888::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:14:55,889::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:14:57,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:57,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174314 s, 58.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:14:58,018::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:14:59,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:14:59,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017083 s, 59.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:00,893::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:00,895::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:00,896::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:15:01,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:02,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174666 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:15:02,692::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:02,693::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:02,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:02,693::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:02,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:02,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:02,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:02,694::__init__::225::IOProcess::(_processLogs) (274468) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:02,695::__init__::225::IOProcess::(_processLogs) (274468) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:02,695::__init__::225::IOProcess::(_processLogs) (274468) Building response >Thread-18::DEBUG::2014-07-08 17:15:02,695::__init__::225::IOProcess::(_processLogs) (274468) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:02,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:02,696::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:15:02,697::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:15:02,847::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000455353 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:15:02,853::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:02,855::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:02,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:02,859::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:02,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:02,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:02,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:02,867::__init__::225::IOProcess::(_processLogs) (274469) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:02,869::__init__::225::IOProcess::(_processLogs) (274469) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:02,871::__init__::225::IOProcess::(_processLogs) (274469) Building response >Thread-18::DEBUG::2014-07-08 17:15:02,872::__init__::225::IOProcess::(_processLogs) (274469) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:02,874::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:02,876::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:15:02,883::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:02,883::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:15:02,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:02,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:02,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:02,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:02,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:02,890::__init__::225::IOProcess::(_processLogs) (274470) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:02,892::__init__::225::IOProcess::(_processLogs) (274470) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:02,893::__init__::225::IOProcess::(_processLogs) (274470) Building response >Thread-18::DEBUG::2014-07-08 17:15:02,894::__init__::225::IOProcess::(_processLogs) (274470) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:02,896::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:02,897::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:02,902::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:02,903::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:15:02,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:02,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:02,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:02,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:02,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:02,908::__init__::225::IOProcess::(_processLogs) DEBUG|(274471) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:02,908::__init__::225::IOProcess::(_processLogs) (274471) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:02,908::__init__::225::IOProcess::(_processLogs) (274471) Building response >Thread-18::DEBUG::2014-07-08 17:15:02,909::__init__::225::IOProcess::(_processLogs) (274471) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:02,909::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:02,909::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:02,910::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:02,911::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:15:02,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:02,911::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:02,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:02,912::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:02,912::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:02,912::__init__::225::IOProcess::(_processLogs) (274472) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:02,912::__init__::225::IOProcess::(_processLogs) (274472) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:02,913::__init__::225::IOProcess::(_processLogs) (274472) Building response >Thread-18::DEBUG::2014-07-08 17:15:02,913::__init__::225::IOProcess::(_processLogs) (274472) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:02,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:02,913::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:15:03,799::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3a66581-beb6-4b89-93fe-a355b2fc4f1c`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:15:03,800::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:15:03,801::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:03,802::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:15:03,802::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:03,802::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:03,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:03,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:03,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:03,803::__init__::225::IOProcess::(_processLogs) (274473) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:15:03,804::__init__::225::IOProcess::(_processLogs) (274473) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:15:03,804::__init__::225::IOProcess::(_processLogs) (274473) Building response >Thread-18::DEBUG::2014-07-08 17:15:03,804::__init__::225::IOProcess::(_processLogs) (274473) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:03,804::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:03,805::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:15:03,807::__init__::225::IOProcess::(_processLogs) Message size is 170DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:03,807::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:15:03,807::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:03,807::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:03,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:03,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:03,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:03,808::__init__::225::IOProcess::(_processLogs) (274474) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:15:03,809::__init__::225::IOProcess::(_processLogs) (274474) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:15:03,809::__init__::225::IOProcess::(_processLogs) (274474) Building response >Thread-18::DEBUG::2014-07-08 17:15:03,809::__init__::225::IOProcess::(_processLogs) (274474) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:03,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:03,810::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:15:03,811::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:15:03,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3a66581-beb6-4b89-93fe-a355b2fc4f1c`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:15:03,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3a66581-beb6-4b89-93fe-a355b2fc4f1c`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:15:03,812::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:15:03,812::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:15:03,812::task::993::Storage.TaskManager.Task::(_decref) Task=`e3a66581-beb6-4b89-93fe-a355b2fc4f1c`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:15:03,894::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:15:03,894::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:15:03,944::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:15:03,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`27bf4670-3267-4ace-bdf6-82101456f3ed`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:15:03,945::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:15:03,960::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:03,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`27bf4670-3267-4ace-bdf6-82101456f3ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:03,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`27bf4670-3267-4ace-bdf6-82101456f3ed`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:15:03,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:15:03,962::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:15:03,962::task::993::Storage.TaskManager.Task::(_decref) Task=`27bf4670-3267-4ace-bdf6-82101456f3ed`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:15:03,976::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:15:03,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`69f31082-8f4e-4d8e-a130-e8e2124be2b9`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:15:03,977::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:15:03,978::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`03b06493-1677-4e8d-ac26-1addc7dd1ec7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:15:03,978::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:15:03,979::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:15:03,979::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`03b06493-1677-4e8d-ac26-1addc7dd1ec7`::Granted request >Thread-7083::DEBUG::2014-07-08 17:15:03,980::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`69f31082-8f4e-4d8e-a130-e8e2124be2b9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:15:03,980::task::993::Storage.TaskManager.Task::(_decref) Task=`69f31082-8f4e-4d8e-a130-e8e2124be2b9`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:15:03,999::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:04,000::task::1191::Storage.TaskManager.Task::(prepare) Task=`69f31082-8f4e-4d8e-a130-e8e2124be2b9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:04,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`69f31082-8f4e-4d8e-a130-e8e2124be2b9`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:15:04,001::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:15:04,001::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:15:04,001::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:15:04,002::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:15:04,002::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:15:04,002::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:15:04,003::task::993::Storage.TaskManager.Task::(_decref) Task=`69f31082-8f4e-4d8e-a130-e8e2124be2b9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:15:04,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:04,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0912878 s, 11.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:15:05,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a8d8d08-6bbd-4d64-8bf2-0be802664d90`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:15:05,087::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:15:05,090::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455353', 'lastCheck': '2.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:15:05,091::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a8d8d08-6bbd-4d64-8bf2-0be802664d90`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455353', 'lastCheck': '2.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:15:05,092::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a8d8d08-6bbd-4d64-8bf2-0be802664d90`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:15:05,093::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:15:05,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:15:05,095::task::993::Storage.TaskManager.Task::(_decref) Task=`1a8d8d08-6bbd-4d64-8bf2-0be802664d90`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:15:05,236::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:05,903::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:05,904::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:05,905::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:15:06,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:06,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171786 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:15:08,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:09,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0441553 s, 23.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:10,908::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:10,910::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:10,911::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:15:11,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:11,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177024 s, 57.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:15:12,916::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:12,917::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:12,917::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:12,917::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:12,917::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:12,918::__init__::225::IOProcess::(_processLogs) (274475) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:12,918::__init__::225::IOProcess::(_processLogs) (274475) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:12,918::__init__::225::IOProcess::(_processLogs) (274475) Building response >Thread-18::DEBUG::2014-07-08 17:15:12,918::__init__::225::IOProcess::(_processLogs) (274475) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:12,919::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:12,919::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:15:12,921::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:15:13,068::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000465969 s, 991 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:15:13,070::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:13,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:13,071::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:13,071::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:13,072::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:13,072::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:13,072::__init__::225::IOProcess::(_processLogs) (274476) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:13,073::__init__::225::IOProcess::(_processLogs) (274476) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:13,073::__init__::225::IOProcess::(_processLogs) DEBUG|(274476) Building response >Thread-18::DEBUG::2014-07-08 17:15:13,073::__init__::225::IOProcess::(_processLogs) (274476) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:13,073::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:13,074::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:15:13,076::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:13,076::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:15:13,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:13,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:13,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:13,078::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:13,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:13,078::__init__::225::IOProcess::(_processLogs) (274477) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:13,078::__init__::225::IOProcess::(_processLogs) (274477) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:13,079::__init__::225::IOProcess::(_processLogs) (274477) Building response >Thread-18::DEBUG::2014-07-08 17:15:13,079::__init__::225::IOProcess::(_processLogs) (274477) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:13,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:13,079::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:13,081::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:13,081::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:15:13,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:13,081::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:13,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:13,082::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:13,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:13,083::__init__::225::IOProcess::(_processLogs) (274478) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:13,083::__init__::225::IOProcess::(_processLogs) (274478) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:13,083::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274478) Building response >Thread-18::DEBUG::2014-07-08 17:15:13,084::__init__::225::IOProcess::(_processLogs) (274478) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:13,084::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:13,084::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:13,086::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:13,086::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:15:13,086::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:13,087::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:13,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:13,087::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:13,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:13,088::__init__::225::IOProcess::(_processLogs) (274479) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:13,088::__init__::225::IOProcess::(_processLogs) (274479) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:13,088::__init__::225::IOProcess::(_processLogs) (274479) Building response >Thread-18::DEBUG::2014-07-08 17:15:13,088::__init__::225::IOProcess::(_processLogs) (274479) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:13,089::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:13,089::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:15:13,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:13,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175993 s, 58.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:15:14,020::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:15:14,021::task::595::Storage.TaskManager.Task::(_updateState) Task=`8218c8c4-49e3-4e1c-a804-04c494981717`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:15:14,021::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:15:14,036::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:14,037::task::1191::Storage.TaskManager.Task::(prepare) Task=`8218c8c4-49e3-4e1c-a804-04c494981717`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:14,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`8218c8c4-49e3-4e1c-a804-04c494981717`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:15:14,037::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:15:14,038::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:15:14,038::task::993::Storage.TaskManager.Task::(_decref) Task=`8218c8c4-49e3-4e1c-a804-04c494981717`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:15:14,050::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:15:14,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a959bd9-681c-4d09-8d0e-000ba997fb6d`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:15:14,051::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:15:14,052::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c902f783-012b-4efd-b26b-271bbf91302c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:15:14,052::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:15:14,052::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:15:14,053::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c902f783-012b-4efd-b26b-271bbf91302c`::Granted request >Thread-7083::DEBUG::2014-07-08 17:15:14,053::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0a959bd9-681c-4d09-8d0e-000ba997fb6d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:15:14,054::task::993::Storage.TaskManager.Task::(_decref) Task=`0a959bd9-681c-4d09-8d0e-000ba997fb6d`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:15:14,073::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:14,073::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a959bd9-681c-4d09-8d0e-000ba997fb6d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:14,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a959bd9-681c-4d09-8d0e-000ba997fb6d`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:15:14,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:15:14,074::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:15:14,074::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:15:14,075::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:15:14,075::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:15:14,075::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:15:14,075::task::993::Storage.TaskManager.Task::(_decref) Task=`0a959bd9-681c-4d09-8d0e-000ba997fb6d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:15:15,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:15,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173325 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:15,918::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:15,920::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:15,921::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:15:17,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:18,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173669 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:15:19,078::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:15:19,079::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:15:20,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:20,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899846 s, 11.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:15:20,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`0548efe9-1a97-4e01-92c1-14cbe2c820ee`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:15:20,582::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:15:20,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465969', 'lastCheck': '7.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:15:20,591::task::1191::Storage.TaskManager.Task::(prepare) Task=`0548efe9-1a97-4e01-92c1-14cbe2c820ee`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465969', 'lastCheck': '7.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:15:20,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`0548efe9-1a97-4e01-92c1-14cbe2c820ee`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:15:20,592::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:15:20,593::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:15:20,594::task::993::Storage.TaskManager.Task::(_decref) Task=`0548efe9-1a97-4e01-92c1-14cbe2c820ee`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:15:20,672::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:20,928::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:20,929::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:20,931::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:15:22,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:22,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174859 s, 58.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:15:23,092::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:23,092::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:23,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:23,093::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:23,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:23,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:23,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:23,094::__init__::225::IOProcess::(_processLogs) (274480) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:23,094::__init__::225::IOProcess::(_processLogs) (274480) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:23,094::__init__::225::IOProcess::(_processLogs) (274480) Building response >Thread-18::DEBUG::2014-07-08 17:15:23,095::__init__::225::IOProcess::(_processLogs) (274480) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:23,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:23,095::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:15:23,097::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:15:23,248::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000887242 s, 521 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:15:23,253::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:23,254::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:23,257::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:23,259::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:23,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:23,262::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:23,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:23,274::__init__::225::IOProcess::(_processLogs) (274481) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:23,280::__init__::225::IOProcess::(_processLogs) (274481) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:23,285::__init__::225::IOProcess::(_processLogs) (274481) Building response >Thread-18::DEBUG::2014-07-08 17:15:23,288::__init__::225::IOProcess::(_processLogs) (274481) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:23,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:23,296::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:15:23,319::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:23,325::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:15:23,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:23,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:23,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:23,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:23,339::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:23,340::__init__::225::IOProcess::(_processLogs) (274482) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:23,342::__init__::225::IOProcess::(_processLogs) (274482) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:23,343::__init__::225::IOProcess::(_processLogs) (274482) Building response >Thread-18::DEBUG::2014-07-08 17:15:23,345::__init__::225::IOProcess::(_processLogs) (274482) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:23,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:23,348::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:23,353::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:23,354::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:15:23,356::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:23,358::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:23,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:23,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:23,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:23,362::__init__::225::IOProcess::(_processLogs) (274483) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:23,364::__init__::225::IOProcess::(_processLogs) (274483) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:23,365::__init__::225::IOProcess::(_processLogs) (274483) Building response >Thread-18::DEBUG::2014-07-08 17:15:23,367::__init__::225::IOProcess::(_processLogs) (274483) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:23,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:23,369::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:23,382::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:23,383::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:15:23,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:23,386::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:23,388::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:23,389::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:23,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:23,391::__init__::225::IOProcess::(_processLogs) (274484) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:23,393::__init__::225::IOProcess::(_processLogs) (274484) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:23,394::__init__::225::IOProcess::(_processLogs) (274484) Building response >Thread-18::DEBUG::2014-07-08 17:15:23,395::__init__::225::IOProcess::(_processLogs) (274484) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:23,397::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:23,398::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:15:24,089::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:15:24,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`74e63292-01cd-4af0-9a34-c1cc2c23e041`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:15:24,090::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:15:24,105::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:24,106::task::1191::Storage.TaskManager.Task::(prepare) Task=`74e63292-01cd-4af0-9a34-c1cc2c23e041`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:24,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`74e63292-01cd-4af0-9a34-c1cc2c23e041`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:15:24,106::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:15:24,106::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:15:24,107::task::993::Storage.TaskManager.Task::(_decref) Task=`74e63292-01cd-4af0-9a34-c1cc2c23e041`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:15:24,119::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:15:24,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`31666fce-625a-4677-ad0d-91ab5022a1af`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:15:24,120::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:15:24,121::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`84699deb-4641-4a76-8adf-cdeddf36ee24`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:15:24,121::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:15:24,122::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:15:24,122::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`84699deb-4641-4a76-8adf-cdeddf36ee24`::Granted request >Thread-7083::DEBUG::2014-07-08 17:15:24,122::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`31666fce-625a-4677-ad0d-91ab5022a1af`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:15:24,123::task::993::Storage.TaskManager.Task::(_decref) Task=`31666fce-625a-4677-ad0d-91ab5022a1af`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:15:24,142::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:24,142::task::1191::Storage.TaskManager.Task::(prepare) Task=`31666fce-625a-4677-ad0d-91ab5022a1af`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:24,143::task::595::Storage.TaskManager.Task::(_updateState) Task=`31666fce-625a-4677-ad0d-91ab5022a1af`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:15:24,143::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:15:24,143::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:15:24,144::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:15:24,144::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:15:24,144::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:15:24,144::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:15:24,145::task::993::Storage.TaskManager.Task::(_decref) Task=`31666fce-625a-4677-ad0d-91ab5022a1af`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:15:24,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:25,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178932 s, 57.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:25,942::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:25,944::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:25,946::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:15:27,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:27,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173012 s, 59.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:15:28,327::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:15:29,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:29,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178272 s, 57.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:30,953::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:30,954::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:30,956::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:15:31,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:31,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175442 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:15:33,404::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:33,404::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:33,404::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:33,405::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:33,405::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:33,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:33,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:33,406::__init__::225::IOProcess::(_processLogs) (274485) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:33,406::__init__::225::IOProcess::(_processLogs) (274485) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:33,406::__init__::225::IOProcess::(_processLogs) (274485) Building response >Thread-18::DEBUG::2014-07-08 17:15:33,406::__init__::225::IOProcess::(_processLogs) (274485) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:33,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:33,407::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:15:33,409::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:15:33,559::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000477144 s, 968 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:15:33,566::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:33,568::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:33,570::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:33,572::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:33,575::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:33,577::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:33,579::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:33,581::__init__::225::IOProcess::(_processLogs) (274486) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:33,583::__init__::225::IOProcess::(_processLogs) (274486) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:33,584::__init__::225::IOProcess::(_processLogs) (274486) Building response >Thread-18::DEBUG::2014-07-08 17:15:33,586::__init__::225::IOProcess::(_processLogs) (274486) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:33,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:33,588::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:15:33,597::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:33,598::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:15:33,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:33,602::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:33,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:33,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:33,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:33,608::__init__::225::IOProcess::(_processLogs) (274487) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:33,609::__init__::225::IOProcess::(_processLogs) (274487) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:33,611::__init__::225::IOProcess::(_processLogs) (274487) Building response >Thread-18::DEBUG::2014-07-08 17:15:33,613::__init__::225::IOProcess::(_processLogs) (274487) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:33,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:33,616::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:33,622::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:15:33,623::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:15:33,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:33,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:33,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:33,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:33,632::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:33,633::__init__::225::IOProcess::(_processLogs) (274488) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:33,635::__init__::225::IOProcess::(_processLogs) (274488) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:33,637::__init__::225::IOProcess::(_processLogs) (274488) Building response >Thread-18::DEBUG::2014-07-08 17:15:33,638::__init__::225::IOProcess::(_processLogs) (274488) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:33,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:33,641::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:33,646::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:15:33,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:33,648::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:33,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:33,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:33,653::__init__::225::IOProcess::(_processLogs) (274489) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:33,654::__init__::225::IOProcess::(_processLogs) (274489) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:33,655::__init__::225::IOProcess::(_processLogs) (274489) Building response >Thread-18::DEBUG::2014-07-08 17:15:33,658::__init__::225::IOProcess::(_processLogs) (274489) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:33,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:33,667::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:15:33,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:15:34,159::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:15:34,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc897757-6490-4ccf-94a2-e114d2dab560`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:15:34,166::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:15:34,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7086::DEBUG::2014-07-08 17:15:34,185::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:15:34,187::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc897757-6490-4ccf-94a2-e114d2dab560`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:34,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc897757-6490-4ccf-94a2-e114d2dab560`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:15:34,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::ERROR::2014-07-08 17:15:34,190::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7087::DEBUG::2014-07-08 17:15:34,195::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:15:34,199::task::993::Storage.TaskManager.Task::(_decref) Task=`bc897757-6490-4ccf-94a2-e114d2dab560`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:15:34,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444132 s, 23.1 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:15:34,291::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:15:34,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eeba425-60dd-4c1a-ae91-a4d97dca4d65`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:15:34,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:15:34,293::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cb3e42fd-df62-46b4-b2e0-d4ae48a8801b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:15:34,293::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:15:34,294::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:15:34,294::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cb3e42fd-df62-46b4-b2e0-d4ae48a8801b`::Granted request >Thread-7083::DEBUG::2014-07-08 17:15:34,295::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6eeba425-60dd-4c1a-ae91-a4d97dca4d65`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:15:34,295::task::993::Storage.TaskManager.Task::(_decref) Task=`6eeba425-60dd-4c1a-ae91-a4d97dca4d65`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:15:34,315::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:34,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`6eeba425-60dd-4c1a-ae91-a4d97dca4d65`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:34,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eeba425-60dd-4c1a-ae91-a4d97dca4d65`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:15:34,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:15:34,316::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:15:34,317::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:15:34,317::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:15:34,317::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:15:34,318::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:15:34,318::task::993::Storage.TaskManager.Task::(_decref) Task=`6eeba425-60dd-4c1a-ae91-a4d97dca4d65`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:15:34,358::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5d', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '2c12e619-b6af-4ff0-8200-ff51e10bed2d', 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [1c81c47b] >Dummy-6860::DEBUG::2014-07-08 17:15:38,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:38,408::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:38,538::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:15:38,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1786a34-dae3-4892-8437-2db60f6517dc`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:15:38,551::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:15:38,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477144', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:15:38,566::vm::3329::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug NIC xml: <interface type="bridge"> > <mac address="00:1a:4a:16:88:5d"/> > <model type="virtio"/> > <source bridge="ovirtmgmt"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Thread-7082::DEBUG::2014-07-08 17:15:38,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1786a34-dae3-4892-8437-2db60f6517dc`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477144', 'lastCheck': '4.9', 'valid': True}} >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:38,582::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:15:38,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1786a34-dae3-4892-8437-2db60f6517dc`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:15:38,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:15:38,595::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:15:38,598::task::993::Storage.TaskManager.Task::(_decref) Task=`a1786a34-dae3-4892-8437-2db60f6517dc`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:15:38,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.219798 s, 4.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:15:38,792::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:15:39,341::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 1 edom: 0 level: 2 message: An error occurred, but the cause is unknown >Thread-7087::ERROR::2014-07-08 17:15:39,342::vm::3334::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug failed >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 3332, in hotplugNic > self._dom.attachDevice(nicXml) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 399, in attachDevice > if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) >libvirtError: An error occurred, but the cause is unknown >Thread-7087::DEBUG::2014-07-08 17:15:39,343::BindingXMLRPC::1114::vds::(wrapper) return vmHotplugNic with {'status': {'message': 'An error occurred, but the cause is unknown', 'code': 49}} >Dummy-6860::DEBUG::2014-07-08 17:15:40,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:41,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173761 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:15:43,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:43,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175417 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:43,691::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:15:43,692::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:43,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:43,698::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:15:43,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:43,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:43,703::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:15:43,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:43,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:43,706::__init__::225::IOProcess::(_processLogs) (274490) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:43,710::__init__::225::IOProcess::(_processLogs) (274490) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:43,710::__init__::225::IOProcess::(_processLogs) (274490) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:43,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:43,711::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:15:43,716::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:15:43,956::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00255473 s, 181 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:15:43,972::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:43,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:43,975::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:43,977::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:43,978::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:43,979::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:43,981::__init__::225::IOProcess::(_processLogs) (274491) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:43,983::__init__::225::IOProcess::(_processLogs) (274491) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:43,984::__init__::225::IOProcess::(_processLogs) (274491) Building response >Thread-18::DEBUG::2014-07-08 17:15:43,986::__init__::225::IOProcess::(_processLogs) (274491) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:43,987::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:43,989::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:15:43,997::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:15:43,999::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:44,000::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:44,001::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:44,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:44,004::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:44,006::__init__::225::IOProcess::(_processLogs) (274492) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:44,007::__init__::225::IOProcess::(_processLogs) (274492) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:44,010::__init__::225::IOProcess::(_processLogs) (274492) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:44,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:44,013::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:44,019::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:15:44,020::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:44,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:44,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:44,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:44,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:44,028::__init__::225::IOProcess::(_processLogs) (274493) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:44,029::__init__::225::IOProcess::(_processLogs) (274493) Building response >Thread-18::DEBUG::2014-07-08 17:15:44,030::__init__::225::IOProcess::(_processLogs) (274493) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:44,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:44,033::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:44,038::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:15:44,042::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:44,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:44,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:44,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:44,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:44,049::__init__::225::IOProcess::(_processLogs) (274494) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:44,050::__init__::225::IOProcess::(_processLogs) (274494) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:44,052::__init__::225::IOProcess::(_processLogs) (274494) Building response >Thread-18::DEBUG::2014-07-08 17:15:44,053::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:44,055::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:15:44,367::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:15:44,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`7633b9eb-638d-4e47-8e9f-27bd8e8f3743`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:15:44,370::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:15:44,385::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:44,386::task::1191::Storage.TaskManager.Task::(prepare) Task=`7633b9eb-638d-4e47-8e9f-27bd8e8f3743`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:44,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`7633b9eb-638d-4e47-8e9f-27bd8e8f3743`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:15:44,387::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:15:44,387::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:15:44,387::task::993::Storage.TaskManager.Task::(_decref) Task=`7633b9eb-638d-4e47-8e9f-27bd8e8f3743`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:15:44,399::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:15:44,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b1f37ca-a8c5-4472-ab28-576191b5a883`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:15:44,400::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:15:44,401::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`206d3b99-856f-42e6-b0da-93bdc30e46cc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:15:44,401::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:15:44,402::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:15:44,402::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`206d3b99-856f-42e6-b0da-93bdc30e46cc`::Granted request >Thread-7083::DEBUG::2014-07-08 17:15:44,403::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0b1f37ca-a8c5-4472-ab28-576191b5a883`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:15:44,403::task::993::Storage.TaskManager.Task::(_decref) Task=`0b1f37ca-a8c5-4472-ab28-576191b5a883`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:15:44,424::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:44,425::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b1f37ca-a8c5-4472-ab28-576191b5a883`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:44,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b1f37ca-a8c5-4472-ab28-576191b5a883`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:15:44,425::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:15:44,425::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:15:44,426::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:15:44,426::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:15:44,427::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:15:44,427::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:15:44,427::task::993::Storage.TaskManager.Task::(_decref) Task=`0b1f37ca-a8c5-4472-ab28-576191b5a883`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:15:45,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:45,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172727 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:15:47,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:47,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172811 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:48,713::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:48,714::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:48,715::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:15:49,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:50,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017513 s, 58.5 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:15:51,179::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:15:51,180::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:15:52,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:52,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173275 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:53,723::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:53,724::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:53,725::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:15:54,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`c16ee037-9ac7-4580-bdc0-4613aafbea08`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:15:54,002::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:15:54,002::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255473', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:15:54,003::task::1191::Storage.TaskManager.Task::(prepare) Task=`c16ee037-9ac7-4580-bdc0-4613aafbea08`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255473', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:15:54,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`c16ee037-9ac7-4580-bdc0-4613aafbea08`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:15:54,003::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:15:54,004::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:15:54,004::task::993::Storage.TaskManager.Task::(_decref) Task=`c16ee037-9ac7-4580-bdc0-4613aafbea08`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:15:54,062::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:54,062::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:54,063::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:54,063::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:54,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:54,063::__init__::225::IOProcess::(_processLogs) (274495) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:54,064::__init__::225::IOProcess::(_processLogs) (274495) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:54,064::__init__::225::IOProcess::(_processLogs) (274495) Building response >Thread-18::DEBUG::2014-07-08 17:15:54,064::__init__::225::IOProcess::(_processLogs) (274495) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:54,064::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:54,065::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:15:54,066::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:15:54,220::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000538323 s, 858 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:15:54,234::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:15:54,233::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:15:54,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:54,245::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:54,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:54,256::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:54,258::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:54,260::__init__::225::IOProcess::(_processLogs) (274496) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:15:54,263::__init__::225::IOProcess::(_processLogs) (274496) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:15:54,266::__init__::225::IOProcess::(_processLogs) (274496) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:54,269::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:54,272::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:15:54,281::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:15:54,282::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:54,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:54,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:54,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:54,289::__init__::225::IOProcess::(_processLogs) (274497) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:54,291::__init__::225::IOProcess::(_processLogs) (274497) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:54,293::__init__::225::IOProcess::(_processLogs) (274497) Building response >Thread-18::DEBUG::2014-07-08 17:15:54,294::__init__::225::IOProcess::(_processLogs) (274497) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:54,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:54,296::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:54,302::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:15:54,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:54,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:54,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:54,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:54,309::__init__::225::IOProcess::(_processLogs) (274498) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:54,310::__init__::225::IOProcess::(_processLogs) (274498) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:54,312::__init__::225::IOProcess::(_processLogs) (274498) Building response >Thread-18::DEBUG::2014-07-08 17:15:54,313::__init__::225::IOProcess::(_processLogs) (274498) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:54,314::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:54,316::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:15:54,320::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:15:54,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:15:54,324::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:15:54,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:15:54,328::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:15:54,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:15:54,330::__init__::225::IOProcess::(_processLogs) (274499) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:15:54,331::__init__::225::IOProcess::(_processLogs) (274499) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:15:54,333::__init__::225::IOProcess::(_processLogs) (274499) Building response >Thread-18::DEBUG::2014-07-08 17:15:54,335::__init__::225::IOProcess::(_processLogs) (274499) Queuing response >Thread-18::DEBUG::2014-07-08 17:15:54,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:15:54,337::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:15:54,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:15:54,515::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [30742acc] >Thread-7087::DEBUG::2014-07-08 17:15:54,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`af37d3a9-d3d4-4137-9dd0-efcc108c71a6`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:15:54,615::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:15:54,695::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 17:15:54,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121117 s, 8.5 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:15:54,782::task::1191::Storage.TaskManager.Task::(prepare) Task=`af37d3a9-d3d4-4137-9dd0-efcc108c71a6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:15:54,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`af37d3a9-d3d4-4137-9dd0-efcc108c71a6`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:15:54,790::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:15:54,795::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:15:54,799::task::993::Storage.TaskManager.Task::(_decref) Task=`af37d3a9-d3d4-4137-9dd0-efcc108c71a6`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:15:54,839::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [30742acc] >Thread-7083::DEBUG::2014-07-08 17:15:54,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4f9ae71-bb42-49a7-865b-7d8209d48da2`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:15:54,848::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:15:54,857::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`73ab4a79-3ad0-4eac-aa95-b3ee99991381`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:15:54,859::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:15:54,863::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:15:54,865::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`73ab4a79-3ad0-4eac-aa95-b3ee99991381`::Granted request >Thread-7083::DEBUG::2014-07-08 17:15:54,874::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c4f9ae71-bb42-49a7-865b-7d8209d48da2`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:15:54,876::task::993::Storage.TaskManager.Task::(_decref) Task=`c4f9ae71-bb42-49a7-865b-7d8209d48da2`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:15:54,923::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:54,925::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4f9ae71-bb42-49a7-865b-7d8209d48da2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:15:54,927::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4f9ae71-bb42-49a7-865b-7d8209d48da2`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:15:54,928::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:15:54,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:15:54,931::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:15:54,932::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:15:54,933::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:15:54,934::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:15:54,936::task::993::Storage.TaskManager.Task::(_decref) Task=`c4f9ae71-bb42-49a7-865b-7d8209d48da2`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:15:57,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:57,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0238971 s, 42.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:58,732::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:58,734::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:15:58,735::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:15:59,276::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:15:59,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:15:59,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173554 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:16:01,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:01,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174705 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:03,742::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:03,743::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:03,744::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:16:03,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:04,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177376 s, 57.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:16:04,343::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:04,344::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:04,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:04,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:04,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:04,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:04,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:04,345::__init__::225::IOProcess::(_processLogs) (274500) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:04,346::__init__::225::IOProcess::(_processLogs) (274500) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:04,346::__init__::225::IOProcess::(_processLogs) (274500) Building response >Thread-18::DEBUG::2014-07-08 17:16:04,346::__init__::225::IOProcess::(_processLogs) (274500) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:04,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:04,346::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:16:04,348::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:16:04,496::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000458147 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:16:04,498::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:04,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:04,498::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:04,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:04,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:04,499::__init__::225::IOProcess::(_processLogs) (274501) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:04,499::__init__::225::IOProcess::(_processLogs) (274501) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:04,500::__init__::225::IOProcess::(_processLogs) (274501) Building response >Thread-18::DEBUG::2014-07-08 17:16:04,500::__init__::225::IOProcess::(_processLogs) (274501) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:04,500::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:04,500::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:16:04,503::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:16:04,503::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:04,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:04,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:04,504::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:04,504::__init__::225::IOProcess::(_processLogs) (274502) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:04,505::__init__::225::IOProcess::(_processLogs) (274502) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:04,505::__init__::225::IOProcess::(_processLogs) (274502) Building response >Thread-18::DEBUG::2014-07-08 17:16:04,505::__init__::225::IOProcess::(_processLogs) (274502) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:04,505::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:04,506::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:04,507::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:16:04,507::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:04,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:04,508::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:04,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:04,508::__init__::225::IOProcess::(_processLogs) (274503) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:04,509::__init__::225::IOProcess::(_processLogs) (274503) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:04,509::__init__::225::IOProcess::(_processLogs) (274503) Building response >Thread-18::DEBUG::2014-07-08 17:16:04,509::__init__::225::IOProcess::(_processLogs) (274503) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:04,509::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:04,516::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:16:04,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:04,516::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:04,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:04,517::__init__::225::IOProcess::(_processLogs) (274504) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:04,517::__init__::225::IOProcess::(_processLogs) (274504) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:04,518::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(274504) Building response >Thread-18::DEBUG::2014-07-08 17:16:04,518::__init__::225::IOProcess::(_processLogs) (274504) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:04,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:04,518::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:16:04,952::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:16:04,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6fc84de-c677-4fc8-b426-32c6b092ff26`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:16:04,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:16:04,968::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:04,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6fc84de-c677-4fc8-b426-32c6b092ff26`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:04,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6fc84de-c677-4fc8-b426-32c6b092ff26`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:04,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:04,970::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:04,970::task::993::Storage.TaskManager.Task::(_decref) Task=`a6fc84de-c677-4fc8-b426-32c6b092ff26`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:16:04,982::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:16:04,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`57683ed8-2c29-4067-b53d-e0ef899a3349`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:16:04,983::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:16:04,984::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1cceb3aa-caec-4741-a6a8-487bf15bd264`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:16:04,985::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:16:04,985::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:16:04,985::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1cceb3aa-caec-4741-a6a8-487bf15bd264`::Granted request >Thread-7083::DEBUG::2014-07-08 17:16:04,986::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`57683ed8-2c29-4067-b53d-e0ef899a3349`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:16:04,986::task::993::Storage.TaskManager.Task::(_decref) Task=`57683ed8-2c29-4067-b53d-e0ef899a3349`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:16:05,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:05,006::task::1191::Storage.TaskManager.Task::(prepare) Task=`57683ed8-2c29-4067-b53d-e0ef899a3349`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:05,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`57683ed8-2c29-4067-b53d-e0ef899a3349`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:16:05,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:16:05,007::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:16:05,007::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:16:05,007::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:16:05,008::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:16:05,008::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:16:05,008::task::993::Storage.TaskManager.Task::(_decref) Task=`57683ed8-2c29-4067-b53d-e0ef899a3349`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:16:06,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7086::DEBUG::2014-07-08 17:16:06,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`916bb6f0-0882-45a7-b35c-3f9b4a047f64`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:16:06,259::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:16:06,263::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:06,264::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:16:06,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:06,265::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:06,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:06,268::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:06,270::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:06,271::__init__::225::IOProcess::(_processLogs) (274505) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:16:06,273::__init__::225::IOProcess::(_processLogs) (274505) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:16:06,275::__init__::225::IOProcess::(_processLogs) (274505) Building response >Thread-18::DEBUG::2014-07-08 17:16:06,276::__init__::225::IOProcess::(_processLogs) (274505) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:06,278::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:06,279::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:16:06,289::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:06,290::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:16:06,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:06,293::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:06,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-6860::DEBUG::2014-07-08 17:16:06,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046707 s, 21.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:16:06,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:06,364::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:06,365::__init__::225::IOProcess::(_processLogs) (274506) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:16:06,366::__init__::225::IOProcess::(_processLogs) (274506) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:16:06,367::__init__::225::IOProcess::(_processLogs) (274506) Building response >Thread-18::DEBUG::2014-07-08 17:16:06,368::__init__::225::IOProcess::(_processLogs) (274506) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:06,369::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:06,370::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:16:06,375::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:16:06,376::task::1191::Storage.TaskManager.Task::(prepare) Task=`916bb6f0-0882-45a7-b35c-3f9b4a047f64`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:16:06,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`916bb6f0-0882-45a7-b35c-3f9b4a047f64`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:16:06,378::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:16:06,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:16:06,380::task::993::Storage.TaskManager.Task::(_decref) Task=`916bb6f0-0882-45a7-b35c-3f9b4a047f64`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:16:06,473::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:16:06,474::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:16:08,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:08,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177113 s, 57.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:08,752::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:08,753::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:08,755::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:16:09,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b574a62-31c9-4a16-b645-753ea791e1c4`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:16:09,402::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:16:09,402::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458147', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:16:09,403::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b574a62-31c9-4a16-b645-753ea791e1c4`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458147', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:16:09,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b574a62-31c9-4a16-b645-753ea791e1c4`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:09,404::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:09,405::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:09,407::task::993::Storage.TaskManager.Task::(_decref) Task=`3b574a62-31c9-4a16-b645-753ea791e1c4`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:16:09,464::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:16:10,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:10,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0870977 s, 11.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:16:13,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:13,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171294 s, 59.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:13,762::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:13,763::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:13,764::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:16:14,521::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:14,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:14,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:14,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:14,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:14,523::__init__::225::IOProcess::(_processLogs) (274507) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:14,523::__init__::225::IOProcess::(_processLogs) (274507) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:14,523::__init__::225::IOProcess::(_processLogs) (274507) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:14,524::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:14,524::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:16:14,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:16:14,674::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000450325 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:16:14,676::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:14,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:14,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:14,677::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:14,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:14,677::__init__::225::IOProcess::(_processLogs) (274508) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:14,677::__init__::225::IOProcess::(_processLogs) (274508) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:14,678::__init__::225::IOProcess::(_processLogs) (274508) Building response >Thread-18::DEBUG::2014-07-08 17:16:14,678::__init__::225::IOProcess::(_processLogs) (274508) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:14,678::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:14,678::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:16:14,680::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:16:14,681::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:14,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:14,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:14,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:14,682::__init__::225::IOProcess::(_processLogs) (274509) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:14,682::__init__::225::IOProcess::(_processLogs) (274509) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:14,682::__init__::225::IOProcess::(_processLogs) (274509) Building response >Thread-18::DEBUG::2014-07-08 17:16:14,683::__init__::225::IOProcess::(_processLogs) (274509) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:14,683::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:14,683::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:14,684::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:16:14,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:14,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:14,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:14,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:14,685::__init__::225::IOProcess::(_processLogs) (274510) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:14,686::__init__::225::IOProcess::(_processLogs) (274510) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:14,686::__init__::225::IOProcess::(_processLogs) (274510) Building response >Thread-18::DEBUG::2014-07-08 17:16:14,686::__init__::225::IOProcess::(_processLogs) (274510) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:14,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:14,687::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:14,688::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:16:14,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:14,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:14,688::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:14,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:14,689::__init__::225::IOProcess::(_processLogs) (274511) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:14,689::__init__::225::IOProcess::(_processLogs) (274511) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:14,689::__init__::225::IOProcess::(_processLogs) (274511) Building response >Thread-18::DEBUG::2014-07-08 17:16:14,690::__init__::225::IOProcess::(_processLogs) (274511) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:14,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:14,690::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:16:15,022::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:16:15,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`b69ce156-5fcb-4ef6-afa3-5375d68f0cdf`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:16:15,023::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:16:15,038::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:15,039::task::1191::Storage.TaskManager.Task::(prepare) Task=`b69ce156-5fcb-4ef6-afa3-5375d68f0cdf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:15,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`b69ce156-5fcb-4ef6-afa3-5375d68f0cdf`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:15,039::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:15,039::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:15,040::task::993::Storage.TaskManager.Task::(_decref) Task=`b69ce156-5fcb-4ef6-afa3-5375d68f0cdf`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:16:15,066::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:16:15,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`f13e51f1-f843-4209-956e-0107e411cdf0`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:16:15,067::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:16:15,068::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ba27a56a-983b-4011-920b-b8c29c4713df`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:16:15,068::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:16:15,069::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:16:15,069::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ba27a56a-983b-4011-920b-b8c29c4713df`::Granted request >Thread-7083::DEBUG::2014-07-08 17:16:15,070::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f13e51f1-f843-4209-956e-0107e411cdf0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:16:15,070::task::993::Storage.TaskManager.Task::(_decref) Task=`f13e51f1-f843-4209-956e-0107e411cdf0`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:16:15,089::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:15,092::task::1191::Storage.TaskManager.Task::(prepare) Task=`f13e51f1-f843-4209-956e-0107e411cdf0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:15,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`f13e51f1-f843-4209-956e-0107e411cdf0`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:16:15,095::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:16:15,097::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:16:15,099::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:16:15,101::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:16:15,106::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:16:15,108::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:16:15,110::task::993::Storage.TaskManager.Task::(_decref) Task=`f13e51f1-f843-4209-956e-0107e411cdf0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:16:15,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:15,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173507 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:16:17,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:17,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172682 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:18,771::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:18,773::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:18,774::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:16:19,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:20,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174403 s, 58.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:16:21,702::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:16:21,702::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:16:22,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:22,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175727 s, 58.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:23,782::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:23,787::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:23,794::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:16:24,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:24,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175482 s, 58.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:16:24,633::task::595::Storage.TaskManager.Task::(_updateState) Task=`411ae784-bc87-4418-9abf-478bf8bbaa77`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:16:24,634::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:16:24,636::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450325', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:16:24,637::task::1191::Storage.TaskManager.Task::(prepare) Task=`411ae784-bc87-4418-9abf-478bf8bbaa77`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450325', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:16:24,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`411ae784-bc87-4418-9abf-478bf8bbaa77`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:24,639::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:24,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:24,641::task::993::Storage.TaskManager.Task::(_decref) Task=`411ae784-bc87-4418-9abf-478bf8bbaa77`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:16:24,693::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:24,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:24,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:24,695::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:24,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::DEBUG::2014-07-08 17:16:24,699::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:16:24,700::__init__::225::IOProcess::(_processLogs) (274512) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:24,703::__init__::225::IOProcess::(_processLogs) (274512) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:24,706::__init__::225::IOProcess::(_processLogs) (274512) Building response >Thread-18::DEBUG::2014-07-08 17:16:24,709::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:24,710::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:16:24,713::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:16:24,861::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000429932 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:16:24,863::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:24,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:24,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:24,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:24,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:24,865::__init__::225::IOProcess::(_processLogs) (274513) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:24,865::__init__::225::IOProcess::(_processLogs) (274513) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:24,865::__init__::225::IOProcess::(_processLogs) (274513) Building response >Thread-18::DEBUG::2014-07-08 17:16:24,865::__init__::225::IOProcess::(_processLogs) (274513) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:24,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:24,866::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:16:24,868::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:16:24,868::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:24,869::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:24,869::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:24,869::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:24,869::__init__::225::IOProcess::(_processLogs) (274514) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:24,870::__init__::225::IOProcess::(_processLogs) (274514) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:24,870::__init__::225::IOProcess::(_processLogs) (274514) Building response >Thread-18::DEBUG::2014-07-08 17:16:24,870::__init__::225::IOProcess::(_processLogs) (274514) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:24,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:24,870::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:24,872::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:16:24,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:24,872::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:24,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:24,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:24,873::__init__::225::IOProcess::(_processLogs) (274515) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:24,873::__init__::225::IOProcess::(_processLogs) (274515) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:24,873::__init__::225::IOProcess::(_processLogs) (274515) Building response >Thread-18::DEBUG::2014-07-08 17:16:24,874::__init__::225::IOProcess::(_processLogs) (274515) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:24,874::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:24,874::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:24,875::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:16:24,876::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:24,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:24,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:24,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:24,877::__init__::225::IOProcess::(_processLogs) (274516) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:24,877::__init__::225::IOProcess::(_processLogs) (274516) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:24,877::__init__::225::IOProcess::(_processLogs) (274516) Building response >Thread-18::DEBUG::2014-07-08 17:16:24,877::__init__::225::IOProcess::(_processLogs) (274516) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:24,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:24,878::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:16:25,161::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:16:25,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9473ec2-10ef-46db-9d30-7b5b1f1b9edf`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:16:25,163::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:16:25,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:25,179::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9473ec2-10ef-46db-9d30-7b5b1f1b9edf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:25,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9473ec2-10ef-46db-9d30-7b5b1f1b9edf`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:25,181::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:25,182::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:25,183::task::993::Storage.TaskManager.Task::(_decref) Task=`c9473ec2-10ef-46db-9d30-7b5b1f1b9edf`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:16:25,200::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:16:25,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ca04b7a-9834-45b4-a6c9-c9f5e362261a`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:16:25,204::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:16:25,209::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c53316e8-5f4e-428d-88a0-11e2ab76bf13`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:16:25,210::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:16:25,213::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:16:25,214::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c53316e8-5f4e-428d-88a0-11e2ab76bf13`::Granted request >Thread-7083::DEBUG::2014-07-08 17:16:25,218::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1ca04b7a-9834-45b4-a6c9-c9f5e362261a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:16:25,219::task::993::Storage.TaskManager.Task::(_decref) Task=`1ca04b7a-9834-45b4-a6c9-c9f5e362261a`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:16:25,255::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:25,256::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ca04b7a-9834-45b4-a6c9-c9f5e362261a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:25,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ca04b7a-9834-45b4-a6c9-c9f5e362261a`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:16:25,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:16:25,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:16:25,263::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:16:25,265::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:16:25,266::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:16:25,267::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:16:25,269::task::993::Storage.TaskManager.Task::(_decref) Task=`1ca04b7a-9834-45b4-a6c9-c9f5e362261a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:16:26,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:26,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0926257 s, 11.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:28,806::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:28,807::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:28,808::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:16:29,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:29,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0183245 s, 55.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:16:29,531::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:16:31,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:31,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018106 s, 56.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:16:33,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:33,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0189977 s, 53.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:33,871::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:33,876::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:33,880::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:16:34,881::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:34,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:34,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:34,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:34,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:34,882::__init__::225::IOProcess::(_processLogs) (274517) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:34,882::__init__::225::IOProcess::(_processLogs) (274517) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:34,883::__init__::225::IOProcess::(_processLogs) (274517) Building response >Thread-18::DEBUG::2014-07-08 17:16:34,883::__init__::225::IOProcess::(_processLogs) (274517) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:34,883::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:34,883::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:16:34,885::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:16:35,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000482731 s, 957 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:16:35,039::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:35,039::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:35,040::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:35,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:35,041::__init__::225::IOProcess::(_processLogs) (274518) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:35,041::__init__::225::IOProcess::(_processLogs) (274518) Building response >Thread-18::DEBUG::2014-07-08 17:16:35,041::__init__::225::IOProcess::(_processLogs) (274518) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:35,041::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:16:35,044::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:16:35,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:35,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:35,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:35,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:35,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:35,045::__init__::225::IOProcess::(_processLogs) (274519) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:35,046::__init__::225::IOProcess::(_processLogs) (274519) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:35,046::__init__::225::IOProcess::(_processLogs) (274519) Building response >Thread-18::DEBUG::2014-07-08 17:16:35,046::__init__::225::IOProcess::(_processLogs) (274519) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:35,046::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:35,047::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:35,048::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:35,048::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:16:35,048::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:35,049::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:35,049::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:35,049::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:35,049::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:35,050::__init__::225::IOProcess::(_processLogs) (274520) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:35,050::__init__::225::IOProcess::(_processLogs) (274520) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:35,050::__init__::225::IOProcess::(_processLogs) (274520) Building response >Thread-18::DEBUG::2014-07-08 17:16:35,050::__init__::225::IOProcess::(_processLogs) (274520) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:35,051::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:35,051::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:35,052::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:35,052::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:16:35,053::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:35,053::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:35,053::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:35,053::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:35,054::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:35,054::__init__::225::IOProcess::(_processLogs) (274521) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:35,054::__init__::225::IOProcess::(_processLogs) (274521) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:35,054::__init__::225::IOProcess::(_processLogs) (274521) Building response >Thread-18::DEBUG::2014-07-08 17:16:35,055::__init__::225::IOProcess::(_processLogs) (274521) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:35,055::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:35,055::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:16:35,289::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:16:35,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f4a7468-bfef-4ce6-a420-5acb87fd2987`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:16:35,290::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:16:35,306::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:35,308::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f4a7468-bfef-4ce6-a420-5acb87fd2987`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:35,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f4a7468-bfef-4ce6-a420-5acb87fd2987`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:35,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:35,311::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:35,312::task::993::Storage.TaskManager.Task::(_decref) Task=`2f4a7468-bfef-4ce6-a420-5acb87fd2987`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:16:35,328::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:16:35,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff4963c9-2e57-4940-b268-c05288aa091a`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:16:35,333::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:16:35,340::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ab664cdb-9782-45a6-ac6a-12f3b8a3ab92`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:16:35,341::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:16:35,344::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:16:35,345::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ab664cdb-9782-45a6-ac6a-12f3b8a3ab92`::Granted request >Thread-7083::DEBUG::2014-07-08 17:16:35,349::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff4963c9-2e57-4940-b268-c05288aa091a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:16:35,351::task::993::Storage.TaskManager.Task::(_decref) Task=`ff4963c9-2e57-4940-b268-c05288aa091a`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:16:35,387::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:35,388::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff4963c9-2e57-4940-b268-c05288aa091a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:35,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff4963c9-2e57-4940-b268-c05288aa091a`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:16:35,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:16:35,392::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:16:35,393::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:16:35,395::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:16:35,396::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:16:35,396::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:16:35,398::task::993::Storage.TaskManager.Task::(_decref) Task=`ff4963c9-2e57-4940-b268-c05288aa091a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:16:35,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:36,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359741 s, 28.5 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:16:36,855::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:16:36,855::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:16:38,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:38,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188773 s, 54.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:38,889::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:38,891::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:38,892::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:16:39,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2e8e736-71a5-4e2c-b849-dbb1bcb7f8e6`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:16:39,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:16:39,825::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482731', 'lastCheck': '4.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:16:39,825::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2e8e736-71a5-4e2c-b849-dbb1bcb7f8e6`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482731', 'lastCheck': '4.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:16:39,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2e8e736-71a5-4e2c-b849-dbb1bcb7f8e6`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:39,826::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:39,826::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:39,826::task::993::Storage.TaskManager.Task::(_decref) Task=`d2e8e736-71a5-4e2c-b849-dbb1bcb7f8e6`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:16:39,858::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:16:40,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:40,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017449 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:16:42,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:43,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106168 s, 9.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:43,900::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:43,901::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:43,902::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:16:45,058::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:45,058::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:45,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:45,059::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:45,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:45,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:45,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:45,060::__init__::225::IOProcess::(_processLogs) (274522) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:45,060::__init__::225::IOProcess::(_processLogs) (274522) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:45,060::__init__::225::IOProcess::(_processLogs) (274522) Building response >Thread-18::DEBUG::2014-07-08 17:16:45,060::__init__::225::IOProcess::(_processLogs) (274522) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:45,061::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:45,061::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:16:45,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:45,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 17:16:45,368::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000427138 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:16:45,371::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:45,372::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:45,372::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:45,372::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:45,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:45,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:45,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:45,373::__init__::225::IOProcess::(_processLogs) (274523) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:45,374::__init__::225::IOProcess::(_processLogs) (274523) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:45,379::__init__::225::IOProcess::(_processLogs) (274523) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:45,380::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:45,380::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:16:45,384::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:16:45,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:45,388::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:45,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:45,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:45,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:45,390::__init__::225::IOProcess::(_processLogs) (274524) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:45,391::__init__::225::IOProcess::(_processLogs) (274524) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:45,391::__init__::225::IOProcess::(_processLogs) (274524) Building response >Thread-18::DEBUG::2014-07-08 17:16:45,392::__init__::225::IOProcess::(_processLogs) (274524) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:45,392::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:45,395::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:16:45,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:45,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:45,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:45,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:45,402::__init__::225::IOProcess::(_processLogs) (274525) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:45,404::__init__::225::IOProcess::(_processLogs) (274525) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:45,405::__init__::225::IOProcess::(_processLogs) (274525) Building response >Thread-18::DEBUG::2014-07-08 17:16:45,406::__init__::225::IOProcess::(_processLogs) (274525) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:45,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:45,409::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:45,414::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:16:45,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:45,416::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:45,417::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:45,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:45,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::DEBUG::2014-07-08 17:16:45,425::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:16:45,427::__init__::225::IOProcess::(_processLogs) (274526) Finding callback 'access'... >Thread-7087::DEBUG::2014-07-08 17:16:45,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcc89cb7-e508-4149-b6b5-4e7d462593c0`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:16:45,501::__init__::225::IOProcess::(_processLogs) (274526) Got request for method 'access' >Dummy-6860::DEBUG::2014-07-08 17:16:45,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0579825 s, 17.7 MB/s\n'; <rc> = 0 >Thread-7087::INFO::2014-07-08 17:16:45,507::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:16:45,510::__init__::225::IOProcess::(_processLogs) (274526) Building response >Thread-18::DEBUG::2014-07-08 17:16:45,516::__init__::225::IOProcess::(_processLogs) (274526) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:45,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:45,519::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::INFO::2014-07-08 17:16:45,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:45,533::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcc89cb7-e508-4149-b6b5-4e7d462593c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:45,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcc89cb7-e508-4149-b6b5-4e7d462593c0`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:45,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:45,539::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:45,543::task::993::Storage.TaskManager.Task::(_decref) Task=`bcc89cb7-e508-4149-b6b5-4e7d462593c0`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:16:45,566::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:16:45,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5e98136-204e-4f38-af80-f108cfb93ee9`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:16:45,576::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:16:45,584::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cc5d2f67-a6d0-476d-a667-5f8a9b169857`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:16:45,587::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:16:45,593::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:16:45,596::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cc5d2f67-a6d0-476d-a667-5f8a9b169857`::Granted request >Thread-7083::DEBUG::2014-07-08 17:16:45,604::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b5e98136-204e-4f38-af80-f108cfb93ee9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:16:45,607::task::993::Storage.TaskManager.Task::(_decref) Task=`b5e98136-204e-4f38-af80-f108cfb93ee9`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:16:45,666::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:45,669::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5e98136-204e-4f38-af80-f108cfb93ee9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:45,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5e98136-204e-4f38-af80-f108cfb93ee9`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:16:45,673::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:16:45,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:16:45,680::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:16:45,684::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:16:45,686::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:16:45,688::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:16:45,692::task::993::Storage.TaskManager.Task::(_decref) Task=`b5e98136-204e-4f38-af80-f108cfb93ee9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:16:47,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:48,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174194 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:48,910::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:48,912::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:48,913::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:16:50,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:50,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173965 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:16:51,941::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:16:51,941::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:16:52,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:52,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0201666 s, 50.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:53,923::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:53,925::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:53,927::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:16:54,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:54,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173188 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:16:55,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`e99cb216-549f-48ec-b0f3-a1d1c9d34c09`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:16:55,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:16:55,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427138', 'lastCheck': '9.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:16:55,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`e99cb216-549f-48ec-b0f3-a1d1c9d34c09`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427138', 'lastCheck': '9.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:16:55,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`e99cb216-549f-48ec-b0f3-a1d1c9d34c09`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:55,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:55,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:55,069::task::993::Storage.TaskManager.Task::(_decref) Task=`e99cb216-549f-48ec-b0f3-a1d1c9d34c09`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:16:55,100::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:16:55,533::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:55,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:55,534::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:55,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:55,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:55,535::__init__::225::IOProcess::(_processLogs) (274527) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:55,535::__init__::225::IOProcess::(_processLogs) (274527) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:55,535::__init__::225::IOProcess::(_processLogs) (274527) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:55,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:55,536::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:16:55,537::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:16:55,685::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000495302 s, 933 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:16:55,687::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:16:55,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:55,688::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:55,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:55,688::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:55,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:55,689::__init__::225::IOProcess::(_processLogs) (274528) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:16:55,689::__init__::225::IOProcess::(_processLogs) (274528) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:16:55,689::__init__::225::IOProcess::(_processLogs) (274528) Building response >Thread-18::DEBUG::2014-07-08 17:16:55,690::__init__::225::IOProcess::(_processLogs) (274528) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:55,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:55,690::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:16:55,692::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:55,693::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:16:55,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:55,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:55,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:55,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:55,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:55,694::__init__::225::IOProcess::(_processLogs) (274529) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:55,695::__init__::225::IOProcess::(_processLogs) (274529) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:55,695::__init__::225::IOProcess::(_processLogs) (274529) Building response >Thread-18::DEBUG::2014-07-08 17:16:55,695::__init__::225::IOProcess::(_processLogs) (274529) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:55,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:55,695::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:55,697::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:55,697::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:16:55,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:55,697::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:55,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:55,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:55,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:55,698::__init__::225::IOProcess::(_processLogs) (274530) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:55,699::__init__::225::IOProcess::(_processLogs) (274530) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:55,699::__init__::225::IOProcess::(_processLogs) (274530) Building response >Thread-18::DEBUG::2014-07-08 17:16:55,699::__init__::225::IOProcess::(_processLogs) (274530) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:55,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:55,700::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:16:55,701::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:16:55,701::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:16:55,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:16:55,701::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:16:55,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:16:55,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:16:55,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:16:55,702::__init__::225::IOProcess::(_processLogs) (274531) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:16:55,703::__init__::225::IOProcess::(_processLogs) (274531) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:16:55,703::__init__::225::IOProcess::(_processLogs) (274531) Building response >Thread-18::DEBUG::2014-07-08 17:16:55,703::__init__::225::IOProcess::(_processLogs) (274531) Queuing response >Thread-18::DEBUG::2014-07-08 17:16:55,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:16:55,703::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:16:55,716::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:16:55,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`57969023-ed22-4eb7-b638-0950d3e3e8f5`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:16:55,718::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:16:55,732::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:55,733::task::1191::Storage.TaskManager.Task::(prepare) Task=`57969023-ed22-4eb7-b638-0950d3e3e8f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:16:55,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`57969023-ed22-4eb7-b638-0950d3e3e8f5`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:16:55,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:16:55,734::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:16:55,734::task::993::Storage.TaskManager.Task::(_decref) Task=`57969023-ed22-4eb7-b638-0950d3e3e8f5`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:16:55,745::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:16:55,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`e963ba9d-ac1d-4e44-8a3a-89d61bb2bbf8`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:16:55,747::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:16:55,748::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d8275939-fc2b-4dde-b73c-fcedce08c0a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:16:55,748::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:16:55,748::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:16:55,749::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d8275939-fc2b-4dde-b73c-fcedce08c0a6`::Granted request >Thread-7083::DEBUG::2014-07-08 17:16:55,749::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e963ba9d-ac1d-4e44-8a3a-89d61bb2bbf8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:16:55,750::task::993::Storage.TaskManager.Task::(_decref) Task=`e963ba9d-ac1d-4e44-8a3a-89d61bb2bbf8`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:16:55,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:55,769::task::1191::Storage.TaskManager.Task::(prepare) Task=`e963ba9d-ac1d-4e44-8a3a-89d61bb2bbf8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:16:55,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`e963ba9d-ac1d-4e44-8a3a-89d61bb2bbf8`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:16:55,769::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:16:55,770::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:16:55,770::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:16:55,770::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:16:55,771::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:16:55,771::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:16:55,771::task::993::Storage.TaskManager.Task::(_decref) Task=`e963ba9d-ac1d-4e44-8a3a-89d61bb2bbf8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:16:56,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:57,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173655 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:58,934::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:58,935::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:16:58,936::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:16:59,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:16:59,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0259306 s, 39.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:16:59,796::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:17:01,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:01,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174468 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:17:03,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:03,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017237 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:03,992::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:03,997::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:04,002::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:17:05,706::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:17:05,707::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:17:05,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:05,708::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:05,708::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:05,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:05,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:05,709::__init__::225::IOProcess::(_processLogs) (274532) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:05,709::__init__::225::IOProcess::(_processLogs) (274532) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:17:05,709::__init__::225::IOProcess::(_processLogs) (274532) Building response >Thread-18::DEBUG::2014-07-08 17:17:05,709::__init__::225::IOProcess::(_processLogs) (274532) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:05,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:05,710::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:17:05,712::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:17:05,859::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:17:05,864::task::595::Storage.TaskManager.Task::(_updateState) Task=`179990a1-ba71-433d-ae69-09fcc62f8e39`::moving from state init -> state preparing >Thread-37::DEBUG::2014-07-08 17:17:05,864::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000433843 s, 1.1 MB/s\n'; <rc> = 0 >Thread-7087::INFO::2014-07-08 17:17:05,867::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:05,869::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:17:05,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:05,870::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:05,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:05,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:05,871::__init__::225::IOProcess::(_processLogs) (274533) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:05,871::__init__::225::IOProcess::(_processLogs) (274533) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:17:05,872::__init__::225::IOProcess::(_processLogs) (274533) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:05,872::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:05,872::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:17:05,878::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:17:05,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:05,881::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::INFO::2014-07-08 17:17:05,887::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:17:05,887::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7087::DEBUG::2014-07-08 17:17:05,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`179990a1-ba71-433d-ae69-09fcc62f8e39`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:17:05,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`179990a1-ba71-433d-ae69-09fcc62f8e39`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:17:05,889::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::DEBUG::2014-07-08 17:17:05,890::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:17:05,891::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:17:05,892::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::DEBUG::2014-07-08 17:17:05,892::task::993::Storage.TaskManager.Task::(_decref) Task=`179990a1-ba71-433d-ae69-09fcc62f8e39`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:17:05,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:05,896::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:05,897::__init__::225::IOProcess::(_processLogs) (274535) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:05,897::__init__::225::IOProcess::(_processLogs) (274535) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:05,897::__init__::225::IOProcess::(_processLogs) (274535) Building response >Thread-18::DEBUG::2014-07-08 17:17:05,898::__init__::225::IOProcess::(_processLogs) (274535) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:05,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:05,898::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:17:05,905::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:17:05,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:17:05,912::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:17:05,915::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:17:05,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`6266b803-c809-4d00-8429-8abdc5d74578`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:17:05,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::INFO::2014-07-08 17:17:05,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:05,929::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:05,935::__init__::225::IOProcess::(_processLogs) (274536) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:17:05,935::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`79e08981-ba55-413c-b433-4c842fd8ffce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:17:05,938::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:17:05,938::__init__::225::IOProcess::(_processLogs) (274536) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:17:05,943::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:17:05,944::__init__::225::IOProcess::(_processLogs) (274536) Building response >Thread-7083::DEBUG::2014-07-08 17:17:05,946::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`79e08981-ba55-413c-b433-4c842fd8ffce`::Granted request >Thread-18::DEBUG::2014-07-08 17:17:05,948::__init__::225::IOProcess::(_processLogs) (274536) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:05,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:17:05,953::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6266b803-c809-4d00-8429-8abdc5d74578`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:17:05,956::task::993::Storage.TaskManager.Task::(_decref) Task=`6266b803-c809-4d00-8429-8abdc5d74578`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:17:05,956::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:17:05,998::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:17:06,000::task::1191::Storage.TaskManager.Task::(prepare) Task=`6266b803-c809-4d00-8429-8abdc5d74578`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:17:06,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`6266b803-c809-4d00-8429-8abdc5d74578`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:17:06,003::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:17:06,004::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:17:06,007::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:17:06,009::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:17:06,010::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:17:06,011::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:17:06,014::task::993::Storage.TaskManager.Task::(_decref) Task=`6266b803-c809-4d00-8429-8abdc5d74578`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:17:06,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:06,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038538 s, 26.6 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:17:07,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0b070e1-2601-4724-9e53-0e3115aacaf7`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:17:07,059::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:17:07,061::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:17:07,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:07,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:07,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:07,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:07,062::__init__::225::IOProcess::(_processLogs) (274537) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:17:07,063::__init__::225::IOProcess::(_processLogs) (274537) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:17:07,063::__init__::225::IOProcess::(_processLogs) (274537) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:07,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:07,063::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:17:07,065::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:17:07,066::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:07,066::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:07,066::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:07,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:07,067::__init__::225::IOProcess::(_processLogs) (274538) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:17:07,067::__init__::225::IOProcess::(_processLogs) (274538) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:17:07,067::__init__::225::IOProcess::(_processLogs) (274538) Building response >Thread-18::DEBUG::2014-07-08 17:17:07,068::__init__::225::IOProcess::(_processLogs) (274538) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:07,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:07,068::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:17:07,069::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:17:07,070::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0b070e1-2601-4724-9e53-0e3115aacaf7`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:17:07,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0b070e1-2601-4724-9e53-0e3115aacaf7`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:17:07,070::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:17:07,070::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:17:07,071::task::993::Storage.TaskManager.Task::(_decref) Task=`e0b070e1-2601-4724-9e53-0e3115aacaf7`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:17:07,160::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:17:07,162::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:17:08,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:08,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173238 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:09,011::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:09,013::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:09,014::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:17:10,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0abbd48-aa8e-41e3-b2f8-a351f90c4a13`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:17:10,213::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:17:10,214::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433843', 'lastCheck': '4.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:17:10,214::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0abbd48-aa8e-41e3-b2f8-a351f90c4a13`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433843', 'lastCheck': '4.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:17:10,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0abbd48-aa8e-41e3-b2f8-a351f90c4a13`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:17:10,214::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:17:10,215::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:17:10,215::task::993::Storage.TaskManager.Task::(_decref) Task=`f0abbd48-aa8e-41e3-b2f8-a351f90c4a13`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:17:10,247::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:10,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:10,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308802 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:17:12,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:13,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171973 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:14,019::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:14,020::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:14,021::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:15,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:15,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0864675 s, 11.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:17:15,971::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:17:15,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:15,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:15,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:15,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:15,973::__init__::225::IOProcess::(_processLogs) (274539) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:15,973::__init__::225::IOProcess::(_processLogs) (274539) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:17:15,973::__init__::225::IOProcess::(_processLogs) (274539) Building response >Thread-18::DEBUG::2014-07-08 17:17:15,974::__init__::225::IOProcess::(_processLogs) (274539) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:15,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:15,974::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:17:15,976::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:17:16,128::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:17:16,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`c69cab2f-ce6c-4c3a-88bf-e2e143951d32`::moving from state init -> state preparing >Thread-37::DEBUG::2014-07-08 17:17:16,132::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00100206 s, 461 kB/s\n'; <rc> = 0 >Thread-7087::INFO::2014-07-08 17:17:16,134::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:16,137::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:17:16,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:16,139::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:16,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:16,139::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:16,139::__init__::225::IOProcess::(_processLogs) (274540) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:16,140::__init__::225::IOProcess::(_processLogs) (274540) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:17:16,140::__init__::225::IOProcess::(_processLogs) (274540) Building response >Thread-18::DEBUG::2014-07-08 17:17:16,140::__init__::225::IOProcess::(_processLogs) (274540) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:16,140::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:16,140::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:17:16,143::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:17:16,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:16,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:16,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:16,145::__init__::225::IOProcess::(_processLogs) (274541) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:16,147::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:17:16,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:16,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:16,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:16,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:16,148::__init__::225::IOProcess::(_processLogs) (274542) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:16,149::__init__::225::IOProcess::(_processLogs) (274542) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:16,149::__init__::225::IOProcess::(_processLogs) (274542) Building response >Thread-18::DEBUG::2014-07-08 17:17:16,149::__init__::225::IOProcess::(_processLogs) (274542) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:16,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:16,150::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:17:16,151::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7087::INFO::2014-07-08 17:17:16,151::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:17:16,153::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::DEBUG::2014-07-08 17:17:16,153::task::1191::Storage.TaskManager.Task::(prepare) Task=`c69cab2f-ce6c-4c3a-88bf-e2e143951d32`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:17:16,154::task::595::Storage.TaskManager.Task::(_updateState) Task=`c69cab2f-ce6c-4c3a-88bf-e2e143951d32`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:17:16,154::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::DEBUG::2014-07-08 17:17:16,155::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:17:16,156::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:17:16,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7087::DEBUG::2014-07-08 17:17:16,158::task::993::Storage.TaskManager.Task::(_decref) Task=`c69cab2f-ce6c-4c3a-88bf-e2e143951d32`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:17:16,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:16,160::__init__::225::IOProcess::(_processLogs) (274543) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:16,162::__init__::225::IOProcess::(_processLogs) (274543) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:16,163::__init__::225::IOProcess::(_processLogs) (274543) Building response >Thread-18::DEBUG::2014-07-08 17:17:16,163::__init__::225::IOProcess::(_processLogs) (274543) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:16,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:16,163::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:17:16,172::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:17:16,173::task::595::Storage.TaskManager.Task::(_updateState) Task=`8657c3c2-8e51-43db-896d-e094658ba143`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:17:16,174::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:17:16,174::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d7f64cc2-cf6c-47bf-87ed-c373d24f5b6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:17:16,175::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:17:16,175::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:17:16,175::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d7f64cc2-cf6c-47bf-87ed-c373d24f5b6f`::Granted request >Thread-7083::DEBUG::2014-07-08 17:17:16,176::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8657c3c2-8e51-43db-896d-e094658ba143`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:17:16,176::task::993::Storage.TaskManager.Task::(_decref) Task=`8657c3c2-8e51-43db-896d-e094658ba143`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:17:16,195::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:17:16,196::task::1191::Storage.TaskManager.Task::(prepare) Task=`8657c3c2-8e51-43db-896d-e094658ba143`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:17:16,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`8657c3c2-8e51-43db-896d-e094658ba143`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:17:16,196::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:17:16,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:17:16,197::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:17:16,197::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:17:16,198::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:17:16,198::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:17:16,198::task::993::Storage.TaskManager.Task::(_decref) Task=`8657c3c2-8e51-43db-896d-e094658ba143`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:17:17,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:17,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180373 s, 56.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:19,028::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:19,030::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:19,031::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:19,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:20,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175523 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:17:22,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:22,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195693 s, 52.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:17:22,323::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:17:22,324::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:24,038::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:24,039::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:24,041::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:24,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:24,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173501 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:17:25,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`67ee6b34-d9ee-45f0-970e-85570fcfa8e0`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:17:25,358::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:17:25,358::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100206', 'lastCheck': '9.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:17:25,359::task::1191::Storage.TaskManager.Task::(prepare) Task=`67ee6b34-d9ee-45f0-970e-85570fcfa8e0`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100206', 'lastCheck': '9.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:17:25,359::task::595::Storage.TaskManager.Task::(_updateState) Task=`67ee6b34-d9ee-45f0-970e-85570fcfa8e0`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:17:25,359::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:17:25,359::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:17:25,360::task::993::Storage.TaskManager.Task::(_decref) Task=`67ee6b34-d9ee-45f0-970e-85570fcfa8e0`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:17:25,391::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:17:26,171::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:17:26,175::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:26,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:26,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:26,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:26,182::__init__::225::IOProcess::(_processLogs) (274544) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:26,182::__init__::225::IOProcess::(_processLogs) (274544) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:17:26,183::__init__::225::IOProcess::(_processLogs) (274544) Building response >Thread-18::DEBUG::2014-07-08 17:17:26,183::__init__::225::IOProcess::(_processLogs) (274544) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:26,183::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:26,183::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:17:26,186::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:17:26,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000603692 s, 765 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:17:26,494::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:17:26,504::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 17:17:26,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`1975b70f-935f-4c5e-823e-5c45be5f51cb`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:17:26,511::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:26,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:26,514::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:26,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:26,516::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:26,518::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:26,520::__init__::225::IOProcess::(_processLogs) (274545) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:26,521::__init__::225::IOProcess::(_processLogs) (274545) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:17:26,523::__init__::225::IOProcess::(_processLogs) (274545) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:26,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:26,526::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::INFO::2014-07-08 17:17:26,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:17:26,532::task::1191::Storage.TaskManager.Task::(prepare) Task=`1975b70f-935f-4c5e-823e-5c45be5f51cb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:17:26,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`1975b70f-935f-4c5e-823e-5c45be5f51cb`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:17:26,535::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:17:26,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:17:26,541::task::993::Storage.TaskManager.Task::(_decref) Task=`1975b70f-935f-4c5e-823e-5c45be5f51cb`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:17:26,546::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:17:26,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:26,553::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:26,554::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:26,556::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:26,558::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:26,559::__init__::225::IOProcess::(_processLogs) (274546) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:26,561::__init__::225::IOProcess::(_processLogs) (274546) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:26,562::__init__::225::IOProcess::(_processLogs) (274546) Building response >Thread-18::DEBUG::2014-07-08 17:17:26,565::__init__::225::IOProcess::(_processLogs) (274546) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:26,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:17:26,570::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:17:26,573::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:17:26,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`14c70df6-2213-4903-a5c4-f0d6e5d1987e`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:17:26,581::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:26,584::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:17:26,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:17:26,591::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`72df7fa3-4275-4844-ad3a-965ce2fa5861`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:17:26,592::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:17:26,593::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:17:26,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:17:26,598::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:17:26,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:17:26,601::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`72df7fa3-4275-4844-ad3a-965ce2fa5861`::Granted request >Thread-18::DEBUG::2014-07-08 17:17:26,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:26,609::__init__::225::IOProcess::(_processLogs) (274547) Finding callback 'access'... >Dummy-6860::DEBUG::2014-07-08 17:17:26,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:17:26,615::__init__::225::IOProcess::(_processLogs) (274547) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:17:26,777::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`14c70df6-2213-4903-a5c4-f0d6e5d1987e`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:17:26,782::task::993::Storage.TaskManager.Task::(_decref) Task=`14c70df6-2213-4903-a5c4-f0d6e5d1987e`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:17:26,782::__init__::225::IOProcess::(_processLogs) (274547) Building response >Thread-18::DEBUG::2014-07-08 17:17:26,789::__init__::225::IOProcess::(_processLogs) (274547) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:26,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:26,827::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:17:26,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:26,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:26,844::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:26,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:26,853::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:26,859::__init__::225::IOProcess::(_processLogs) (274548) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:26,865::__init__::225::IOProcess::(_processLogs) (274548) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:26,868::__init__::225::IOProcess::(_processLogs) (274548) Building response >Thread-18::DEBUG::2014-07-08 17:17:26,872::__init__::225::IOProcess::(_processLogs) (274548) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:26,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:26,878::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:17:26,887::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:17:26,894::task::1191::Storage.TaskManager.Task::(prepare) Task=`14c70df6-2213-4903-a5c4-f0d6e5d1987e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:17:26,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`14c70df6-2213-4903-a5c4-f0d6e5d1987e`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:17:26,903::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:17:26,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-6860::DEBUG::2014-07-08 17:17:26,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.130659 s, 7.8 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:17:26,978::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:17:26,982::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:17:26,984::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:17:26,987::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:17:26,997::task::993::Storage.TaskManager.Task::(_decref) Task=`14c70df6-2213-4903-a5c4-f0d6e5d1987e`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:29,044::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:29,045::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:29,046::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:29,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:29,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174233 s, 58.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:17:30,489::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:17:31,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:31,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898167 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:17:34,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:34,168::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:34,172::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:34,174::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:34,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211432 s, 48.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:17:36,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:36,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017732 s, 57.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:17:36,901::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:17:36,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:36,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:36,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:36,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:36,902::__init__::225::IOProcess::(_processLogs) (274549) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:36,902::__init__::225::IOProcess::(_processLogs) (274549) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:17:36,903::__init__::225::IOProcess::(_processLogs) (274549) Building response >Thread-18::DEBUG::2014-07-08 17:17:36,903::__init__::225::IOProcess::(_processLogs) (274549) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:36,903::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:36,903::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:17:36,905::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:17:37,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000506197 s, 913 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:17:37,152::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:17:37,175::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 17:17:37,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b236b78-9279-483e-a0d3-f210a854f6b8`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:17:37,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::INFO::2014-07-08 17:17:37,185::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:37,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:37,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:37,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:37,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:37,211::__init__::225::IOProcess::(_processLogs) (274550) Finding callback 'statvfs'... >Thread-7087::INFO::2014-07-08 17:17:37,212::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:17:37,218::__init__::225::IOProcess::(_processLogs) (274550) Got request for method 'statvfs' >Thread-7087::DEBUG::2014-07-08 17:17:37,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b236b78-9279-483e-a0d3-f210a854f6b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:17:37,225::__init__::225::IOProcess::(_processLogs) (274550) Queuing response >Thread-7087::DEBUG::2014-07-08 17:17:37,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b236b78-9279-483e-a0d3-f210a854f6b8`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:17:37,233::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:17:37,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::DEBUG::2014-07-08 17:17:37,238::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:17:37,241::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7087::DEBUG::2014-07-08 17:17:37,336::task::993::Storage.TaskManager.Task::(_decref) Task=`0b236b78-9279-483e-a0d3-f210a854f6b8`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:17:37,404::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:17:37,402::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:17:37,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`eceecd30-080e-47fe-8548-9c5c3c6f1017`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:17:37,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 17:17:37,421::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:37,429::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:37,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:17:37,446::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f573aecc-7d0a-4322-9763-476220316387`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:17:37,449::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:17:37,452::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7086::DEBUG::2014-07-08 17:17:37,463::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:17:37,462::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:17:37,468::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:17:37,478::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f573aecc-7d0a-4322-9763-476220316387`::Granted request >Thread-18::DEBUG::2014-07-08 17:17:37,479::__init__::225::IOProcess::(_processLogs) (274551) Finding callback 'access'... >Thread-7086::ERROR::2014-07-08 17:17:37,475::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:17:37,496::__init__::225::IOProcess::(_processLogs) (274551) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:17:37,501::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`eceecd30-080e-47fe-8548-9c5c3c6f1017`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:17:37,511::task::993::Storage.TaskManager.Task::(_decref) Task=`eceecd30-080e-47fe-8548-9c5c3c6f1017`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:17:37,512::__init__::225::IOProcess::(_processLogs) (274551) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:37,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:37,542::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:17:37,564::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:17:37,570::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:37,576::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:37,582::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:37,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:37,592::__init__::225::IOProcess::(_processLogs) (274552) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:37,598::__init__::225::IOProcess::(_processLogs) (274552) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:37,602::__init__::225::IOProcess::(_processLogs) (274552) Building response >Thread-18::DEBUG::2014-07-08 17:17:37,607::__init__::225::IOProcess::(_processLogs) (274552) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:37,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:37,614::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:17:37,629::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:17:37,633::task::1191::Storage.TaskManager.Task::(prepare) Task=`eceecd30-080e-47fe-8548-9c5c3c6f1017`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:17:37,635::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 17:17:37,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`eceecd30-080e-47fe-8548-9c5c3c6f1017`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:17:37,640::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:17:37,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:17:37,644::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:37,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:17:37,648::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:17:37,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:37,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:17:37,657::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:17:37,662::__init__::225::IOProcess::(_processLogs) (274553) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:17:37,666::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:17:37,668::__init__::225::IOProcess::(_processLogs) (274553) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:17:37,670::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:17:37,674::__init__::225::IOProcess::(_processLogs) (274553) Queuing response >Thread-7083::DEBUG::2014-07-08 17:17:37,675::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:17:37,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:17:37,683::task::993::Storage.TaskManager.Task::(_decref) Task=`eceecd30-080e-47fe-8548-9c5c3c6f1017`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:17:37,684::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:17:38,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:38,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171889 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:39,185::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:39,186::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:39,187::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:17:40,572::task::595::Storage.TaskManager.Task::(_updateState) Task=`68bcac69-9cae-4acb-bc2a-ffd5e3eb0d85`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:17:40,572::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:17:40,573::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506197', 'lastCheck': '2.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:17:40,573::task::1191::Storage.TaskManager.Task::(prepare) Task=`68bcac69-9cae-4acb-bc2a-ffd5e3eb0d85`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506197', 'lastCheck': '2.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:17:40,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`68bcac69-9cae-4acb-bc2a-ffd5e3eb0d85`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:17:40,573::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:17:40,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:17:40,574::task::993::Storage.TaskManager.Task::(_decref) Task=`68bcac69-9cae-4acb-bc2a-ffd5e3eb0d85`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:17:40,604::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:40,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:41,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172191 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:17:43,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:43,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174758 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:44,195::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:44,196::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:44,197::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:45,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:45,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174934 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:17:47,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 17:17:47,745::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-7087::DEBUG::2014-07-08 17:17:47,758::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:17:47,769::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-7087::DEBUG::2014-07-08 17:17:47,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`61a0804a-7564-4c9b-ad8c-df452338748d`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:17:47,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::INFO::2014-07-08 17:17:47,789::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:47,794::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:47,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:47,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:47,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:47,928::__init__::225::IOProcess::(_processLogs) (274554) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:17:47,932::__init__::225::IOProcess::(_processLogs) (274554) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:17:47,938::__init__::225::IOProcess::(_processLogs) (274554) Building response >Thread-18::DEBUG::2014-07-08 17:17:47,943::__init__::225::IOProcess::(_processLogs) (274554) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:47,951::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:47,963::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:17:48,084::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:17:48,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,103::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-6860::DEBUG::2014-07-08 17:17:48,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.348836 s, 2.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:17:48,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,185::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:48,191::__init__::225::IOProcess::(_processLogs) (274555) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:17:48,193::__init__::225::IOProcess::(_processLogs) (274555) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:17:48,195::__init__::225::IOProcess::(_processLogs) (274555) Building response >Thread-18::DEBUG::2014-07-08 17:17:48,197::__init__::225::IOProcess::(_processLogs) (274555) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:48,202::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:17:48,213::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:17:48,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,218::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:48,220::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,226::__init__::225::IOProcess::(_processLogs) (274556) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:17:48,228::__init__::225::IOProcess::(_processLogs) (274556) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:17:48,231::__init__::225::IOProcess::(_processLogs) (274556) Building response >Thread-18::DEBUG::2014-07-08 17:17:48,233::__init__::225::IOProcess::(_processLogs) (274556) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,236::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:48,239::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 17:17:48,246::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 17:17:48,256::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,262::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:48,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:48,279::__init__::225::IOProcess::(_processLogs) (274557) Finding callback 'glob'... >Thread-37::DEBUG::2014-07-08 17:17:48,281::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:17:48,282::__init__::225::IOProcess::(_processLogs) (274557) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:17:48,287::__init__::225::IOProcess::(_processLogs) (274557) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:48,292::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 17:17:48,300::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 17:17:48,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,305::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:48,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:48,315::__init__::225::IOProcess::(_processLogs) (274558) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 17:17:48,318::__init__::225::IOProcess::(_processLogs) (274558) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 17:17:48,321::__init__::225::IOProcess::(_processLogs) (274558) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:48,325::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 17:17:48,331::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 17:17:48,336::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 17:17:48,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:48,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:48,351::__init__::225::IOProcess::(_processLogs) (274559) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 17:17:48,353::__init__::225::IOProcess::(_processLogs) (274559) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 17:17:48,357::__init__::225::IOProcess::(_processLogs) (274559) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:48,361::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 17:17:48,367::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 17:17:48,376::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 17:17:48,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,382::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:48,384::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:48,390::__init__::225::IOProcess::(_processLogs) (274560) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:48,393::__init__::225::IOProcess::(_processLogs) (274560) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:48,395::__init__::225::IOProcess::(_processLogs) (274560) Building response >Thread-18::DEBUG::2014-07-08 17:17:48,398::__init__::225::IOProcess::(_processLogs) (274560) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,401::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:48,403::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:17:48,411::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 17:17:48,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,417::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:48,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,423::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:48,430::__init__::225::IOProcess::(_processLogs) (274561) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:17:48,433::__init__::225::IOProcess::(_processLogs) (274561) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:17:48,437::__init__::225::IOProcess::(_processLogs) (274561) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:48,442::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 17:17:48,447::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 17:17:48,449::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 17:17:48,451::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 17:17:48,457::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:17:48,460::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,461::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:48,463::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7087::INFO::2014-07-08 17:17:48,469::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:17:48,473::__init__::225::IOProcess::(_processLogs) (274562) Finding callback 'statvfs'... >Thread-7087::DEBUG::2014-07-08 17:17:48,476::task::1191::Storage.TaskManager.Task::(prepare) Task=`61a0804a-7564-4c9b-ad8c-df452338748d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:17:48,478::__init__::225::IOProcess::(_processLogs) (274562) Got request for method 'statvfs' >Thread-7087::DEBUG::2014-07-08 17:17:48,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`61a0804a-7564-4c9b-ad8c-df452338748d`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:17:48,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:17:48,485::__init__::225::IOProcess::(_processLogs) (274562) Queuing response >Thread-7087::DEBUG::2014-07-08 17:17:48,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:17:48,491::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::DEBUG::2014-07-08 17:17:48,494::task::993::Storage.TaskManager.Task::(_decref) Task=`61a0804a-7564-4c9b-ad8c-df452338748d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:17:48,496::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:17:48,517::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:17:48,682::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:17:48,683::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000659565 s, 700 kB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:17:48,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c54dfdc-abb7-4eb1-ac28-0b14ad118a20`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:17:48,703::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:48,704::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7083::DEBUG::2014-07-08 17:17:48,713::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`06968721-254e-44db-a30d-633b8a871626`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:17:48,715::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:17:48,713::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:17:48,721::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:17:48,724::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`06968721-254e-44db-a30d-633b8a871626`::Granted request >Thread-18::DEBUG::2014-07-08 17:17:48,724::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:17:48,739::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3c54dfdc-abb7-4eb1-ac28-0b14ad118a20`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:17:48,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:17:48,743::task::993::Storage.TaskManager.Task::(_decref) Task=`3c54dfdc-abb7-4eb1-ac28-0b14ad118a20`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:17:48,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:48,763::__init__::225::IOProcess::(_processLogs) (274563) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:48,771::__init__::225::IOProcess::(_processLogs) (274563) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:17:48,780::__init__::225::IOProcess::(_processLogs) (274563) Building response >Thread-18::DEBUG::2014-07-08 17:17:48,789::__init__::225::IOProcess::(_processLogs) (274563) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:48,816::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:17:48,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 17:17:48,822::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:17:48,827::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:17:48,829::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c54dfdc-abb7-4eb1-ac28-0b14ad118a20`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:17:48,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:17:48,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c54dfdc-abb7-4eb1-ac28-0b14ad118a20`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:17:48,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:17:48,839::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:17:48,842::__init__::225::IOProcess::(_processLogs) (274564) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:17:48,845::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:17:48,847::__init__::225::IOProcess::(_processLogs) (274564) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:48,853::__init__::225::IOProcess::(_processLogs) (274564) Building response >Thread-18::DEBUG::2014-07-08 17:17:48,857::__init__::225::IOProcess::(_processLogs) (274564) Queuing response >Thread-7083::DEBUG::2014-07-08 17:17:48,857::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:17:48,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:17:48,866::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:17:48,866::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:17:48,869::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:17:48,874::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:17:48,883::task::993::Storage.TaskManager.Task::(_decref) Task=`3c54dfdc-abb7-4eb1-ac28-0b14ad118a20`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:17:48,884::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:17:48,891::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,895::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:48,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:48,913::__init__::225::IOProcess::(_processLogs) (274565) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:48,916::__init__::225::IOProcess::(_processLogs) (274565) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:48,919::__init__::225::IOProcess::(_processLogs) (274565) Building response >Thread-18::DEBUG::2014-07-08 17:17:48,922::__init__::225::IOProcess::(_processLogs) (274565) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,925::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:17:48,934::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:17:48,937::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:48,939::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:48,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:48,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:48,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:48,951::__init__::225::IOProcess::(_processLogs) (274566) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:48,954::__init__::225::IOProcess::(_processLogs) (274566) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:48,958::__init__::225::IOProcess::(_processLogs) (274566) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:48,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:48,965::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:49,204::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:49,205::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:49,207::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:51,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:51,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173794 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:17:52,588::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:17:52,589::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:17:53,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:53,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112399 s, 9.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:54,214::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:54,216::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:54,217::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:55,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:17:55,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bf622d9-e276-4460-97a4-65fdd617e491`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:17:55,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:17:55,809::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659565', 'lastCheck': '6.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:17:55,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`3bf622d9-e276-4460-97a4-65fdd617e491`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659565', 'lastCheck': '6.8', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:17:55,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bf622d9-e276-4460-97a4-65fdd617e491`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:17:55,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:17:55,810::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:17:55,811::task::993::Storage.TaskManager.Task::(_decref) Task=`3bf622d9-e276-4460-97a4-65fdd617e491`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:17:55,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320943 s, 31.9 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:17:55,906::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:17:57,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:17:58,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172425 s, 59.4 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:17:58,934::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:17:58,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`a048f128-b146-4045-8450-c9272842b739`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:17:58,936::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:17:58,952::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:17:58,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`a048f128-b146-4045-8450-c9272842b739`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:17:58,956::task::595::Storage.TaskManager.Task::(_updateState) Task=`a048f128-b146-4045-8450-c9272842b739`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:17:58,957::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:17:58,959::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:17:58,960::task::993::Storage.TaskManager.Task::(_decref) Task=`a048f128-b146-4045-8450-c9272842b739`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:17:58,972::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:17:58,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`f42160a4-e443-457e-b5db-77e7d2bba382`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:17:58,975::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:17:58,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:58,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:58,977::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:58,977::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::INFO::2014-07-08 17:17:58,975::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:17:58,978::__init__::225::IOProcess::(_processLogs) (274567) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:58,980::__init__::225::IOProcess::(_processLogs) (274567) Got request for method 'statvfs' >Thread-7083::DEBUG::2014-07-08 17:17:58,982::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b202d5be-9be2-4067-a05e-1e0552c9472e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:17:58,982::__init__::225::IOProcess::(_processLogs) (274567) Building response >Thread-7083::DEBUG::2014-07-08 17:17:58,983::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:17:58,983::__init__::225::IOProcess::(_processLogs) (274567) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:58,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:17:58,985::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:17:58,986::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:17:58,987::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b202d5be-9be2-4067-a05e-1e0552c9472e`::Granted request >Thread-37::DEBUG::2014-07-08 17:17:58,992::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:17:59,139::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f42160a4-e443-457e-b5db-77e7d2bba382`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:17:59,145::task::993::Storage.TaskManager.Task::(_decref) Task=`f42160a4-e443-457e-b5db-77e7d2bba382`::ref 1 aborting False >Thread-37::DEBUG::2014-07-08 17:17:59,150::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000572963 s, 806 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:17:59,163::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:17:59,166::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:59,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:59,175::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:59,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:59,182::__init__::225::IOProcess::(_processLogs) (274568) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:17:59,185::__init__::225::IOProcess::(_processLogs) (274568) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:17:59,188::__init__::225::IOProcess::(_processLogs) (274568) Building response >Thread-18::DEBUG::2014-07-08 17:17:59,192::__init__::225::IOProcess::(_processLogs) (274568) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:59,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:59,198::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:17:59,210::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::INFO::2014-07-08 17:17:59,214::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:17:59,218::task::1191::Storage.TaskManager.Task::(prepare) Task=`f42160a4-e443-457e-b5db-77e7d2bba382`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:17:59,216::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:17:59,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`f42160a4-e443-457e-b5db-77e7d2bba382`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:17:59,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:17:59,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:59,229::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7083::DEBUG::2014-07-08 17:17:59,230::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:17:59,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:17:59,240::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:59,244::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:17:59,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:17:59,249::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:17:59,253::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:17:59,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:17:59,256::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >GuestMonitor-vm1::DEBUG::2014-07-08 17:17:59,259::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:17:59,262::__init__::225::IOProcess::(_processLogs) (274569) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:17:59,265::task::993::Storage.TaskManager.Task::(_decref) Task=`f42160a4-e443-457e-b5db-77e7d2bba382`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:17:59,269::__init__::225::IOProcess::(_processLogs) (274569) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:59,273::__init__::225::IOProcess::(_processLogs) (274569) Building response >Thread-18::DEBUG::2014-07-08 17:17:59,275::__init__::225::IOProcess::(_processLogs) (274569) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:59,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:59,280::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:17:59,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:17:59,289::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:17:59,290::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:59,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:59,292::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:59,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:59,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:59,297::__init__::225::IOProcess::(_processLogs) (274570) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:59,298::__init__::225::IOProcess::(_processLogs) (274570) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:59,299::__init__::225::IOProcess::(_processLogs) (274570) Building response >Thread-18::DEBUG::2014-07-08 17:17:59,301::__init__::225::IOProcess::(_processLogs) (274570) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:59,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:59,303::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:17:59,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:17:59,310::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:17:59,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:17:59,313::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:17:59,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:17:59,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:17:59,317::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:17:59,318::__init__::225::IOProcess::(_processLogs) (274571) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:17:59,319::__init__::225::IOProcess::(_processLogs) (274571) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:17:59,320::__init__::225::IOProcess::(_processLogs) (274571) Building response >Thread-18::DEBUG::2014-07-08 17:17:59,322::__init__::225::IOProcess::(_processLogs) (274571) Queuing response >Thread-18::DEBUG::2014-07-08 17:17:59,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:17:59,324::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:18:00,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:00,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331947 s, 30.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:18:00,879::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:18:02,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:02,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204194 s, 50.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:04,280::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:04,282::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:04,283::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:04,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:04,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174412 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:18:07,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:07,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348695 s, 29.4 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:18:07,623::task::595::Storage.TaskManager.Task::(_updateState) Task=`3781a4e2-5305-46fb-a7bc-7f9bb57bf388`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:18:07,625::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:18:07,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:18:07,630::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:18:07,631::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:07,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:07,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:07,636::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:07,637::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:07,638::__init__::225::IOProcess::(_processLogs) (274572) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:18:07,640::__init__::225::IOProcess::(_processLogs) (274572) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:18:07,641::__init__::225::IOProcess::(_processLogs) (274572) Building response >Thread-18::DEBUG::2014-07-08 17:18:07,642::__init__::225::IOProcess::(_processLogs) (274572) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:07,644::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:07,645::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:18:07,651::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:18:07,653::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:18:07,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:07,655::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:07,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:07,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:07,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:07,660::__init__::225::IOProcess::(_processLogs) (274573) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:18:07,661::__init__::225::IOProcess::(_processLogs) (274573) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:18:07,662::__init__::225::IOProcess::(_processLogs) (274573) Building response >Thread-18::DEBUG::2014-07-08 17:18:07,664::__init__::225::IOProcess::(_processLogs) (274573) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:07,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:07,666::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:18:07,671::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:18:07,672::task::1191::Storage.TaskManager.Task::(prepare) Task=`3781a4e2-5305-46fb-a7bc-7f9bb57bf388`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:18:07,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`3781a4e2-5305-46fb-a7bc-7f9bb57bf388`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:18:07,674::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:18:07,674::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:18:07,675::task::993::Storage.TaskManager.Task::(_decref) Task=`3781a4e2-5305-46fb-a7bc-7f9bb57bf388`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:18:07,771::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:18:07,771::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:09,290::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:09,292::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:09,293::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:18:09,299::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:18:09,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2b4a235-6186-4cd6-9f70-a4c76b026e82`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:18:09,300::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:18:09,315::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:09,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2b4a235-6186-4cd6-9f70-a4c76b026e82`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:09,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2b4a235-6186-4cd6-9f70-a4c76b026e82`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:18:09,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:18:09,316::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:18:09,317::task::993::Storage.TaskManager.Task::(_decref) Task=`a2b4a235-6186-4cd6-9f70-a4c76b026e82`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:18:09,426::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:18:09,426::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:09,435::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:18:09,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7540b06-d84c-41ae-8959-d8ce47c1b48c`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:18:09,442::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::INFO::2014-07-08 17:18:09,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:18:09,447::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:09,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 17:18:09,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:18:09,460::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`54e4ad33-da49-4183-b849-9308151c4425`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:18:09,461::__init__::225::IOProcess::(_processLogs) (274574) Finding callback 'statvfs'... >Thread-7083::DEBUG::2014-07-08 17:18:09,715::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:18:09,721::__init__::225::IOProcess::(_processLogs) (274574) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:09,728::__init__::225::IOProcess::(_processLogs) (274574) Building response >Thread-7083::DEBUG::2014-07-08 17:18:09,728::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:18:09,732::__init__::225::IOProcess::(_processLogs) (274574) Queuing response >Thread-7083::DEBUG::2014-07-08 17:18:09,736::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`54e4ad33-da49-4183-b849-9308151c4425`::Granted request >Thread-18::DEBUG::2014-07-08 17:18:09,738::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:09,744::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:18:09,765::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:18:09,762::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a7540b06-d84c-41ae-8959-d8ce47c1b48c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:18:10,065::task::993::Storage.TaskManager.Task::(_decref) Task=`a7540b06-d84c-41ae-8959-d8ce47c1b48c`::ref 1 aborting False >Thread-37::DEBUG::2014-07-08 17:18:10,075::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000768794 s, 601 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:18:10,088::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:10,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:10,096::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:10,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:10,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:10,111::__init__::225::IOProcess::(_processLogs) (274575) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:18:10,116::__init__::225::IOProcess::(_processLogs) (274575) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:10,119::__init__::225::IOProcess::(_processLogs) (274575) Building response >Thread-18::DEBUG::2014-07-08 17:18:10,124::__init__::225::IOProcess::(_processLogs) (274575) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:10,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:10,133::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::INFO::2014-07-08 17:18:10,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:18:10,165::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7540b06-d84c-41ae-8959-d8ce47c1b48c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:18:10,169::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:18:10,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7540b06-d84c-41ae-8959-d8ce47c1b48c`::moving from state preparing -> state finished >Dummy-6860::DEBUG::2014-07-08 17:18:10,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.54109 s, 1.9 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:18:10,240::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:18:10,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:18:10,244::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:18:10,246::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:10,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:18:10,252::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:18:10,256::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:18:10,259::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:18:10,262::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:18:10,262::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:18:10,265::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:18:10,267::__init__::225::IOProcess::(_processLogs) (274576) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:10,272::__init__::225::IOProcess::(_processLogs) (274576) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:18:10,273::task::993::Storage.TaskManager.Task::(_decref) Task=`a7540b06-d84c-41ae-8959-d8ce47c1b48c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:18:10,277::__init__::225::IOProcess::(_processLogs) (274576) Building response >Thread-18::DEBUG::2014-07-08 17:18:10,282::__init__::225::IOProcess::(_processLogs) (274576) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:10,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:10,291::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:10,306::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:18:10,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:10,310::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:10,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:10,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:10,319::__init__::225::IOProcess::(_processLogs) (274577) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:10,322::__init__::225::IOProcess::(_processLogs) (274577) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:10,326::__init__::225::IOProcess::(_processLogs) (274577) Building response >Thread-18::DEBUG::2014-07-08 17:18:10,329::__init__::225::IOProcess::(_processLogs) (274577) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:10,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:10,334::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:10,345::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:18:10,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:10,349::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:10,351::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:10,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:10,358::__init__::225::IOProcess::(_processLogs) (274578) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:10,361::__init__::225::IOProcess::(_processLogs) (274578) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:10,364::__init__::225::IOProcess::(_processLogs) (274578) Building response >Thread-18::DEBUG::2014-07-08 17:18:10,366::__init__::225::IOProcess::(_processLogs) (274578) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:10,369::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:10,373::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7087::DEBUG::2014-07-08 17:18:11,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`dce11fd5-529c-46c4-af52-9ad9547fb045`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:18:11,032::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:18:11,033::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000768794', 'lastCheck': '0.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:18:11,033::task::1191::Storage.TaskManager.Task::(prepare) Task=`dce11fd5-529c-46c4-af52-9ad9547fb045`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000768794', 'lastCheck': '0.7', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:18:11,033::task::595::Storage.TaskManager.Task::(_updateState) Task=`dce11fd5-529c-46c4-af52-9ad9547fb045`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:18:11,033::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:18:11,034::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:18:11,034::task::993::Storage.TaskManager.Task::(_decref) Task=`dce11fd5-529c-46c4-af52-9ad9547fb045`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:18:11,086::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:12,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:12,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171104 s, 59.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:14,300::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:14,301::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:14,302::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:14,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:15,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172378 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:18:17,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:17,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174481 s, 58.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:19,310::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:19,311::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:19,313::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:19,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:19,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176412 s, 58.0 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:18:20,315::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:18:20,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`9df54b7c-7c26-409d-bb3b-22752d457baf`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:18:20,316::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:18:20,331::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:20,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`9df54b7c-7c26-409d-bb3b-22752d457baf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:20,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`9df54b7c-7c26-409d-bb3b-22752d457baf`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:18:20,332::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:18:20,332::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:18:20,333::task::993::Storage.TaskManager.Task::(_decref) Task=`9df54b7c-7c26-409d-bb3b-22752d457baf`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:18:20,344::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:18:20,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c8ca25b-7f09-489f-ae46-32e17213c7f6`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:18:20,345::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:18:20,346::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ecec6080-b5bf-4be2-afbd-80cba3925dea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:18:20,347::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:18:20,347::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:18:20,348::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ecec6080-b5bf-4be2-afbd-80cba3925dea`::Granted request >Thread-7083::DEBUG::2014-07-08 17:18:20,348::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3c8ca25b-7f09-489f-ae46-32e17213c7f6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:18:20,349::task::993::Storage.TaskManager.Task::(_decref) Task=`3c8ca25b-7f09-489f-ae46-32e17213c7f6`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:18:20,367::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:18:20,368::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c8ca25b-7f09-489f-ae46-32e17213c7f6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:18:20,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c8ca25b-7f09-489f-ae46-32e17213c7f6`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:18:20,369::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:18:20,369::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:18:20,369::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:18:20,370::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:18:20,370::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:18:20,370::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:18:20,370::task::993::Storage.TaskManager.Task::(_decref) Task=`3c8ca25b-7f09-489f-ae46-32e17213c7f6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:18:20,382::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:20,383::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:20,383::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:20,383::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:20,383::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:20,384::__init__::225::IOProcess::(_processLogs) (274579) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:18:20,384::__init__::225::IOProcess::(_processLogs) (274579) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:20,384::__init__::225::IOProcess::(_processLogs) (274579) Building response >Thread-18::DEBUG::2014-07-08 17:18:20,384::__init__::225::IOProcess::(_processLogs) (274579) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:20,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:20,385::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:18:20,386::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:18:20,619::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00938336 s, 49.2 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:18:20,652::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:20,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:20,669::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:20,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:20,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:20,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:20,694::__init__::225::IOProcess::(_processLogs) (274580) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:18:20,700::__init__::225::IOProcess::(_processLogs) (274580) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:20,791::__init__::225::IOProcess::(_processLogs) (274580) Building response >Thread-18::DEBUG::2014-07-08 17:18:20,797::__init__::225::IOProcess::(_processLogs) (274580) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:20,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:20,811::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:18:20,845::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:18:20,852::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:20,855::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:20,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:20,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:20,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:20,871::__init__::225::IOProcess::(_processLogs) (274581) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:20,872::__init__::225::IOProcess::(_processLogs) (274581) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:20,874::__init__::225::IOProcess::(_processLogs) (274581) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:20,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:20,877::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:20,884::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:18:20,886::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:20,888::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:20,889::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:20,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:20,892::__init__::225::IOProcess::(_processLogs) (274582) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:20,893::__init__::225::IOProcess::(_processLogs) (274582) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:20,895::__init__::225::IOProcess::(_processLogs) (274582) Building response >Thread-18::DEBUG::2014-07-08 17:18:20,897::__init__::225::IOProcess::(_processLogs) (274582) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:20,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:20,899::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:20,908::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:18:20,910::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:20,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:20,913::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:20,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:20,916::__init__::225::IOProcess::(_processLogs) (274583) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:20,917::__init__::225::IOProcess::(_processLogs) (274583) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:20,919::__init__::225::IOProcess::(_processLogs) (274583) Building response >Thread-18::DEBUG::2014-07-08 17:18:20,921::__init__::225::IOProcess::(_processLogs) (274583) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:20,922::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:20,924::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:18:21,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:21,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172836 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:18:23,097::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:18:23,098::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:18:23,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:24,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172853 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:24,320::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:24,321::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:24,323::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:18:26,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`b16bd523-3b9b-4332-83e4-e2c92d3a9c0a`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:18:26,248::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:18:26,248::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00938336', 'lastCheck': '5.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:18:26,248::task::1191::Storage.TaskManager.Task::(prepare) Task=`b16bd523-3b9b-4332-83e4-e2c92d3a9c0a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00938336', 'lastCheck': '5.3', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:18:26,249::task::595::Storage.TaskManager.Task::(_updateState) Task=`b16bd523-3b9b-4332-83e4-e2c92d3a9c0a`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:18:26,249::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:18:26,249::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:18:26,249::task::993::Storage.TaskManager.Task::(_decref) Task=`b16bd523-3b9b-4332-83e4-e2c92d3a9c0a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:18:26,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:18:26,417::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:26,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017323 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:18:28,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:28,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175825 s, 58.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:29,330::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:29,331::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:29,333::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:18:30,386::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:18:30,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a808d36-184d-4ecc-a240-29b82897d2ad`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:18:30,387::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:18:30,402::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:30,402::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a808d36-184d-4ecc-a240-29b82897d2ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:30,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a808d36-184d-4ecc-a240-29b82897d2ad`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:18:30,403::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:18:30,403::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:18:30,403::task::993::Storage.TaskManager.Task::(_decref) Task=`2a808d36-184d-4ecc-a240-29b82897d2ad`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:18:30,415::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:18:30,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`e380d95a-763a-44ff-8311-63c230fae5a3`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:18:30,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:18:30,417::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3f22cdc8-6f4e-435f-a395-511f6b726e18`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:18:30,417::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:18:30,418::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:18:30,418::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3f22cdc8-6f4e-435f-a395-511f6b726e18`::Granted request >Thread-7083::DEBUG::2014-07-08 17:18:30,419::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e380d95a-763a-44ff-8311-63c230fae5a3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:18:30,419::task::993::Storage.TaskManager.Task::(_decref) Task=`e380d95a-763a-44ff-8311-63c230fae5a3`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:18:30,438::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:18:30,438::task::1191::Storage.TaskManager.Task::(prepare) Task=`e380d95a-763a-44ff-8311-63c230fae5a3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:18:30,439::task::595::Storage.TaskManager.Task::(_updateState) Task=`e380d95a-763a-44ff-8311-63c230fae5a3`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:18:30,439::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:18:30,439::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:18:30,440::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:18:30,440::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:18:30,440::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:18:30,440::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:18:30,441::task::993::Storage.TaskManager.Task::(_decref) Task=`e380d95a-763a-44ff-8311-63c230fae5a3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:18:30,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:18:30,948::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:30,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:30,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:30,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:30,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:30,950::__init__::225::IOProcess::(_processLogs) (274584) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:18:30,950::__init__::225::IOProcess::(_processLogs) (274584) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:30,957::__init__::225::IOProcess::(_processLogs) (274584) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:30,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-37::DEBUG::2014-07-08 17:18:30,988::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:18:31,155::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000650345 s, 710 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:18:31,160::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-18::DEBUG::2014-07-08 17:18:31,175::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:31,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:31,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:31,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:31,201::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:31,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:31,211::__init__::225::IOProcess::(_processLogs) (274585) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:18:31,217::__init__::225::IOProcess::(_processLogs) (274585) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:31,223::__init__::225::IOProcess::(_processLogs) (274585) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:31,229::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:31,236::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:18:31,379::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:18:31,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Dummy-6860::DEBUG::2014-07-08 17:18:31,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.408521 s, 2.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:18:31,553::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:31,557::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:31,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:31,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:31,570::__init__::225::IOProcess::(_processLogs) (274586) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:31,573::__init__::225::IOProcess::(_processLogs) (274586) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:31,579::__init__::225::IOProcess::(_processLogs) (274586) Building response >Thread-18::DEBUG::2014-07-08 17:18:31,582::__init__::225::IOProcess::(_processLogs) (274586) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:31,585::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:31,588::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:31,600::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:18:31,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:31,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:31,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:31,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:31,616::__init__::225::IOProcess::(_processLogs) (274587) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:31,619::__init__::225::IOProcess::(_processLogs) (274587) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:31,621::__init__::225::IOProcess::(_processLogs) (274587) Building response >Thread-18::DEBUG::2014-07-08 17:18:31,626::__init__::225::IOProcess::(_processLogs) (274587) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:31,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:31,633::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:31,645::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:18:31,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:31,652::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:31,656::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:31,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:31,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:31,664::__init__::225::IOProcess::(_processLogs) (274588) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:31,668::__init__::225::IOProcess::(_processLogs) (274588) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:31,671::__init__::225::IOProcess::(_processLogs) (274588) Building response >Thread-18::DEBUG::2014-07-08 17:18:31,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:31,678::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:18:33,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:34,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177225 s, 57.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:34,338::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:34,340::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:34,341::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:36,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:36,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178683 s, 57.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:18:38,312::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:18:38,313::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:18:38,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:38,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172275 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:39,348::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:39,349::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:39,350::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:18:40,456::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6b1df169] >Thread-7087::DEBUG::2014-07-08 17:18:40,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d0401ed-879d-4d67-8c30-21f70016ac39`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:18:40,457::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:18:40,473::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:40,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d0401ed-879d-4d67-8c30-21f70016ac39`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:40,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d0401ed-879d-4d67-8c30-21f70016ac39`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:18:40,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:18:40,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:18:40,475::task::993::Storage.TaskManager.Task::(_decref) Task=`1d0401ed-879d-4d67-8c30-21f70016ac39`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:18:40,490::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6b1df169] >Thread-7083::DEBUG::2014-07-08 17:18:40,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4d54024-424a-4f1d-8008-335f8d0a1a80`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:18:40,491::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:18:40,492::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8b0c5ab0-fc07-468a-85a3-1beeb2958e54`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:18:40,492::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:18:40,493::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:18:40,493::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8b0c5ab0-fc07-468a-85a3-1beeb2958e54`::Granted request >Thread-7083::DEBUG::2014-07-08 17:18:40,493::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d4d54024-424a-4f1d-8008-335f8d0a1a80`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:18:40,494::task::993::Storage.TaskManager.Task::(_decref) Task=`d4d54024-424a-4f1d-8008-335f8d0a1a80`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:18:40,513::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:18:40,513::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4d54024-424a-4f1d-8008-335f8d0a1a80`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:18:40,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4d54024-424a-4f1d-8008-335f8d0a1a80`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:18:40,514::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:18:40,514::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:18:40,514::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:18:40,515::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:18:40,515::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:18:40,515::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:18:40,516::task::993::Storage.TaskManager.Task::(_decref) Task=`d4d54024-424a-4f1d-8008-335f8d0a1a80`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:18:40,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:40,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171565 s, 59.7 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:18:41,572::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa7db0b0-3fb7-48d5-949d-4b86044c11be`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:18:41,573::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:18:41,573::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650345', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:18:41,573::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa7db0b0-3fb7-48d5-949d-4b86044c11be`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650345', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:18:41,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa7db0b0-3fb7-48d5-949d-4b86044c11be`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:18:41,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:18:41,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:18:41,574::task::993::Storage.TaskManager.Task::(_decref) Task=`aa7db0b0-3fb7-48d5-949d-4b86044c11be`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:18:41,605::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:18:41,688::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:41,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:41,689::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:41,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:41,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:41,690::__init__::225::IOProcess::(_processLogs) (274589) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:18:41,690::__init__::225::IOProcess::(_processLogs) (274589) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:41,690::__init__::225::IOProcess::(_processLogs) (274589) Building response >Thread-18::DEBUG::2014-07-08 17:18:41,691::__init__::225::IOProcess::(_processLogs) (274589) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:41,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:41,691::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:18:41,693::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:18:41,840::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000449767 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:18:41,842::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:41,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:41,843::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:41,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:41,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:41,844::__init__::225::IOProcess::(_processLogs) (274590) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:18:41,844::__init__::225::IOProcess::(_processLogs) (274590) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:41,844::__init__::225::IOProcess::(_processLogs) (274590) Building response >Thread-18::DEBUG::2014-07-08 17:18:41,845::__init__::225::IOProcess::(_processLogs) (274590) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:41,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:41,845::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:18:41,847::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:18:41,847::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:41,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:41,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:41,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:41,849::__init__::225::IOProcess::(_processLogs) (274591) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:41,849::__init__::225::IOProcess::(_processLogs) (274591) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:41,849::__init__::225::IOProcess::(_processLogs) (274591) Building response >Thread-18::DEBUG::2014-07-08 17:18:41,849::__init__::225::IOProcess::(_processLogs) (274591) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:41,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:41,850::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:41,851::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:18:41,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:41,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:41,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:41,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:41,852::__init__::225::IOProcess::(_processLogs) (274592) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:41,852::__init__::225::IOProcess::(_processLogs) (274592) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:41,853::__init__::225::IOProcess::(_processLogs) (274592) Building response >Thread-18::DEBUG::2014-07-08 17:18:41,853::__init__::225::IOProcess::(_processLogs) (274592) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:41,853::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:41,853::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:41,854::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:18:41,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:41,855::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:41,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:41,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:41,856::__init__::225::IOProcess::(_processLogs) (274593) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:41,856::__init__::225::IOProcess::(_processLogs) (274593) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:41,856::__init__::225::IOProcess::(_processLogs) (274593) Building response >Thread-18::DEBUG::2014-07-08 17:18:41,856::__init__::225::IOProcess::(_processLogs) (274593) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:41,857::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:41,857::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:18:42,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:43,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172526 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:44,359::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:44,361::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:44,362::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:45,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:45,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174828 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:18:47,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:47,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.128175 s, 8.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:49,369::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:49,371::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:49,372::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:49,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:50,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0190941 s, 53.6 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:18:50,530::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:18:50,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7c7a6e9-8238-4b93-a766-6e0dd33a7f2d`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:18:50,531::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:18:50,560::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:50,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7c7a6e9-8238-4b93-a766-6e0dd33a7f2d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:18:50,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7c7a6e9-8238-4b93-a766-6e0dd33a7f2d`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:18:50,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:18:50,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:18:50,561::task::993::Storage.TaskManager.Task::(_decref) Task=`b7c7a6e9-8238-4b93-a766-6e0dd33a7f2d`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:18:50,573::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:18:50,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8b1b30f-a1c6-4e78-a68f-5e4082cf762d`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:18:50,574::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:18:50,575::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1c03e88d-45f9-4f1a-82d4-614899b80b6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:18:50,575::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:18:50,580::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:18:50,580::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1c03e88d-45f9-4f1a-82d4-614899b80b6f`::Granted request >Thread-7083::DEBUG::2014-07-08 17:18:50,581::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f8b1b30f-a1c6-4e78-a68f-5e4082cf762d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:18:50,581::task::993::Storage.TaskManager.Task::(_decref) Task=`f8b1b30f-a1c6-4e78-a68f-5e4082cf762d`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:18:50,601::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:18:50,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8b1b30f-a1c6-4e78-a68f-5e4082cf762d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:18:50,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8b1b30f-a1c6-4e78-a68f-5e4082cf762d`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:18:50,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:18:50,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:18:50,603::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:18:50,603::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:18:50,603::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:18:50,603::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:18:50,604::task::993::Storage.TaskManager.Task::(_decref) Task=`f8b1b30f-a1c6-4e78-a68f-5e4082cf762d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:18:51,859::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:51,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:51,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:51,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:51,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:51,861::__init__::225::IOProcess::(_processLogs) (274594) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:18:51,861::__init__::225::IOProcess::(_processLogs) (274594) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:51,861::__init__::225::IOProcess::(_processLogs) (274594) Building response >Thread-18::DEBUG::2014-07-08 17:18:51,862::__init__::225::IOProcess::(_processLogs) (274594) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:51,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:51,862::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:18:51,864::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:18:52,018::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000481892 s, 959 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:18:52,022::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:18:52,022::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:52,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:52,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:52,024::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:52,024::__init__::225::IOProcess::(_processLogs) (274595) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:18:52,024::__init__::225::IOProcess::(_processLogs) (274595) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:18:52,025::__init__::225::IOProcess::(_processLogs) (274595) Building response >Thread-18::DEBUG::2014-07-08 17:18:52,025::__init__::225::IOProcess::(_processLogs) (274595) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:52,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:52,026::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:18:52,030::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:18:52,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:52,031::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:18:52,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:52,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:52,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:52,033::__init__::225::IOProcess::(_processLogs) (274596) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:52,033::__init__::225::IOProcess::(_processLogs) (274596) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:52,033::__init__::225::IOProcess::(_processLogs) (274596) Building response >Thread-18::DEBUG::2014-07-08 17:18:52,034::__init__::225::IOProcess::(_processLogs) (274596) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:52,034::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:52,035::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:52,037::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:18:52,038::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:52,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:52,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:52,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:52,039::__init__::225::IOProcess::(_processLogs) (274597) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:52,040::__init__::225::IOProcess::(_processLogs) (274597) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:52,040::__init__::225::IOProcess::(_processLogs) (274597) Building response >Thread-18::DEBUG::2014-07-08 17:18:52,040::__init__::225::IOProcess::(_processLogs) (274597) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:52,041::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:52,041::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:18:52,052::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:18:52,053::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:18:52,053::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:18:52,053::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:18:52,053::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:18:52,054::__init__::225::IOProcess::(_processLogs) (274598) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:18:52,054::__init__::225::IOProcess::(_processLogs) (274598) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:18:52,054::__init__::225::IOProcess::(_processLogs) (274598) Building response >Thread-18::DEBUG::2014-07-08 17:18:52,054::__init__::225::IOProcess::(_processLogs) (274598) Queuing response >Thread-18::DEBUG::2014-07-08 17:18:52,055::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:18:52,055::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:18:52,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:52,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181284 s, 56.5 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:18:53,386::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:18:53,387::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:54,378::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:54,379::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:54,381::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:54,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:54,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0187058 s, 54.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:18:56,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:56,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185932 s, 55.1 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:18:56,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`320b99c9-ed61-4c4f-a3f7-0748d17c4dcc`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:18:56,958::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:18:56,960::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481892', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:18:56,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`320b99c9-ed61-4c4f-a3f7-0748d17c4dcc`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481892', 'lastCheck': '4.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:18:56,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`320b99c9-ed61-4c4f-a3f7-0748d17c4dcc`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:18:56,962::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:18:56,963::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:18:56,964::task::993::Storage.TaskManager.Task::(_decref) Task=`320b99c9-ed61-4c4f-a3f7-0748d17c4dcc`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:18:57,012::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:18:59,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:18:59,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172635 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:59,388::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:59,389::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:18:59,390::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:19:00,639::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:19:00,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`adba09e1-8bbb-4f7e-924b-e739662bdeab`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:00,641::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:19:00,656::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:00,656::task::1191::Storage.TaskManager.Task::(prepare) Task=`adba09e1-8bbb-4f7e-924b-e739662bdeab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:00,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`adba09e1-8bbb-4f7e-924b-e739662bdeab`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:00,657::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:00,657::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:00,658::task::993::Storage.TaskManager.Task::(_decref) Task=`adba09e1-8bbb-4f7e-924b-e739662bdeab`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:19:00,669::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:19:00,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e1885f3-c9e9-4481-ad73-72a716335fb6`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:19:00,670::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:19:00,671::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f13bda62-e985-430a-8a2f-fad47466585e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:19:00,671::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:19:00,672::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:19:00,672::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f13bda62-e985-430a-8a2f-fad47466585e`::Granted request >Thread-7083::DEBUG::2014-07-08 17:19:00,673::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2e1885f3-c9e9-4481-ad73-72a716335fb6`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:19:00,673::task::993::Storage.TaskManager.Task::(_decref) Task=`2e1885f3-c9e9-4481-ad73-72a716335fb6`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:19:00,692::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:00,692::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e1885f3-c9e9-4481-ad73-72a716335fb6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:00,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e1885f3-c9e9-4481-ad73-72a716335fb6`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:19:00,693::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:19:00,693::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:19:00,694::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:19:00,694::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:19:00,694::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:19:00,694::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:19:00,695::task::993::Storage.TaskManager.Task::(_decref) Task=`2e1885f3-c9e9-4481-ad73-72a716335fb6`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:19:01,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-07-08 17:19:01,443::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:19:01,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205694 s, 49.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:19:02,059::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:02,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:02,060::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:02,060::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:02,060::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:02,060::__init__::225::IOProcess::(_processLogs) (274599) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:02,061::__init__::225::IOProcess::(_processLogs) (274599) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:02,061::__init__::225::IOProcess::(_processLogs) (274599) Building response >Thread-18::DEBUG::2014-07-08 17:19:02,061::__init__::225::IOProcess::(_processLogs) (274599) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:02,061::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:02,062::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:19:02,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:19:02,221::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000438872 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:19:02,230::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:02,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:02,235::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:02,238::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:02,240::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:02,243::__init__::225::IOProcess::(_processLogs) (274600) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:02,256::__init__::225::IOProcess::(_processLogs) (274600) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:02,260::__init__::225::IOProcess::(_processLogs) (274600) Building response >Thread-18::DEBUG::2014-07-08 17:19:02,264::__init__::225::IOProcess::(_processLogs) (274600) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:02,267::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:02,270::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:19:02,291::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:19:02,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:02,297::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:02,300::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:02,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:02,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:02,310::__init__::225::IOProcess::(_processLogs) (274601) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:02,311::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:02,313::__init__::225::IOProcess::(_processLogs) (274601) Building response >Thread-18::DEBUG::2014-07-08 17:19:02,314::__init__::225::IOProcess::(_processLogs) (274601) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:02,316::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:02,317::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:02,321::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:02,321::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:19:02,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:02,322::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:02,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:02,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:02,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:02,324::__init__::225::IOProcess::(_processLogs) (274602) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:02,324::__init__::225::IOProcess::(_processLogs) (274602) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:02,325::__init__::225::IOProcess::(_processLogs) (274602) Building response >Thread-18::DEBUG::2014-07-08 17:19:02,326::__init__::225::IOProcess::(_processLogs) (274602) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:02,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:02,329::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:02,333::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:02,334::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:19:02,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:02,337::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:02,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:02,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:02,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:02,343::__init__::225::IOProcess::(_processLogs) (274603) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:02,344::__init__::225::IOProcess::(_processLogs) (274603) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:02,345::__init__::225::IOProcess::(_processLogs) (274603) Building response >Thread-18::DEBUG::2014-07-08 17:19:02,346::__init__::225::IOProcess::(_processLogs) (274603) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:02,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:02,350::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:19:03,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:03,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0922966 s, 11.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:04,393::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:04,394::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:04,395::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:05,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:06,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0221176 s, 46.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:19:08,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:08,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322033 s, 31.8 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:19:08,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`fdaa1c0c-ecd4-45e7-8e62-5a94269d6c93`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:19:08,494::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:19:08,498::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:08,499::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:19:08,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:08,502::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:08,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:08,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:08,505::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:08,506::__init__::225::IOProcess::(_processLogs) (274604) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:19:08,507::__init__::225::IOProcess::(_processLogs) (274604) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:19:08,508::__init__::225::IOProcess::(_processLogs) (274604) Building response >Thread-18::DEBUG::2014-07-08 17:19:08,509::__init__::225::IOProcess::(_processLogs) (274604) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:08,510::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:08,511::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:19:08,517::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:08,518::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:19:08,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:08,520::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:08,522::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:08,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:08,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:08,524::__init__::225::IOProcess::(_processLogs) (274605) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:19:08,525::__init__::225::IOProcess::(_processLogs) (274605) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:19:08,526::__init__::225::IOProcess::(_processLogs) (274605) Building response >Thread-18::DEBUG::2014-07-08 17:19:08,527::__init__::225::IOProcess::(_processLogs) (274605) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:08,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:08,529::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:19:08,533::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:19:08,534::task::1191::Storage.TaskManager.Task::(prepare) Task=`fdaa1c0c-ecd4-45e7-8e62-5a94269d6c93`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:19:08,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`fdaa1c0c-ecd4-45e7-8e62-5a94269d6c93`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:19:08,536::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:19:08,536::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:19:08,538::task::993::Storage.TaskManager.Task::(_decref) Task=`fdaa1c0c-ecd4-45e7-8e62-5a94269d6c93`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:19:08,621::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:19:08,621::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:09,403::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:09,404::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:09,406::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:10,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:19:10,726::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:19:10,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5fc0827-85c8-4699-ad3c-734a39cc8479`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:10,730::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:19:10,813::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 17:19:10,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333685 s, 30.7 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:19:10,815::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5fc0827-85c8-4699-ad3c-734a39cc8479`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:10,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5fc0827-85c8-4699-ad3c-734a39cc8479`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:10,817::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:10,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:10,818::task::993::Storage.TaskManager.Task::(_decref) Task=`c5fc0827-85c8-4699-ad3c-734a39cc8479`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:19:10,834::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:19:10,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce1de88b-4544-49a8-ac72-1745cf5c274c`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:19:10,838::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:19:10,841::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`aba93f09-0a79-4d4f-b67f-214460ef5b44`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:19:10,842::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:19:10,844::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:19:10,845::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`aba93f09-0a79-4d4f-b67f-214460ef5b44`::Granted request >Thread-7083::DEBUG::2014-07-08 17:19:10,847::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce1de88b-4544-49a8-ac72-1745cf5c274c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:19:10,848::task::993::Storage.TaskManager.Task::(_decref) Task=`ce1de88b-4544-49a8-ac72-1745cf5c274c`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:19:10,877::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:10,878::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce1de88b-4544-49a8-ac72-1745cf5c274c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:10,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce1de88b-4544-49a8-ac72-1745cf5c274c`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:19:10,878::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:19:10,878::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:19:10,879::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:19:10,879::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:19:10,880::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:19:10,880::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:19:10,880::task::993::Storage.TaskManager.Task::(_decref) Task=`ce1de88b-4544-49a8-ac72-1745cf5c274c`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:19:12,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dac0f53-23d4-45cf-b093-6ae5b13ecce7`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:12,260::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:19:12,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438872', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:19:12,260::task::1191::Storage.TaskManager.Task::(prepare) Task=`7dac0f53-23d4-45cf-b093-6ae5b13ecce7`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438872', 'lastCheck': '9.9', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:19:12,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dac0f53-23d4-45cf-b093-6ae5b13ecce7`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:12,261::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:12,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:12,261::task::993::Storage.TaskManager.Task::(_decref) Task=`7dac0f53-23d4-45cf-b093-6ae5b13ecce7`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:19:12,319::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:19:12,355::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:12,355::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:12,355::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:12,355::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:12,356::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:12,356::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:12,356::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:12,356::__init__::225::IOProcess::(_processLogs) (274606) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:12,357::__init__::225::IOProcess::(_processLogs) (274606) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:12,357::__init__::225::IOProcess::(_processLogs) (274606) Building response >Thread-18::DEBUG::2014-07-08 17:19:12,357::__init__::225::IOProcess::(_processLogs) (274606) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:12,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:12,358::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:19:12,359::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:19:12,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000474909 s, 973 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:19:12,529::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:12,534::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:12,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:12,545::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:12,550::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:12,556::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:12,558::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:12,562::__init__::225::IOProcess::(_processLogs) (274607) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:12,567::__init__::225::IOProcess::(_processLogs) (274607) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:12,572::__init__::225::IOProcess::(_processLogs) (274607) Building response >Thread-18::DEBUG::2014-07-08 17:19:12,577::__init__::225::IOProcess::(_processLogs) (274607) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:12,580::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:12,583::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:19:12,609::__init__::225::IOProcess::(_processLogs) (274601) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:12,611::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:19:12,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:12,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:12,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:12,618::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:12,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:12,620::__init__::225::IOProcess::(_processLogs) (274608) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:12,621::__init__::225::IOProcess::(_processLogs) (274608) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:12,623::__init__::225::IOProcess::(_processLogs) (274608) Building response >Thread-18::DEBUG::2014-07-08 17:19:12,624::__init__::225::IOProcess::(_processLogs) (274608) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:12,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:12,627::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:12,632::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:12,634::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:19:12,635::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:12,637::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:12,638::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:12,640::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:12,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:12,647::__init__::225::IOProcess::(_processLogs) (274609) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:12,648::__init__::225::IOProcess::(_processLogs) (274609) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:12,650::__init__::225::IOProcess::(_processLogs) (274609) Building response >Thread-18::DEBUG::2014-07-08 17:19:12,651::__init__::225::IOProcess::(_processLogs) (274609) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:12,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:12,654::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:12,659::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:12,661::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:19:12,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:12,664::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:12,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:12,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:12,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:12,670::__init__::225::IOProcess::(_processLogs) (274610) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:12,671::__init__::225::IOProcess::(_processLogs) (274610) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:12,673::__init__::225::IOProcess::(_processLogs) (274610) Building response >Thread-18::DEBUG::2014-07-08 17:19:12,674::__init__::225::IOProcess::(_processLogs) (274610) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:12,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:12,677::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:19:12,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:13,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173724 s, 58.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:14,417::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:14,419::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:14,420::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:15,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:15,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200856 s, 51.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:19:17,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:17,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173501 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:19,427::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:19,429::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:19,430::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:19,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:20,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0887107 s, 11.5 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:19:20,913::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6b1df169] >Thread-7087::DEBUG::2014-07-08 17:19:20,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`214e5dc5-ade1-4c27-a53b-daf2cc6b815a`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:20,915::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:19:20,930::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:20,931::task::1191::Storage.TaskManager.Task::(prepare) Task=`214e5dc5-ade1-4c27-a53b-daf2cc6b815a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:20,931::task::595::Storage.TaskManager.Task::(_updateState) Task=`214e5dc5-ade1-4c27-a53b-daf2cc6b815a`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:20,931::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:20,931::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:20,932::task::993::Storage.TaskManager.Task::(_decref) Task=`214e5dc5-ade1-4c27-a53b-daf2cc6b815a`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:19:20,943::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6b1df169] >Thread-7083::DEBUG::2014-07-08 17:19:20,944::task::595::Storage.TaskManager.Task::(_updateState) Task=`683a950a-bcbf-4964-9f55-cdffb2d57446`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:19:20,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:19:20,945::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fe57b892-0357-4422-b926-11232e3e93db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:19:20,945::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:19:20,946::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:19:20,946::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fe57b892-0357-4422-b926-11232e3e93db`::Granted request >Thread-7083::DEBUG::2014-07-08 17:19:20,947::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`683a950a-bcbf-4964-9f55-cdffb2d57446`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:19:20,947::task::993::Storage.TaskManager.Task::(_decref) Task=`683a950a-bcbf-4964-9f55-cdffb2d57446`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:19:20,966::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:20,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`683a950a-bcbf-4964-9f55-cdffb2d57446`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:20,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`683a950a-bcbf-4964-9f55-cdffb2d57446`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:19:20,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:19:20,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:19:20,967::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:19:20,967::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:19:20,968::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:19:20,968::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:19:20,968::task::993::Storage.TaskManager.Task::(_decref) Task=`683a950a-bcbf-4964-9f55-cdffb2d57446`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:19:22,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:22,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182387 s, 56.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:19:22,684::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:22,684::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:22,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:22,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:22,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:22,686::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:22,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:22,687::__init__::225::IOProcess::(_processLogs) (274611) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:22,687::__init__::225::IOProcess::(_processLogs) (274611) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:22,687::__init__::225::IOProcess::(_processLogs) (274611) Building response >Thread-18::DEBUG::2014-07-08 17:19:22,687::__init__::225::IOProcess::(_processLogs) (274611) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:22,688::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:22,688::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:19:22,689::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:19:22,844::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0005048 s, 915 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:19:22,850::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:22,852::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:22,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:22,857::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:22,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:22,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:22,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:22,865::__init__::225::IOProcess::(_processLogs) (274612) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:22,867::__init__::225::IOProcess::(_processLogs) (274612) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:22,869::__init__::225::IOProcess::(_processLogs) (274612) Building response >Thread-18::DEBUG::2014-07-08 17:19:22,871::__init__::225::IOProcess::(_processLogs) (274612) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:22,872::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:22,875::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:19:22,887::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:22,890::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:19:22,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:22,897::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:22,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:22,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:22,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:22,907::__init__::225::IOProcess::(_processLogs) (274613) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:22,910::__init__::225::IOProcess::(_processLogs) (274613) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:22,913::__init__::225::IOProcess::(_processLogs) (274613) Building response >Thread-18::DEBUG::2014-07-08 17:19:22,916::__init__::225::IOProcess::(_processLogs) (274613) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:22,922::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:22,936::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:22,939::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:22,939::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:19:22,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:22,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:22,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:22,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:22,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:22,942::__init__::225::IOProcess::(_processLogs) (274614) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:22,942::__init__::225::IOProcess::(_processLogs) (274614) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:22,942::__init__::225::IOProcess::(_processLogs) (274614) Building response >Thread-18::DEBUG::2014-07-08 17:19:22,943::__init__::225::IOProcess::(_processLogs) (274614) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:22,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:22,957::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:22,961::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:22,962::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:19:22,963::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:22,964::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:22,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:22,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:22,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:22,970::__init__::225::IOProcess::(_processLogs) (274615) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:22,971::__init__::225::IOProcess::(_processLogs) (274615) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:22,972::__init__::225::IOProcess::(_processLogs) (274615) Building response >Thread-18::DEBUG::2014-07-08 17:19:22,973::__init__::225::IOProcess::(_processLogs) (274615) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:22,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:22,976::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:19:23,868::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:19:23,868::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:19:24,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:24,518::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:24,520::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:24,521::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:24,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174739 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:19:26,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:26,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174079 s, 58.8 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:19:27,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b6281c6-f0f5-4703-8d3f-9773304094a5`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:27,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:19:27,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005048', 'lastCheck': '4.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:19:27,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b6281c6-f0f5-4703-8d3f-9773304094a5`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005048', 'lastCheck': '4.6', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:19:27,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b6281c6-f0f5-4703-8d3f-9773304094a5`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:27,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:27,623::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:27,623::task::993::Storage.TaskManager.Task::(_decref) Task=`9b6281c6-f0f5-4703-8d3f-9773304094a5`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:19:27,653::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:28,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:29,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0219059 s, 46.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:29,528::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:29,530::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:29,531::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7087::DEBUG::2014-07-08 17:19:30,982::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:19:30,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`68096947-14e6-40b8-8968-dd704c8ee858`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:30,983::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:19:30,998::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:30,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`68096947-14e6-40b8-8968-dd704c8ee858`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:30,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`68096947-14e6-40b8-8968-dd704c8ee858`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:30,999::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:31,000::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:31,000::task::993::Storage.TaskManager.Task::(_decref) Task=`68096947-14e6-40b8-8968-dd704c8ee858`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:19:31,013::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:19:31,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d60ebce-9dc2-41b0-a98e-e02581602c20`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:19:31,015::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:19:31,016::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b62eaff0-d181-482b-960e-bf9058dcde50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:19:31,016::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:19:31,017::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:19:31,017::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`b62eaff0-d181-482b-960e-bf9058dcde50`::Granted request >Thread-7083::DEBUG::2014-07-08 17:19:31,018::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3d60ebce-9dc2-41b0-a98e-e02581602c20`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:19:31,018::task::993::Storage.TaskManager.Task::(_decref) Task=`3d60ebce-9dc2-41b0-a98e-e02581602c20`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:19:31,037::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:31,037::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d60ebce-9dc2-41b0-a98e-e02581602c20`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:31,038::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d60ebce-9dc2-41b0-a98e-e02581602c20`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:19:31,038::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:19:31,038::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:19:31,039::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:19:31,039::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:19:31,039::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:19:31,039::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:19:31,040::task::993::Storage.TaskManager.Task::(_decref) Task=`3d60ebce-9dc2-41b0-a98e-e02581602c20`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:19:31,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:31,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017321 s, 59.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:19:31,609::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-18::DEBUG::2014-07-08 17:19:32,982::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:19:32,982::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:32,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:32,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:32,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:32,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:32,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:32,984::__init__::225::IOProcess::(_processLogs) (274616) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:32,984::__init__::225::IOProcess::(_processLogs) (274616) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:32,984::__init__::225::IOProcess::(_processLogs) (274616) Building response >Thread-18::DEBUG::2014-07-08 17:19:32,985::__init__::225::IOProcess::(_processLogs) (274616) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:32,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:32,985::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:19:32,987::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:19:33,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000572963 s, 806 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:19:33,150::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:33,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:33,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:33,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:33,165::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:33,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:33,172::__init__::225::IOProcess::(_processLogs) (274617) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:33,176::__init__::225::IOProcess::(_processLogs) (274617) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:33,181::__init__::225::IOProcess::(_processLogs) (274617) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:33,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:33,189::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:19:33,209::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:19:33,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:33,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:33,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:33,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:33,227::__init__::225::IOProcess::(_processLogs) (274618) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:33,230::__init__::225::IOProcess::(_processLogs) (274618) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:33,231::__init__::225::IOProcess::(_processLogs) (274618) Building response >Thread-18::DEBUG::2014-07-08 17:19:33,233::__init__::225::IOProcess::(_processLogs) (274618) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:33,235::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:33,236::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:33,243::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:19:33,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:33,247::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:33,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:33,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:33,252::__init__::225::IOProcess::(_processLogs) (274619) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:33,253::__init__::225::IOProcess::(_processLogs) (274619) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:33,254::__init__::225::IOProcess::(_processLogs) (274619) Building response >Thread-18::DEBUG::2014-07-08 17:19:33,256::__init__::225::IOProcess::(_processLogs) (274619) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:33,258::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:33,259::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:33,266::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:19:33,267::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:33,269::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:33,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:33,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:33,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:33,275::__init__::225::IOProcess::(_processLogs) (274620) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:33,277::__init__::225::IOProcess::(_processLogs) (274620) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:33,279::__init__::225::IOProcess::(_processLogs) (274620) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:33,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:33,281::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:19:33,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:33,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174264 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:34,534::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:34,536::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:34,537::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:35,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:36,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.122423 s, 8.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:19:38,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:38,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170853 s, 59.9 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:19:38,900::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:19:38,900::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:39,544::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:39,545::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:39,546::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:40,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:40,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171987 s, 59.5 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:19:41,075::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:19:41,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0dd725c-afa0-4deb-b759-9870c76b01d0`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:41,077::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:19:41,093::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:41,093::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0dd725c-afa0-4deb-b759-9870c76b01d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:41,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0dd725c-afa0-4deb-b759-9870c76b01d0`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:41,094::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:41,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:41,094::task::993::Storage.TaskManager.Task::(_decref) Task=`e0dd725c-afa0-4deb-b759-9870c76b01d0`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:19:41,110::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:19:41,111::task::595::Storage.TaskManager.Task::(_updateState) Task=`7be4914a-dbc0-4ae2-afaf-2b52416dfcfb`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:19:41,111::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:19:41,112::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fc3acfbc-2faa-4497-b342-ac72b4cb0c28`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:19:41,112::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:19:41,113::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:19:41,113::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`fc3acfbc-2faa-4497-b342-ac72b4cb0c28`::Granted request >Thread-7083::DEBUG::2014-07-08 17:19:41,118::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7be4914a-dbc0-4ae2-afaf-2b52416dfcfb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:19:41,118::task::993::Storage.TaskManager.Task::(_decref) Task=`7be4914a-dbc0-4ae2-afaf-2b52416dfcfb`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:19:41,138::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:41,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`7be4914a-dbc0-4ae2-afaf-2b52416dfcfb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:41,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`7be4914a-dbc0-4ae2-afaf-2b52416dfcfb`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:19:41,139::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:19:41,139::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:19:41,139::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:19:41,140::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:19:41,140::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:19:41,140::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:19:41,141::task::993::Storage.TaskManager.Task::(_decref) Task=`7be4914a-dbc0-4ae2-afaf-2b52416dfcfb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:19:42,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7087::DEBUG::2014-07-08 17:19:42,823::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffdcde94-121b-4003-a7e1-f56e88d3bd34`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:42,823::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:19:42,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572963', 'lastCheck': '9.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:19:42,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffdcde94-121b-4003-a7e1-f56e88d3bd34`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572963', 'lastCheck': '9.5', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:19:42,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffdcde94-121b-4003-a7e1-f56e88d3bd34`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:42,825::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:42,825::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:42,825::task::993::Storage.TaskManager.Task::(_decref) Task=`ffdcde94-121b-4003-a7e1-f56e88d3bd34`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:19:42,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032783 s, 31.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:19:42,923::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:19:43,288::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:43,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:43,289::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:43,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:43,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:43,289::__init__::225::IOProcess::(_processLogs) (274621) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:43,290::__init__::225::IOProcess::(_processLogs) (274621) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:43,290::__init__::225::IOProcess::(_processLogs) (274621) Building response >Thread-18::DEBUG::2014-07-08 17:19:43,290::__init__::225::IOProcess::(_processLogs) (274621) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:43,290::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:43,291::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:19:43,292::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:19:43,447::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000457309 s, 1.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:19:43,460::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:43,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:43,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:43,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:43,480::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:43,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:43,489::__init__::225::IOProcess::(_processLogs) (274622) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:43,494::__init__::225::IOProcess::(_processLogs) (274622) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:43,498::__init__::225::IOProcess::(_processLogs) (274622) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:43,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:43,508::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:19:43,536::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:19:43,538::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:43,540::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:43,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:43,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:43,544::__init__::225::IOProcess::(_processLogs) (274623) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:43,546::__init__::225::IOProcess::(_processLogs) (274623) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:43,547::__init__::225::IOProcess::(_processLogs) (274623) Building response >Thread-18::DEBUG::2014-07-08 17:19:43,548::__init__::225::IOProcess::(_processLogs) (274623) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:43,550::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:43,551::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:43,556::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:19:43,558::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:43,559::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:43,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:43,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:43,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:43,564::__init__::225::IOProcess::(_processLogs) (274624) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:43,566::__init__::225::IOProcess::(_processLogs) (274624) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:43,567::__init__::225::IOProcess::(_processLogs) (274624) Building response >Thread-18::DEBUG::2014-07-08 17:19:43,569::__init__::225::IOProcess::(_processLogs) (274624) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:43,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:43,571::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:43,576::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:19:43,577::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:43,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:43,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:43,582::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:43,583::__init__::225::IOProcess::(_processLogs) (274625) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:43,584::__init__::225::IOProcess::(_processLogs) (274625) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:43,586::__init__::225::IOProcess::(_processLogs) (274625) Building response >Thread-18::DEBUG::2014-07-08 17:19:43,587::__init__::225::IOProcess::(_processLogs) (274625) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:43,588::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:43,590::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:44,554::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:44,555::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:44,556::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:44,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:45,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180868 s, 56.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:19:47,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:47,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175311 s, 58.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:19:49,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:49,636::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:49,646::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:49,658::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:49,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0562513 s, 18.2 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:19:51,161::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:19:51,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6d93e92-7fc1-47b0-b8f4-7c226cf650d3`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:51,163::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7087::INFO::2014-07-08 17:19:51,177::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:51,178::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6d93e92-7fc1-47b0-b8f4-7c226cf650d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:19:51,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6d93e92-7fc1-47b0-b8f4-7c226cf650d3`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:51,178::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:51,179::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:51,179::task::993::Storage.TaskManager.Task::(_decref) Task=`e6d93e92-7fc1-47b0-b8f4-7c226cf650d3`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:19:51,201::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:19:51,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`46988106-5b08-4534-98af-837c4e404c15`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:19:51,202::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:19:51,203::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a9b49425-d53a-4264-8b5c-47218c97cc40`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:19:51,204::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:19:51,204::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:19:51,204::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a9b49425-d53a-4264-8b5c-47218c97cc40`::Granted request >Thread-7083::DEBUG::2014-07-08 17:19:51,205::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`46988106-5b08-4534-98af-837c4e404c15`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:19:51,205::task::993::Storage.TaskManager.Task::(_decref) Task=`46988106-5b08-4534-98af-837c4e404c15`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:19:51,224::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:51,225::task::1191::Storage.TaskManager.Task::(prepare) Task=`46988106-5b08-4534-98af-837c4e404c15`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:19:51,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`46988106-5b08-4534-98af-837c4e404c15`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:19:51,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:19:51,225::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:19:51,226::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:19:51,226::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:19:51,226::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:19:51,226::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:19:51,227::task::993::Storage.TaskManager.Task::(_decref) Task=`46988106-5b08-4534-98af-837c4e404c15`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:19:51,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:52,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10548 s, 9.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:19:53,596::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:53,596::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:53,596::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:53,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:53,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:53,597::__init__::225::IOProcess::(_processLogs) (274626) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:53,597::__init__::225::IOProcess::(_processLogs) (274626) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:53,598::__init__::225::IOProcess::(_processLogs) (274626) Building response >Thread-18::DEBUG::2014-07-08 17:19:53,598::__init__::225::IOProcess::(_processLogs) (274626) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:53,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:53,598::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:19:53,600::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:19:53,752::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00047435 s, 974 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:19:53,758::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:19:53,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:53,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:53,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:53,764::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:53,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:53,767::__init__::225::IOProcess::(_processLogs) (274627) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:19:53,768::__init__::225::IOProcess::(_processLogs) (274627) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:19:53,769::__init__::225::IOProcess::(_processLogs) (274627) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:53,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:53,772::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:19:53,781::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:19:53,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:53,792::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:53,796::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:53,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:53,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:53,810::__init__::225::IOProcess::(_processLogs) (274628) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:53,814::__init__::225::IOProcess::(_processLogs) (274628) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:53,818::__init__::225::IOProcess::(_processLogs) (274628) Building response >Thread-18::DEBUG::2014-07-08 17:19:53,822::__init__::225::IOProcess::(_processLogs) (274628) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:53,826::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:53,830::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:53,846::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:19:53,850::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:53,853::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:53,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:53,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:19:53,866::__init__::225::IOProcess::(_processLogs) (274629) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:53,869::__init__::225::IOProcess::(_processLogs) (274629) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:53,873::__init__::225::IOProcess::(_processLogs) (274629) Building response >Thread-18::DEBUG::2014-07-08 17:19:53,875::__init__::225::IOProcess::(_processLogs) (274629) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:53,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:53,877::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:19:53,883::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:19:53,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:19:53,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:19:53,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:19:53,887::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:19:53,889::__init__::225::IOProcess::(_processLogs) (274630) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:19:53,890::__init__::225::IOProcess::(_processLogs) (274630) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:19:53,892::__init__::225::IOProcess::(_processLogs) (274630) Building response >Thread-18::DEBUG::2014-07-08 17:19:53,893::__init__::225::IOProcess::(_processLogs) (274630) Queuing response >Thread-18::DEBUG::2014-07-08 17:19:53,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:19:53,895::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:19:53,950::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:19:53,951::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:19:54,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:54,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017399 s, 58.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:54,674::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:54,675::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:54,677::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:56,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:56,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017211 s, 59.5 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:19:58,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0c155dd-95a4-4678-a660-8b267777bf9a`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:19:58,074::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:19:58,075::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047435', 'lastCheck': '4.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:19:58,075::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0c155dd-95a4-4678-a660-8b267777bf9a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047435', 'lastCheck': '4.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:19:58,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0c155dd-95a4-4678-a660-8b267777bf9a`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:19:58,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:19:58,076::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:19:58,076::task::993::Storage.TaskManager.Task::(_decref) Task=`b0c155dd-95a4-4678-a660-8b267777bf9a`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:19:58,107::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:19:58,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:19:59,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017342 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:59,680::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:59,681::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:19:59,682::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:01,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:20:01,251::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6b1df169] >Thread-7082::DEBUG::2014-07-08 17:20:01,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d03bd74-7fcc-40cf-97ed-16dffb48e4b1`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:01,259::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:20:01,338::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 17:20:01,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328704 s, 31.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:20:01,340::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d03bd74-7fcc-40cf-97ed-16dffb48e4b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:01,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d03bd74-7fcc-40cf-97ed-16dffb48e4b1`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:01,343::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:01,344::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:01,345::task::993::Storage.TaskManager.Task::(_decref) Task=`2d03bd74-7fcc-40cf-97ed-16dffb48e4b1`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:20:01,363::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] flowID [6b1df169] >Thread-7083::DEBUG::2014-07-08 17:20:01,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`213b3ce2-228d-45c2-b6da-a16fa52baff1`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:20:01,367::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:20:01,371::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`62f471e2-cba7-441f-9e9c-fc8453bd3110`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:20:01,372::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:20:01,374::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:20:01,375::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`62f471e2-cba7-441f-9e9c-fc8453bd3110`::Granted request >Thread-7083::DEBUG::2014-07-08 17:20:01,378::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`213b3ce2-228d-45c2-b6da-a16fa52baff1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:20:01,379::task::993::Storage.TaskManager.Task::(_decref) Task=`213b3ce2-228d-45c2-b6da-a16fa52baff1`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:20:01,414::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:01,415::task::1191::Storage.TaskManager.Task::(prepare) Task=`213b3ce2-228d-45c2-b6da-a16fa52baff1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:01,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`213b3ce2-228d-45c2-b6da-a16fa52baff1`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:20:01,415::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:20:01,416::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:20:01,416::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:20:01,416::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:20:01,417::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:20:01,417::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:20:01,417::task::993::Storage.TaskManager.Task::(_decref) Task=`213b3ce2-228d-45c2-b6da-a16fa52baff1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-08 17:20:01,980::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:20:03,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:03,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175381 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:20:03,902::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:03,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:03,902::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:03,903::__init__::225::IOProcess::(_processLogs) (274631) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:03,904::__init__::225::IOProcess::(_processLogs) (274631) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:03,904::__init__::225::IOProcess::(_processLogs) (274631) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:03,904::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:03,904::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:20:03,906::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:20:04,060::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00051793 s, 892 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:20:04,072::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:04,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:04,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:04,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:04,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:04,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:04,103::__init__::225::IOProcess::(_processLogs) (274632) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:04,107::__init__::225::IOProcess::(_processLogs) (274632) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:04,111::__init__::225::IOProcess::(_processLogs) (274632) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:04,114::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:04,119::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:20:04,141::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:20:04,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:04,155::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:04,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:04,158::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:04,159::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:04,161::__init__::225::IOProcess::(_processLogs) (274633) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:04,163::__init__::225::IOProcess::(_processLogs) (274633) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:04,164::__init__::225::IOProcess::(_processLogs) (274633) Building response >Thread-18::DEBUG::2014-07-08 17:20:04,165::__init__::225::IOProcess::(_processLogs) (274633) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:04,166::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:04,167::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:04,173::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:20:04,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:04,175::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:04,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:04,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:04,179::__init__::225::IOProcess::(_processLogs) (274634) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:04,181::__init__::225::IOProcess::(_processLogs) (274634) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:04,182::__init__::225::IOProcess::(_processLogs) (274634) Building response >Thread-18::DEBUG::2014-07-08 17:20:04,183::__init__::225::IOProcess::(_processLogs) (274634) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:04,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:04,186::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:04,191::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:20:04,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:04,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:04,199::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:04,201::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:04,202::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:04,203::__init__::225::IOProcess::(_processLogs) (274635) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:04,205::__init__::225::IOProcess::(_processLogs) (274635) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:04,207::__init__::225::IOProcess::(_processLogs) (274635) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:04,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:04,209::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:04,689::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:04,690::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:04,691::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:05,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:05,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174585 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:20:07,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:08,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.123012 s, 8.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:20:09,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`33dc98a7-f73e-4311-900b-85600cc45ffc`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:20:09,011::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:20:09,013::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:20:09,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:09,014::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:09,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:09,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:09,014::__init__::225::IOProcess::(_processLogs) (274636) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:20:09,015::__init__::225::IOProcess::(_processLogs) (274636) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:20:09,015::__init__::225::IOProcess::(_processLogs) (274636) Building response >Thread-18::DEBUG::2014-07-08 17:20:09,015::__init__::225::IOProcess::(_processLogs) (274636) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:09,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:09,016::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:20:09,017::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:20:09,018::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:09,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:09,018::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:09,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:09,019::__init__::225::IOProcess::(_processLogs) (274637) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:20:09,019::__init__::225::IOProcess::(_processLogs) (274637) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:20:09,019::__init__::225::IOProcess::(_processLogs) (274637) Building response >Thread-18::DEBUG::2014-07-08 17:20:09,019::__init__::225::IOProcess::(_processLogs) (274637) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:09,020::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:09,020::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:20:09,021::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:20:09,021::task::1191::Storage.TaskManager.Task::(prepare) Task=`33dc98a7-f73e-4311-900b-85600cc45ffc`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:20:09,021::task::595::Storage.TaskManager.Task::(_updateState) Task=`33dc98a7-f73e-4311-900b-85600cc45ffc`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:20:09,022::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:20:09,022::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:20:09,022::task::993::Storage.TaskManager.Task::(_decref) Task=`33dc98a7-f73e-4311-900b-85600cc45ffc`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:20:09,141::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:20:09,142::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:09,698::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:09,700::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:09,701::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:10,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:10,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173926 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:20:11,433::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:20:11,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`340dda54-76f9-44ad-8bf8-2807cc938e73`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:11,435::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:20:11,450::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:11,450::task::1191::Storage.TaskManager.Task::(prepare) Task=`340dda54-76f9-44ad-8bf8-2807cc938e73`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:11,451::task::595::Storage.TaskManager.Task::(_updateState) Task=`340dda54-76f9-44ad-8bf8-2807cc938e73`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:11,451::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:11,451::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:11,451::task::993::Storage.TaskManager.Task::(_decref) Task=`340dda54-76f9-44ad-8bf8-2807cc938e73`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:20:11,463::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:20:11,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`45ece043-3422-4b6b-be9b-ae62b8ae4bf8`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:20:11,464::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:20:11,465::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1589368c-9d42-4510-8319-b86ba6f8c4ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:20:11,465::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:20:11,466::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:20:11,466::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`1589368c-9d42-4510-8319-b86ba6f8c4ec`::Granted request >Thread-7083::DEBUG::2014-07-08 17:20:11,467::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`45ece043-3422-4b6b-be9b-ae62b8ae4bf8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:20:11,467::task::993::Storage.TaskManager.Task::(_decref) Task=`45ece043-3422-4b6b-be9b-ae62b8ae4bf8`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:20:11,486::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:11,487::task::1191::Storage.TaskManager.Task::(prepare) Task=`45ece043-3422-4b6b-be9b-ae62b8ae4bf8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:11,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`45ece043-3422-4b6b-be9b-ae62b8ae4bf8`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:20:11,487::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:20:11,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:20:11,488::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:20:11,488::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:20:11,489::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:20:11,489::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:20:11,489::task::993::Storage.TaskManager.Task::(_decref) Task=`45ece043-3422-4b6b-be9b-ae62b8ae4bf8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:20:12,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:12,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176283 s, 58.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:20:13,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`54800a0c-3573-439b-92cd-589a2ca8003f`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:13,315::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:20:13,316::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051793', 'lastCheck': '9.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:20:13,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`54800a0c-3573-439b-92cd-589a2ca8003f`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051793', 'lastCheck': '9.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:20:13,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`54800a0c-3573-439b-92cd-589a2ca8003f`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:13,317::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:13,317::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:13,317::task::993::Storage.TaskManager.Task::(_decref) Task=`54800a0c-3573-439b-92cd-589a2ca8003f`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:20:13,374::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:20:14,217::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:14,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:14,219::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:14,220::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:14,220::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:14,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:14,220::__init__::225::IOProcess::(_processLogs) (274638) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:14,221::__init__::225::IOProcess::(_processLogs) (274638) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:14,221::__init__::225::IOProcess::(_processLogs) (274638) Building response >Thread-18::DEBUG::2014-07-08 17:20:14,221::__init__::225::IOProcess::(_processLogs) (274638) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:14,221::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:14,222::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:20:14,223::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:20:14,374::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000421831 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:20:14,379::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:14,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:14,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:14,384::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:14,385::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:14,387::__init__::225::IOProcess::(_processLogs) (274639) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:14,388::__init__::225::IOProcess::(_processLogs) (274639) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:14,390::__init__::225::IOProcess::(_processLogs) (274639) Building response >Thread-18::DEBUG::2014-07-08 17:20:14,391::__init__::225::IOProcess::(_processLogs) (274639) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:14,392::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:14,394::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:20:14,402::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:20:14,404::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:14,406::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:14,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:14,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:14,411::__init__::225::IOProcess::(_processLogs) (274640) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:14,412::__init__::225::IOProcess::(_processLogs) (274640) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:14,414::__init__::225::IOProcess::(_processLogs) (274640) Building response >Thread-18::DEBUG::2014-07-08 17:20:14,415::__init__::225::IOProcess::(_processLogs) (274640) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:14,417::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:14,419::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:14,424::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:20:14,426::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:14,428::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:14,429::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:14,431::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:14,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:14,434::__init__::225::IOProcess::(_processLogs) (274641) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:14,435::__init__::225::IOProcess::(_processLogs) (274641) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:14,437::__init__::225::IOProcess::(_processLogs) (274641) Building response >Thread-18::DEBUG::2014-07-08 17:20:14,438::__init__::225::IOProcess::(_processLogs) (274641) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:14,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:14,442::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:14,447::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:20:14,449::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:14,450::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:14,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:14,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:14,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:14,456::__init__::225::IOProcess::(_processLogs) (274642) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:14,458::__init__::225::IOProcess::(_processLogs) (274642) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:14,459::__init__::225::IOProcess::(_processLogs) (274642) Building response >Thread-18::DEBUG::2014-07-08 17:20:14,461::__init__::225::IOProcess::(_processLogs) (274642) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:14,462::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:14,464::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:14,708::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:14,709::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:14,710::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:14,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:15,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0197386 s, 51.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:20:17,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:17,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172283 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:20:19,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:19,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170892 s, 59.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:19,764::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:19,768::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:19,773::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:20:21,503::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:20:21,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`80e805a8-2fd7-4e17-8ee3-5a534ef998b3`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:21,505::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:20:21,522::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:21,523::task::1191::Storage.TaskManager.Task::(prepare) Task=`80e805a8-2fd7-4e17-8ee3-5a534ef998b3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:21,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`80e805a8-2fd7-4e17-8ee3-5a534ef998b3`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:21,523::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:21,523::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:21,524::task::993::Storage.TaskManager.Task::(_decref) Task=`80e805a8-2fd7-4e17-8ee3-5a534ef998b3`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:20:21,535::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:20:21,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`76ee5a75-0512-4f77-9924-d753bc59d5f3`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:20:21,536::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:20:21,537::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`78dca988-c55b-40f7-82ae-225f5bb42ada`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:20:21,537::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:20:21,538::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:20:21,538::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`78dca988-c55b-40f7-82ae-225f5bb42ada`::Granted request >Thread-7083::DEBUG::2014-07-08 17:20:21,539::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`76ee5a75-0512-4f77-9924-d753bc59d5f3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:20:21,539::task::993::Storage.TaskManager.Task::(_decref) Task=`76ee5a75-0512-4f77-9924-d753bc59d5f3`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:20:21,560::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:21,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`76ee5a75-0512-4f77-9924-d753bc59d5f3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576133632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:21,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`76ee5a75-0512-4f77-9924-d753bc59d5f3`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:20:21,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:20:21,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:20:21,562::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:20:21,562::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:20:21,562::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:20:21,562::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:20:21,563::task::993::Storage.TaskManager.Task::(_decref) Task=`76ee5a75-0512-4f77-9924-d753bc59d5f3`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:20:21,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:22,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172492 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:20:24,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:24,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119205 s, 8.6 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:20:24,504::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:20:24,509::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:24,512::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:24,515::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7086::ERROR::2014-07-08 17:20:24,509::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:20:24,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:24,524::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:24,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:24,535::__init__::225::IOProcess::(_processLogs) (274643) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:24,540::__init__::225::IOProcess::(_processLogs) (274643) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:24,544::__init__::225::IOProcess::(_processLogs) (274643) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:24,546::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:24,549::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:20:24,562::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:20:24,719::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000529104 s, 873 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:20:24,727::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:24,729::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:24,732::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:24,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:24,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:24,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:24,744::__init__::225::IOProcess::(_processLogs) (274644) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:24,746::__init__::225::IOProcess::(_processLogs) (274644) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:24,750::__init__::225::IOProcess::(_processLogs) (274644) Building response >Thread-18::DEBUG::2014-07-08 17:20:24,755::__init__::225::IOProcess::(_processLogs) (274644) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:24,761::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:24,768::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:24,789::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:24,820::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:20:24,820::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:20:24,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:24,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:24,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:24,855::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:20:24,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:24,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:24,878::__init__::225::IOProcess::(_processLogs) (274645) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:24,882::__init__::225::IOProcess::(_processLogs) (274645) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:24,889::__init__::225::IOProcess::(_processLogs) (274645) Building response >Thread-18::DEBUG::2014-07-08 17:20:24,895::__init__::225::IOProcess::(_processLogs) (274645) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:24,901::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:24,908::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:24,924::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:20:24,927::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:24,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:24,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:24,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:24,936::__init__::225::IOProcess::(_processLogs) (274646) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:24,937::__init__::225::IOProcess::(_processLogs) (274646) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:24,939::__init__::225::IOProcess::(_processLogs) (274646) Building response >Thread-18::DEBUG::2014-07-08 17:20:24,941::__init__::225::IOProcess::(_processLogs) (274646) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:24,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:24,946::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:24,954::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:20:24,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:24,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:24,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:24,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:24,965::__init__::225::IOProcess::(_processLogs) (274647) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:24,968::__init__::225::IOProcess::(_processLogs) (274647) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:24,970::__init__::225::IOProcess::(_processLogs) (274647) Building response >Thread-18::DEBUG::2014-07-08 17:20:24,973::__init__::225::IOProcess::(_processLogs) (274647) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:24,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:24,977::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:20:27,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:27,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173895 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:20:28,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4ba6431-359a-4444-8446-0d77e1ca261c`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:28,726::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:20:28,726::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529104', 'lastCheck': '3.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:20:28,726::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4ba6431-359a-4444-8446-0d77e1ca261c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529104', 'lastCheck': '3.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:20:28,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4ba6431-359a-4444-8446-0d77e1ca261c`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:28,727::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:28,727::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:28,727::task::993::Storage.TaskManager.Task::(_decref) Task=`a4ba6431-359a-4444-8446-0d77e1ca261c`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:20:28,777::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:29,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:29,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172758 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:29,884::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:29,886::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:29,887::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:20:31,577::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:20:31,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`67c7d301-1da2-46ab-bfb8-8706afe93847`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:31,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:20:31,595::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:31,595::task::1191::Storage.TaskManager.Task::(prepare) Task=`67c7d301-1da2-46ab-bfb8-8706afe93847`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:31,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`67c7d301-1da2-46ab-bfb8-8706afe93847`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:31,596::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:31,596::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:31,596::task::993::Storage.TaskManager.Task::(_decref) Task=`67c7d301-1da2-46ab-bfb8-8706afe93847`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:20:31,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:20:31,763::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:20:31,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bdcff4a-fff5-4f51-a5c7-a51df280b4ea`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:20:31,766::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:20:31,767::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3de882c6-3091-4919-8a48-c20df053ae4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:20:31,767::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:20:31,768::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:20:31,768::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3de882c6-3091-4919-8a48-c20df053ae4c`::Granted request >Thread-7083::DEBUG::2014-07-08 17:20:31,773::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1bdcff4a-fff5-4f51-a5c7-a51df280b4ea`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:20:31,774::task::993::Storage.TaskManager.Task::(_decref) Task=`1bdcff4a-fff5-4f51-a5c7-a51df280b4ea`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:20:31,856::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576068096', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Dummy-6860::DEBUG::2014-07-08 17:20:31,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242572 s, 42.2 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:20:31,860::task::1191::Storage.TaskManager.Task::(prepare) Task=`1bdcff4a-fff5-4f51-a5c7-a51df280b4ea`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576068096', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:31,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bdcff4a-fff5-4f51-a5c7-a51df280b4ea`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:20:31,867::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:20:31,869::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:20:31,873::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:20:31,874::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:20:31,875::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:20:31,876::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:20:31,878::task::993::Storage.TaskManager.Task::(_decref) Task=`1bdcff4a-fff5-4f51-a5c7-a51df280b4ea`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-08 17:20:32,242::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:20:33,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:34,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0214776 s, 47.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:34,890::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:34,891::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:34,892::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:20:34,985::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:34,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:34,986::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:34,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:34,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:34,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:34,987::__init__::225::IOProcess::(_processLogs) (274648) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:34,987::__init__::225::IOProcess::(_processLogs) (274648) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:34,987::__init__::225::IOProcess::(_processLogs) (274648) Building response >Thread-18::DEBUG::2014-07-08 17:20:34,988::__init__::225::IOProcess::(_processLogs) (274648) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:34,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:34,988::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:20:34,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:20:35,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000521282 s, 886 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:20:35,264::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:35,269::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:35,275::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:35,278::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:35,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:35,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:35,289::__init__::225::IOProcess::(_processLogs) (274649) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:35,297::__init__::225::IOProcess::(_processLogs) (274649) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:35,304::__init__::225::IOProcess::(_processLogs) (274649) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:35,309::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:35,313::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:20:35,436::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:20:35,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:35,455::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:35,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:35,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:35,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:35,480::__init__::225::IOProcess::(_processLogs) (274650) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:35,482::__init__::225::IOProcess::(_processLogs) (274650) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:35,483::__init__::225::IOProcess::(_processLogs) (274650) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:35,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:35,486::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:35,493::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:20:35,495::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:35,496::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:35,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:35,501::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:35,503::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:35,505::__init__::225::IOProcess::(_processLogs) (274651) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:35,506::__init__::225::IOProcess::(_processLogs) (274651) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:35,508::__init__::225::IOProcess::(_processLogs) (274651) Building response >Thread-18::DEBUG::2014-07-08 17:20:35,510::__init__::225::IOProcess::(_processLogs) (274651) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:35,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:35,513::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:35,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:20:35,523::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:20:35,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:35,526::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:35,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:35,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:35,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:35,532::__init__::225::IOProcess::(_processLogs) (274652) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:35,533::__init__::225::IOProcess::(_processLogs) (274652) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:35,535::__init__::225::IOProcess::(_processLogs) (274652) Building response >Thread-18::DEBUG::2014-07-08 17:20:35,536::__init__::225::IOProcess::(_processLogs) (274652) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:35,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:35,539::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:20:36,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:36,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205689 s, 49.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:20:38,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:38,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172819 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:20:39,608::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:20:39,608::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:39,899::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:39,901::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:39,902::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:40,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:41,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173222 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:20:41,896::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:20:41,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`0660434c-c576-4094-8204-f65f661f8bcb`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:41,898::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:20:41,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:41,914::task::1191::Storage.TaskManager.Task::(prepare) Task=`0660434c-c576-4094-8204-f65f661f8bcb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:41,914::task::595::Storage.TaskManager.Task::(_updateState) Task=`0660434c-c576-4094-8204-f65f661f8bcb`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:41,914::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:41,915::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:41,915::task::993::Storage.TaskManager.Task::(_decref) Task=`0660434c-c576-4094-8204-f65f661f8bcb`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:20:41,927::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:20:41,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`f63d0dd9-b73d-476a-86a9-f50a65d86247`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:20:41,928::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:20:41,929::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0b19409a-1e07-4f9f-8415-dc1bed64c717`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:20:41,929::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:20:41,930::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:20:41,930::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0b19409a-1e07-4f9f-8415-dc1bed64c717`::Granted request >Thread-7083::DEBUG::2014-07-08 17:20:41,931::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f63d0dd9-b73d-476a-86a9-f50a65d86247`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:20:41,931::task::993::Storage.TaskManager.Task::(_decref) Task=`f63d0dd9-b73d-476a-86a9-f50a65d86247`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:20:41,950::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576068096', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:41,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`f63d0dd9-b73d-476a-86a9-f50a65d86247`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576068096', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:41,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`f63d0dd9-b73d-476a-86a9-f50a65d86247`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:20:41,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:20:41,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:20:41,952::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:20:41,952::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:20:41,952::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:20:41,953::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:20:41,953::task::993::Storage.TaskManager.Task::(_decref) Task=`f63d0dd9-b73d-476a-86a9-f50a65d86247`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:20:43,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:43,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174557 s, 58.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:20:43,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5eb6834-b526-4229-9f99-d7600a7ef072`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:43,953::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:20:43,954::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521282', 'lastCheck': '8.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:20:43,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5eb6834-b526-4229-9f99-d7600a7ef072`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521282', 'lastCheck': '8.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:20:43,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5eb6834-b526-4229-9f99-d7600a7ef072`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:43,955::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:43,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:43,955::task::993::Storage.TaskManager.Task::(_decref) Task=`b5eb6834-b526-4229-9f99-d7600a7ef072`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:20:43,985::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:44,906::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:44,907::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:44,908::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:45,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:45,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180535 s, 56.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:20:45,548::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:20:45,549::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:45,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:45,551::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:45,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:45,554::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:45,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:45,556::__init__::225::IOProcess::(_processLogs) (274653) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:45,557::__init__::225::IOProcess::(_processLogs) (274653) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:45,558::__init__::225::IOProcess::(_processLogs) (274653) Building response >Thread-18::DEBUG::2014-07-08 17:20:45,559::__init__::225::IOProcess::(_processLogs) (274653) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:45,561::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:45,562::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:20:45,567::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:20:45,733::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000657329 s, 703 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:20:45,749::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:20:45,755::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:45,762::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:45,769::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:45,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:45,781::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:45,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:45,795::__init__::225::IOProcess::(_processLogs) (274654) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:45,801::__init__::225::IOProcess::(_processLogs) (274654) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:45,807::__init__::225::IOProcess::(_processLogs) DEBUG|(274654) Building response >Thread-18::DEBUG::2014-07-08 17:20:45,812::__init__::225::IOProcess::(_processLogs) (274654) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:45,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:45,823::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:20:45,860::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:20:45,863::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:20:45,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:45,869::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:45,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:45,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:45,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:45,880::__init__::225::IOProcess::(_processLogs) DEBUG|(274655) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:45,883::__init__::225::IOProcess::(_processLogs) (274655) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:45,885::__init__::225::IOProcess::(_processLogs) (274655) Building response >Thread-18::DEBUG::2014-07-08 17:20:45,887::__init__::225::IOProcess::(_processLogs) (274655) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:45,890::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:45,892::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:45,900::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:20:45,902::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:20:45,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:45,906::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:45,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:45,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:45,912::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:45,915::__init__::225::IOProcess::(_processLogs) (274656) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:45,917::__init__::225::IOProcess::(_processLogs) (274656) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:45,919::__init__::225::IOProcess::(_processLogs) (274656) Building response >Thread-18::DEBUG::2014-07-08 17:20:45,920::__init__::225::IOProcess::(_processLogs) (274656) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:45,922::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:45,924::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:45,933::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:20:45,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:45,938::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:45,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:46,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:46,034::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:46,038::__init__::225::IOProcess::(_processLogs) (274657) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:46,041::__init__::225::IOProcess::(_processLogs) (274657) Building response >Thread-18::DEBUG::2014-07-08 17:20:46,043::__init__::225::IOProcess::(_processLogs) (274657) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:46,045::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:46,048::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:20:48,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:48,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017532 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:49,918::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:49,923::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:49,927::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:50,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:50,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173378 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:20:51,968::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:20:51,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`071fd03d-264e-4920-8430-c2895afd96f3`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:51,970::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:20:51,985::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:51,985::task::1191::Storage.TaskManager.Task::(prepare) Task=`071fd03d-264e-4920-8430-c2895afd96f3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:20:51,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`071fd03d-264e-4920-8430-c2895afd96f3`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:51,986::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:51,986::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:51,986::task::993::Storage.TaskManager.Task::(_decref) Task=`071fd03d-264e-4920-8430-c2895afd96f3`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:20:51,999::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:20:52,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`48b85bef-7b0b-4025-bc3f-436a436787e1`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:20:52,000::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:20:52,001::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ec7619cd-7036-4c7a-bebb-a9ea95579ffe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:20:52,001::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:20:52,002::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:20:52,002::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ec7619cd-7036-4c7a-bebb-a9ea95579ffe`::Granted request >Thread-7083::DEBUG::2014-07-08 17:20:52,003::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`48b85bef-7b0b-4025-bc3f-436a436787e1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:20:52,003::task::993::Storage.TaskManager.Task::(_decref) Task=`48b85bef-7b0b-4025-bc3f-436a436787e1`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:20:52,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576068096', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:52,023::task::1191::Storage.TaskManager.Task::(prepare) Task=`48b85bef-7b0b-4025-bc3f-436a436787e1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576068096', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:20:52,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`48b85bef-7b0b-4025-bc3f-436a436787e1`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:20:52,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:20:52,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:20:52,024::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:20:52,024::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:20:52,025::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:20:52,025::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:20:52,025::task::993::Storage.TaskManager.Task::(_decref) Task=`48b85bef-7b0b-4025-bc3f-436a436787e1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:20:52,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:53,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172917 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:20:54,755::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:20:54,755::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:54,937::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:54,938::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:54,940::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:55,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:55,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175322 s, 58.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:20:56,061::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:56,062::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:56,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:56,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:56,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:56,063::__init__::225::IOProcess::(_processLogs) (274658) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:56,063::__init__::225::IOProcess::(_processLogs) (274658) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:56,063::__init__::225::IOProcess::(_processLogs) (274658) Building response >Thread-18::DEBUG::2014-07-08 17:20:56,063::__init__::225::IOProcess::(_processLogs) (274658) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:56,064::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:56,064::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:20:56,065::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:20:56,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000493625 s, 936 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:20:56,222::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:20:56,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:56,225::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:56,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:56,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:56,226::__init__::225::IOProcess::(_processLogs) (274659) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:20:56,227::__init__::225::IOProcess::(_processLogs) (274659) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:20:56,227::__init__::225::IOProcess::(_processLogs) (274659) Building response >Thread-18::DEBUG::2014-07-08 17:20:56,227::__init__::225::IOProcess::(_processLogs) (274659) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:56,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:56,228::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:20:56,230::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:20:56,230::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:56,230::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:56,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:56,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:56,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:56,231::__init__::225::IOProcess::(_processLogs) (274660) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:56,232::__init__::225::IOProcess::(_processLogs) (274660) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:56,232::__init__::225::IOProcess::(_processLogs) (274660) Building response >Thread-18::DEBUG::2014-07-08 17:20:56,232::__init__::225::IOProcess::(_processLogs) (274660) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:56,232::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:56,232::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:56,234::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:20:56,234::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:56,234::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:56,234::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:56,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:56,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:56,235::__init__::225::IOProcess::(_processLogs) (274661) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:56,235::__init__::225::IOProcess::(_processLogs) (274661) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:56,236::__init__::225::IOProcess::(_processLogs) (274661) Building response >Thread-18::DEBUG::2014-07-08 17:20:56,236::__init__::225::IOProcess::(_processLogs) (274661) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:56,236::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:56,236::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:20:56,237::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:20:56,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:20:56,238::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:20:56,238::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:20:56,238::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:20:56,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:20:56,239::__init__::225::IOProcess::(_processLogs) (274662) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:20:56,239::__init__::225::IOProcess::(_processLogs) (274662) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:20:56,239::__init__::225::IOProcess::(_processLogs) (274662) Building response >Thread-18::DEBUG::2014-07-08 17:20:56,240::__init__::225::IOProcess::(_processLogs) (274662) Queuing response >Thread-18::DEBUG::2014-07-08 17:20:56,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:20:56,240::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:20:57,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:57,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204119 s, 50.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:20:59,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`3881bef4-789b-4b77-93e1-fc991cf1df85`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:20:59,239::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:20:59,240::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493625', 'lastCheck': '3.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:20:59,240::task::1191::Storage.TaskManager.Task::(prepare) Task=`3881bef4-789b-4b77-93e1-fc991cf1df85`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493625', 'lastCheck': '3.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:20:59,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`3881bef4-789b-4b77-93e1-fc991cf1df85`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:20:59,241::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:20:59,241::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:20:59,241::task::993::Storage.TaskManager.Task::(_decref) Task=`3881bef4-789b-4b77-93e1-fc991cf1df85`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:20:59,272::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:20:59,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:20:59,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018272 s, 56.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:59,947::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:59,949::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:20:59,950::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:21:01,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:21:02,047::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:21:02,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`1129367d-5c90-4140-b3d5-483863572619`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:21:02,153::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:21:02,177::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:02,181::task::1191::Storage.TaskManager.Task::(prepare) Task=`1129367d-5c90-4140-b3d5-483863572619`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:02,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`1129367d-5c90-4140-b3d5-483863572619`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:21:02,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Dummy-6860::DEBUG::2014-07-08 17:21:02,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.141093 s, 7.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:21:02,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:21:02,374::task::993::Storage.TaskManager.Task::(_decref) Task=`1129367d-5c90-4140-b3d5-483863572619`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:21:02,406::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:21:02,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`866d344b-a8c7-4bcd-a6b2-b234780d1ce3`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:21:02,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:21:02,429::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4f5096c1-8533-4b79-bf0d-3aacfaf11642`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:21:02,433::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:21:02,440::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:21:02,447::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4f5096c1-8533-4b79-bf0d-3aacfaf11642`::Granted request >Thread-7083::DEBUG::2014-07-08 17:21:02,452::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`866d344b-a8c7-4bcd-a6b2-b234780d1ce3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:21:02,454::task::993::Storage.TaskManager.Task::(_decref) Task=`866d344b-a8c7-4bcd-a6b2-b234780d1ce3`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:21:02,492::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576068096', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:02,493::task::1191::Storage.TaskManager.Task::(prepare) Task=`866d344b-a8c7-4bcd-a6b2-b234780d1ce3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576068096', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:02,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`866d344b-a8c7-4bcd-a6b2-b234780d1ce3`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:21:02,495::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:21:02,496::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:21:02,498::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:21:02,500::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:21:02,501::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:21:02,502::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:21:02,503::task::993::Storage.TaskManager.Task::(_decref) Task=`866d344b-a8c7-4bcd-a6b2-b234780d1ce3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-08 17:21:02,600::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:21:04,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:04,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0202166 s, 50.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:04,957::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:04,958::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:04,960::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:21:06,243::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:06,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:06,244::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:06,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:06,245::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:06,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:06,245::__init__::225::IOProcess::(_processLogs) (274663) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:06,246::__init__::225::IOProcess::(_processLogs) (274663) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:06,246::__init__::225::IOProcess::(_processLogs) (274663) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:06,246::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:06,246::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:21:06,248::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:21:06,399::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00049167 s, 940 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:06,405::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:06,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:06,409::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:06,410::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:06,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:06,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:06,414::__init__::225::IOProcess::(_processLogs) (274664) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:06,416::__init__::225::IOProcess::(_processLogs) (274664) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:06,418::__init__::225::IOProcess::(_processLogs) (274664) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:06,419::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:06,421::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:21:06,430::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:21:06,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:06,434::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:06,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:06,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:06,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:06,441::__init__::225::IOProcess::(_processLogs) (274665) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:06,443::__init__::225::IOProcess::(_processLogs) (274665) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:06,445::__init__::225::IOProcess::(_processLogs) (274665) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:06,447::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:06,448::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:06,454::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:21:06,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:06,457::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:06,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:06,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:06,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:06,463::__init__::225::IOProcess::(_processLogs) (274666) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:06,465::__init__::225::IOProcess::(_processLogs) (274666) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:06,467::__init__::225::IOProcess::(_processLogs) (274666) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:06,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:06,474::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:06,495::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:21:06,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:06,506::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:06,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:06,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:06,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:06,523::__init__::225::IOProcess::(_processLogs) (274667) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:06,527::__init__::225::IOProcess::(_processLogs) (274667) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:06,533::__init__::225::IOProcess::(_processLogs) (274667) Building response >Thread-18::DEBUG::2014-07-08 17:21:06,538::__init__::225::IOProcess::(_processLogs) (274667) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:06,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:06,547::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:21:06,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:07,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179462 s, 57.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:21:09,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:09,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173638 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:21:09,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a650e19-2a06-492a-908d-ae597b4feb2d`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:21:09,784::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:21:09,786::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:21:09,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:09,786::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:09,787::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:09,787::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:09,787::__init__::225::IOProcess::(_processLogs) (274668) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:21:09,787::__init__::225::IOProcess::(_processLogs) (274668) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:21:09,788::__init__::225::IOProcess::(_processLogs) (274668) Building response >Thread-18::DEBUG::2014-07-08 17:21:09,788::__init__::225::IOProcess::(_processLogs) (274668) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:09,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:09,788::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:21:09,790::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:21:09,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:09,791::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:09,791::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:09,791::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:09,792::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:09,792::__init__::225::IOProcess::(_processLogs) (274669) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:21:09,792::__init__::225::IOProcess::(_processLogs) (274669) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:21:09,792::__init__::225::IOProcess::(_processLogs) (274669) Building response >Thread-18::DEBUG::2014-07-08 17:21:09,793::__init__::225::IOProcess::(_processLogs) (274669) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:09,793::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:09,793::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:21:09,794::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:21:09,795::task::1191::Storage.TaskManager.Task::(prepare) Task=`7a650e19-2a06-492a-908d-ae597b4feb2d`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:21:09,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a650e19-2a06-492a-908d-ae597b4feb2d`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:21:09,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:21:09,795::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:21:09,796::task::993::Storage.TaskManager.Task::(_decref) Task=`7a650e19-2a06-492a-908d-ae597b4feb2d`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:21:09,875::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:21:09,876::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:09,971::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:09,972::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:09,973::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:21:11,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:11,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017449 s, 58.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:21:12,517::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:21:12,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f0256da-8773-44f2-9fff-4b6a33980128`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:21:12,518::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:21:12,533::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:12,534::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f0256da-8773-44f2-9fff-4b6a33980128`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:12,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f0256da-8773-44f2-9fff-4b6a33980128`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:21:12,534::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:21:12,535::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:21:12,535::task::993::Storage.TaskManager.Task::(_decref) Task=`1f0256da-8773-44f2-9fff-4b6a33980128`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:21:12,548::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:21:12,548::task::595::Storage.TaskManager.Task::(_updateState) Task=`790367ec-1ca6-4f9e-9c10-267d8c8e8df8`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:21:12,549::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:21:12,550::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8e108c70-604c-40d2-bbcb-9ad61d46f6bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:21:12,550::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:21:12,551::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:21:12,551::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8e108c70-604c-40d2-bbcb-9ad61d46f6bf`::Granted request >Thread-7083::DEBUG::2014-07-08 17:21:12,552::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`790367ec-1ca6-4f9e-9c10-267d8c8e8df8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:21:12,552::task::993::Storage.TaskManager.Task::(_decref) Task=`790367ec-1ca6-4f9e-9c10-267d8c8e8df8`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:21:12,571::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:12,571::task::1191::Storage.TaskManager.Task::(prepare) Task=`790367ec-1ca6-4f9e-9c10-267d8c8e8df8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:12,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`790367ec-1ca6-4f9e-9c10-267d8c8e8df8`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:21:12,572::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:21:12,572::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:21:12,572::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:21:12,573::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:21:12,573::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:21:12,573::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:21:12,574::task::993::Storage.TaskManager.Task::(_decref) Task=`790367ec-1ca6-4f9e-9c10-267d8c8e8df8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:21:13,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:13,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171582 s, 59.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:21:14,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1a2ad29-92ed-4c95-9031-bd934b4d221b`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:21:14,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:21:14,496::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049167', 'lastCheck': '7.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:21:14,496::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1a2ad29-92ed-4c95-9031-bd934b4d221b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049167', 'lastCheck': '7.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:21:14,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1a2ad29-92ed-4c95-9031-bd934b4d221b`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:21:14,497::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:21:14,497::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:21:14,497::task::993::Storage.TaskManager.Task::(_decref) Task=`c1a2ad29-92ed-4c95-9031-bd934b4d221b`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:21:14,528::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:14,980::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:14,982::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:14,983::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:21:15,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:16,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0203945 s, 50.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:16,562::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:16,563::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:16,563::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:16,563::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:16,563::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:16,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:16,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:16,564::__init__::225::IOProcess::(_processLogs) (274670) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:16,564::__init__::225::IOProcess::(_processLogs) (274670) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:16,565::__init__::225::IOProcess::(_processLogs) (274670) Building response >Thread-18::DEBUG::2014-07-08 17:21:16,565::__init__::225::IOProcess::(_processLogs) (274670) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:16,565::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:16,565::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:21:16,567::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:21:16,723::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00210496 s, 219 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:16,737::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:16,743::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:16,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:16,751::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:16,755::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:16,759::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:16,763::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:16,766::__init__::225::IOProcess::(_processLogs) (274671) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:16,770::__init__::225::IOProcess::(_processLogs) (274671) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:16,775::__init__::225::IOProcess::(_processLogs) DEBUG|(274671) Building response >Thread-18::DEBUG::2014-07-08 17:21:16,778::__init__::225::IOProcess::(_processLogs) (274671) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:16,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:16,786::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:21:16,804::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:16,808::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:21:16,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:16,817::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:16,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:16,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:16,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:16,823::__init__::225::IOProcess::(_processLogs) (274672) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:16,825::__init__::225::IOProcess::(_processLogs) (274672) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:16,826::__init__::225::IOProcess::(_processLogs) (274672) Building response >Thread-18::DEBUG::2014-07-08 17:21:16,827::__init__::225::IOProcess::(_processLogs) (274672) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:16,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:16,830::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:16,836::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:16,837::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:21:16,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:16,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:16,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:16,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:16,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:16,846::__init__::225::IOProcess::(_processLogs) (274673) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:16,848::__init__::225::IOProcess::(_processLogs) (274673) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:16,849::__init__::225::IOProcess::(_processLogs) (274673) Building response >Thread-18::DEBUG::2014-07-08 17:21:16,850::__init__::225::IOProcess::(_processLogs) (274673) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:16,852::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:16,853::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:16,859::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:16,861::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:21:16,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:16,864::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:16,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:16,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:16,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:16,869::__init__::225::IOProcess::(_processLogs) (274674) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:16,871::__init__::225::IOProcess::(_processLogs) (274674) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:16,872::__init__::225::IOProcess::(_processLogs) (274674) Building response >Thread-18::DEBUG::2014-07-08 17:21:16,874::__init__::225::IOProcess::(_processLogs) (274674) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:16,875::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:21:16,877::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:21:18,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:18,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0982061 s, 10.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:19,990::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:19,992::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:19,993::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:21:20,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:20,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0223914 s, 45.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:21:22,586::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:21:22,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`04ae54f6-ca62-4e18-a1f4-967ab10d778f`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:21:22,588::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:21:22,603::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:22,603::task::1191::Storage.TaskManager.Task::(prepare) Task=`04ae54f6-ca62-4e18-a1f4-967ab10d778f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:22,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`04ae54f6-ca62-4e18-a1f4-967ab10d778f`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:21:22,604::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:21:22,604::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:21:22,604::task::993::Storage.TaskManager.Task::(_decref) Task=`04ae54f6-ca62-4e18-a1f4-967ab10d778f`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:21:22,616::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:21:22,617::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a325955-a6e7-4532-89f3-48a29d09c8d8`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:21:22,617::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:21:22,618::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`579ccca3-dbcb-4594-8a43-722bcfe8ec27`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:21:22,619::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:21:22,619::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:21:22,619::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`579ccca3-dbcb-4594-8a43-722bcfe8ec27`::Granted request >Thread-7083::DEBUG::2014-07-08 17:21:22,624::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2a325955-a6e7-4532-89f3-48a29d09c8d8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:21:22,624::task::993::Storage.TaskManager.Task::(_decref) Task=`2a325955-a6e7-4532-89f3-48a29d09c8d8`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:21:22,643::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:22,644::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a325955-a6e7-4532-89f3-48a29d09c8d8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:22,644::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a325955-a6e7-4532-89f3-48a29d09c8d8`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:21:22,644::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:21:22,644::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:21:22,645::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:21:22,645::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:21:22,645::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:21:22,646::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:21:22,646::task::993::Storage.TaskManager.Task::(_decref) Task=`2a325955-a6e7-4532-89f3-48a29d09c8d8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:21:22,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:23,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034691 s, 29.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:25,002::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:25,009::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:25,017::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:21:25,031::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:21:25,032::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:21:25,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:25,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172571 s, 59.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:26,883::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:26,884::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:26,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:26,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:26,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:26,885::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:26,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:26,885::__init__::225::IOProcess::(_processLogs) (274675) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:26,885::__init__::225::IOProcess::(_processLogs) (274675) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:26,886::__init__::225::IOProcess::(_processLogs) (274675) Building response >Thread-18::DEBUG::2014-07-08 17:21:26,886::__init__::225::IOProcess::(_processLogs) (274675) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:26,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:26,886::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:21:26,888::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:21:27,046::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000497816 s, 928 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:27,056::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:27,063::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:27,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:27,072::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:27,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:27,081::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:27,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:27,089::__init__::225::IOProcess::(_processLogs) (274676) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:27,093::__init__::225::IOProcess::(_processLogs) (274676) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:27,097::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|(274676) Building response >Thread-18::DEBUG::2014-07-08 17:21:27,101::__init__::225::IOProcess::(_processLogs) (274676) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:27,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:27,108::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:21:27,136::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:27,138::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:21:27,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:27,141::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:27,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:27,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:27,146::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:27,147::__init__::225::IOProcess::(_processLogs) (274677) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:27,148::__init__::225::IOProcess::(_processLogs) (274677) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:27,150::__init__::225::IOProcess::(_processLogs) (274677) Building response >Thread-18::DEBUG::2014-07-08 17:21:27,151::__init__::225::IOProcess::(_processLogs) (274677) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:27,153::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:27,154::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:27,159::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:27,160::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:21:27,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:27,163::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:27,165::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:27,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:27,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:27,169::__init__::225::IOProcess::(_processLogs) (274678) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:27,170::__init__::225::IOProcess::(_processLogs) (274678) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:27,171::__init__::225::IOProcess::(_processLogs) (274678) Building response >Thread-18::DEBUG::2014-07-08 17:21:27,173::__init__::225::IOProcess::(_processLogs) (274678) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:27,174::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:27,176::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:27,180::__init__::225::IOProcess::(_processLogs) (274673) Queuing responseDEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:27,182::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:21:27,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:27,184::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:27,186::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:27,187::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:27,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:27,190::__init__::225::IOProcess::(_processLogs) (274679) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:27,192::__init__::225::IOProcess::(_processLogs) (274679) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:27,193::__init__::225::IOProcess::(_processLogs) (274679) Building response >Thread-18::DEBUG::2014-07-08 17:21:27,194::__init__::225::IOProcess::(_processLogs) (274679) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:27,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:27,197::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:21:27,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:27,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017235 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:21:29,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:21:29,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de84e48-a3e3-4c28-b8c0-2211599f412a`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:21:29,772::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:21:29,773::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497816', 'lastCheck': '2.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:21:29,773::task::1191::Storage.TaskManager.Task::(prepare) Task=`9de84e48-a3e3-4c28-b8c0-2211599f412a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497816', 'lastCheck': '2.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:21:29,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de84e48-a3e3-4c28-b8c0-2211599f412a`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:21:29,774::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:21:29,777::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:21:29,780::task::993::Storage.TaskManager.Task::(_decref) Task=`9de84e48-a3e3-4c28-b8c0-2211599f412a`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:21:29,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0437165 s, 23.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:21:29,905::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:30,027::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:30,029::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:30,030::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:21:31,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:32,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196757 s, 52.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:21:32,661::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:21:32,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`f05ed25b-604d-45b6-9f4d-9eab6566594f`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:21:32,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:21:32,677::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:32,678::task::1191::Storage.TaskManager.Task::(prepare) Task=`f05ed25b-604d-45b6-9f4d-9eab6566594f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:32,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`f05ed25b-604d-45b6-9f4d-9eab6566594f`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:21:32,678::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:21:32,679::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:21:32,679::task::993::Storage.TaskManager.Task::(_decref) Task=`f05ed25b-604d-45b6-9f4d-9eab6566594f`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:21:32,692::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:21:32,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9c9d40e-79d5-4a56-8a43-402d23049747`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:21:32,693::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:21:32,694::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4a7f3ccb-6f8c-4b1c-809c-627c1f2fbc01`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:21:32,694::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:21:32,695::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:21:32,695::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4a7f3ccb-6f8c-4b1c-809c-627c1f2fbc01`::Granted request >Thread-7083::DEBUG::2014-07-08 17:21:32,696::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b9c9d40e-79d5-4a56-8a43-402d23049747`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:21:32,696::task::993::Storage.TaskManager.Task::(_decref) Task=`b9c9d40e-79d5-4a56-8a43-402d23049747`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:21:32,715::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:32,716::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9c9d40e-79d5-4a56-8a43-402d23049747`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:32,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9c9d40e-79d5-4a56-8a43-402d23049747`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:21:32,716::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:21:32,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:21:32,717::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:21:32,718::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:21:32,718::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:21:32,718::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:21:32,718::task::993::Storage.TaskManager.Task::(_decref) Task=`b9c9d40e-79d5-4a56-8a43-402d23049747`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-08 17:21:32,789::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:21:34,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:34,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894292 s, 11.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:35,034::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:35,036::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:35,037::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:21:36,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:36,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0209108 s, 49.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:37,205::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:37,206::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:37,207::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:37,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:37,210::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:37,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:37,213::__init__::225::IOProcess::(_processLogs) (274680) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:37,214::__init__::225::IOProcess::(_processLogs) (274680) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:37,215::__init__::225::IOProcess::(_processLogs) (274680) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:37,217::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:37,218::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:21:37,224::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:21:37,386::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000609001 s, 759 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:37,403::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:37,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:37,418::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:37,424::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:37,431::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:37,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:37,445::__init__::225::IOProcess::(_processLogs) (274681) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:37,452::__init__::225::IOProcess::(_processLogs) (274681) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:37,459::__init__::225::IOProcess::(_processLogs) (274681) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:37,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:37,471::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:21:37,513::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:21:37,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:37,525::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:37,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:37,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:37,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:37,538::__init__::225::IOProcess::(_processLogs) (274682) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:37,541::__init__::225::IOProcess::(_processLogs) (274682) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:37,544::__init__::225::IOProcess::(_processLogs) (274682) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:37,547::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:37,549::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:37,560::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:21:37,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:37,565::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:37,568::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:37,572::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:37,575::__init__::225::IOProcess::(_processLogs) (274683) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:37,578::__init__::225::IOProcess::(_processLogs) (274683) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:37,580::__init__::225::IOProcess::(_processLogs) (274683) Building response >Thread-18::DEBUG::2014-07-08 17:21:37,583::__init__::225::IOProcess::(_processLogs) (274683) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:37,585::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:37,588::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:37,598::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:21:37,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:37,603::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:37,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:37,610::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:37,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:37,616::__init__::225::IOProcess::(_processLogs) (274684) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:37,619::__init__::225::IOProcess::(_processLogs) (274684) Building response >Thread-18::DEBUG::2014-07-08 17:21:37,622::__init__::225::IOProcess::(_processLogs) (274684) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:37,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:37,627::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:21:38,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:39,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0208113 s, 49.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:40,044::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:40,046::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:40,047::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:21:40,090::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:21:40,091::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:21:41,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:41,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173213 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:21:42,732::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:21:42,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`032f6a62-69a6-4338-8361-66e9a6d86241`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:21:42,734::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:21:42,750::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:42,750::task::1191::Storage.TaskManager.Task::(prepare) Task=`032f6a62-69a6-4338-8361-66e9a6d86241`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:42,750::task::595::Storage.TaskManager.Task::(_updateState) Task=`032f6a62-69a6-4338-8361-66e9a6d86241`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:21:42,751::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:21:42,751::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:21:42,751::task::993::Storage.TaskManager.Task::(_decref) Task=`032f6a62-69a6-4338-8361-66e9a6d86241`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:21:42,763::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:21:42,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`74a01792-e178-4dc6-852e-e245076c3ac5`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:21:42,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:21:42,765::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5e76be95-06d5-4bf0-b578-8726d06af0b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:21:42,765::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:21:42,766::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:21:42,766::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5e76be95-06d5-4bf0-b578-8726d06af0b8`::Granted request >Thread-7083::DEBUG::2014-07-08 17:21:42,767::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`74a01792-e178-4dc6-852e-e245076c3ac5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:21:42,767::task::993::Storage.TaskManager.Task::(_decref) Task=`74a01792-e178-4dc6-852e-e245076c3ac5`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:21:42,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:42,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`74a01792-e178-4dc6-852e-e245076c3ac5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:42,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`74a01792-e178-4dc6-852e-e245076c3ac5`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:21:42,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:21:42,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:21:42,790::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:21:42,790::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:21:42,790::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:21:42,790::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:21:42,791::task::993::Storage.TaskManager.Task::(_decref) Task=`74a01792-e178-4dc6-852e-e245076c3ac5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:21:43,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:43,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0207119 s, 49.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:45,133::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:21:45,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ba16295-df96-4b8f-9203-06a5f1504f32`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:21:45,142::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:45,143::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::INFO::2014-07-08 17:21:45,151::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609001', 'lastCheck': '7.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:21:45,153::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ba16295-df96-4b8f-9203-06a5f1504f32`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609001', 'lastCheck': '7.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:21:45,155::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ba16295-df96-4b8f-9203-06a5f1504f32`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:21:45,157::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:21:45,158::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:45,159::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:21:45,160::task::993::Storage.TaskManager.Task::(_decref) Task=`2ba16295-df96-4b8f-9203-06a5f1504f32`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:21:45,195::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:21:45,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:45,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0238184 s, 43.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:47,637::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:47,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:47,638::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:47,638::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:47,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:47,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:47,639::__init__::225::IOProcess::(_processLogs) (274685) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:47,639::__init__::225::IOProcess::(_processLogs) (274685) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:47,639::__init__::225::IOProcess::(_processLogs) (274685) Building response >Thread-18::DEBUG::2014-07-08 17:21:47,640::__init__::225::IOProcess::(_processLogs) (274685) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:47,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:47,640::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:21:47,642::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:21:47,792::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000432167 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:47,794::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:47,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:47,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:47,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:47,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:47,796::__init__::225::IOProcess::(_processLogs) (274686) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:47,796::__init__::225::IOProcess::(_processLogs) (274686) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:47,797::__init__::225::IOProcess::(_processLogs) (274686) Building response >Thread-18::DEBUG::2014-07-08 17:21:47,797::__init__::225::IOProcess::(_processLogs) (274686) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:47,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:47,797::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:21:47,799::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:21:47,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:47,800::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:47,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:47,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:47,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:47,801::__init__::225::IOProcess::(_processLogs) (274687) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:47,801::__init__::225::IOProcess::(_processLogs) (274687) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:47,802::__init__::225::IOProcess::(_processLogs) (274687) Building response >Thread-18::DEBUG::2014-07-08 17:21:47,802::__init__::225::IOProcess::(_processLogs) (274687) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:47,802::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:21:47,802::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:47,803::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:47,804::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:21:47,804::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:47,804::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:47,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:47,805::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:47,805::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:47,805::__init__::225::IOProcess::(_processLogs) (274688) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:47,805::__init__::225::IOProcess::(_processLogs) (274688) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:47,806::__init__::225::IOProcess::(_processLogs) (274688) Building response >Thread-18::DEBUG::2014-07-08 17:21:47,806::__init__::225::IOProcess::(_processLogs) (274688) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:47,806::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:47,806::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:47,807::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:21:47,808::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:21:47,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:47,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:47,809::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:47,809::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:47,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:47,809::__init__::225::IOProcess::(_processLogs) (274689) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:47,809::__init__::225::IOProcess::(_processLogs) (274689) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:47,810::__init__::225::IOProcess::(_processLogs) (274689) Building response >Thread-18::DEBUG::2014-07-08 17:21:47,810::__init__::225::IOProcess::(_processLogs) (274689) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:47,810::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:47,811::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:21:47,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:48,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182452 s, 56.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:50,170::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:50,186::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:50,187::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:21:50,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:50,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0909151 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:21:52,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:21:52,898::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:21:52,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`72449b66-5fce-4b78-8b30-3783fe5ba5c9`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:21:52,901::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:21:52,921::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Dummy-6860::DEBUG::2014-07-08 17:21:52,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243201 s, 42.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:21:52,986::task::1191::Storage.TaskManager.Task::(prepare) Task=`72449b66-5fce-4b78-8b30-3783fe5ba5c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:21:52,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`72449b66-5fce-4b78-8b30-3783fe5ba5c9`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:21:52,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:21:52,989::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:21:52,990::task::993::Storage.TaskManager.Task::(_decref) Task=`72449b66-5fce-4b78-8b30-3783fe5ba5c9`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:21:53,006::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:21:53,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`38eec0a1-3d4b-4c51-a92f-5298e8f837f1`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:21:53,010::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:21:53,013::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a6d82638-b34f-497a-8f53-305e99182347`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:21:53,014::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:21:53,016::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:21:53,017::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a6d82638-b34f-497a-8f53-305e99182347`::Granted request >Thread-7083::DEBUG::2014-07-08 17:21:53,019::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`38eec0a1-3d4b-4c51-a92f-5298e8f837f1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:21:53,020::task::993::Storage.TaskManager.Task::(_decref) Task=`38eec0a1-3d4b-4c51-a92f-5298e8f837f1`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:21:53,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:53,051::task::1191::Storage.TaskManager.Task::(prepare) Task=`38eec0a1-3d4b-4c51-a92f-5298e8f837f1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:21:53,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`38eec0a1-3d4b-4c51-a92f-5298e8f837f1`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:21:53,052::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:21:53,052::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:21:53,053::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:21:53,053::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:21:53,053::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:21:53,053::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:21:53,054::task::993::Storage.TaskManager.Task::(_decref) Task=`38eec0a1-3d4b-4c51-a92f-5298e8f837f1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:21:55,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:55,209::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:55,212::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:21:55,214::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:21:55,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0202099 s, 50.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:21:55,299::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:21:55,301::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:21:57,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:57,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172632 s, 59.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:57,813::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:57,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:57,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:57,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:57,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:57,815::__init__::225::IOProcess::(_processLogs) (274690) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:57,815::__init__::225::IOProcess::(_processLogs) (274690) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:57,815::__init__::225::IOProcess::(_processLogs) (274690) Building response >Thread-18::DEBUG::2014-07-08 17:21:57,816::__init__::225::IOProcess::(_processLogs) (274690) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:57,816::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:57,816::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:21:57,818::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:21:57,983::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00075259 s, 614 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:21:57,989::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:21:57,991::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:57,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:57,995::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:57,997::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:57,999::__init__::225::IOProcess::(_processLogs) (274691) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:21:58,001::__init__::225::IOProcess::(_processLogs) (274691) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:21:58,002::__init__::225::IOProcess::(_processLogs) (274691) Building response >Thread-18::DEBUG::2014-07-08 17:21:58,004::__init__::225::IOProcess::(_processLogs) (274691) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:58,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:58,007::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:21:58,015::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:21:58,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:58,018::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:21:58,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:58,020::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:58,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:58,024::__init__::225::IOProcess::(_processLogs) (274692) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:58,026::__init__::225::IOProcess::(_processLogs) (274692) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:58,028::__init__::225::IOProcess::(_processLogs) (274692) Building response >Thread-18::DEBUG::2014-07-08 17:21:58,029::__init__::225::IOProcess::(_processLogs) (274692) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:58,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:58,033::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:58,038::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:21:58,039::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:58,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:58,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:58,043::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:58,044::__init__::225::IOProcess::(_processLogs) (274693) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:58,045::__init__::225::IOProcess::(_processLogs) (274693) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:58,047::__init__::225::IOProcess::(_processLogs) (274693) Building response >Thread-18::DEBUG::2014-07-08 17:21:58,048::__init__::225::IOProcess::(_processLogs) (274693) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:58,049::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:58,051::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:21:58,055::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:21:58,056::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:21:58,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:21:58,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:21:58,057::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:21:58,058::__init__::225::IOProcess::(_processLogs) (274694) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:21:58,058::__init__::225::IOProcess::(_processLogs) (274694) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:21:58,060::__init__::225::IOProcess::(_processLogs) (274694) Building response >Thread-18::DEBUG::2014-07-08 17:21:58,062::__init__::225::IOProcess::(_processLogs) (274694) Queuing response >Thread-18::DEBUG::2014-07-08 17:21:58,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:21:58,065::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:21:59,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:21:59,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174549 s, 58.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:00,218::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:00,219::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:00,221::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:22:00,303::task::595::Storage.TaskManager.Task::(_updateState) Task=`c461667e-9832-4e7d-aabf-92fe9fa9d489`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:00,303::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:22:00,305::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075259', 'lastCheck': '2.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:22:00,305::task::1191::Storage.TaskManager.Task::(prepare) Task=`c461667e-9832-4e7d-aabf-92fe9fa9d489`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075259', 'lastCheck': '2.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:22:00,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`c461667e-9832-4e7d-aabf-92fe9fa9d489`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:00,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:00,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:00,306::task::993::Storage.TaskManager.Task::(_decref) Task=`c461667e-9832-4e7d-aabf-92fe9fa9d489`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:22:00,338::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:22:01,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:02,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182566 s, 56.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:22:03,009::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7082::DEBUG::2014-07-08 17:22:03,068::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:22:03,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`1edb8a2e-0990-42d3-bad8-17075557563c`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:03,070::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:22:03,085::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:03,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`1edb8a2e-0990-42d3-bad8-17075557563c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:03,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`1edb8a2e-0990-42d3-bad8-17075557563c`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:03,086::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:03,086::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:03,086::task::993::Storage.TaskManager.Task::(_decref) Task=`1edb8a2e-0990-42d3-bad8-17075557563c`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:22:03,101::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:22:03,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a1f160a-aa64-4f0e-8d36-b4fa9d42a933`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:22:03,102::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:22:03,103::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a4d364e8-265a-4851-bb35-a4466ee80e5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:22:03,103::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:22:03,104::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:22:03,104::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a4d364e8-265a-4851-bb35-a4466ee80e5f`::Granted request >Thread-7083::DEBUG::2014-07-08 17:22:03,105::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0a1f160a-aa64-4f0e-8d36-b4fa9d42a933`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:22:03,105::task::993::Storage.TaskManager.Task::(_decref) Task=`0a1f160a-aa64-4f0e-8d36-b4fa9d42a933`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:22:03,124::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:03,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a1f160a-aa64-4f0e-8d36-b4fa9d42a933`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:03,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a1f160a-aa64-4f0e-8d36-b4fa9d42a933`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:22:03,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:22:03,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:22:03,126::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:22:03,126::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:22:03,126::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:22:03,126::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:22:03,127::task::993::Storage.TaskManager.Task::(_decref) Task=`0a1f160a-aa64-4f0e-8d36-b4fa9d42a933`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:22:04,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:04,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377471 s, 27.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:05,228::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:05,230::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:05,231::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:22:06,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:06,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0967833 s, 10.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:22:08,072::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:08,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:08,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:08,074::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:08,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:08,074::__init__::225::IOProcess::(_processLogs) (274695) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:08,075::__init__::225::IOProcess::(_processLogs) (274695) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:08,075::__init__::225::IOProcess::(_processLogs) (274695) Building response >Thread-18::DEBUG::2014-07-08 17:22:08,076::__init__::225::IOProcess::(_processLogs) (274695) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:08,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:08,076::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:22:08,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:22:08,229::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000471836 s, 979 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:22:08,235::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:08,237::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:08,238::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:08,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:08,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:08,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:08,244::__init__::225::IOProcess::(_processLogs) (274696) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:08,246::__init__::225::IOProcess::(_processLogs) (274696) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:08,247::__init__::225::IOProcess::(_processLogs) (274696) Building response >Thread-18::DEBUG::2014-07-08 17:22:08,248::__init__::225::IOProcess::(_processLogs) (274696) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:08,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:08,251::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:22:08,260::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:22:08,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:08,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:08,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:08,267::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:08,268::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:08,269::__init__::225::IOProcess::(_processLogs) (274697) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:08,270::__init__::225::IOProcess::(_processLogs) (274697) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:08,272::__init__::225::IOProcess::(_processLogs) (274697) Building response >Thread-18::DEBUG::2014-07-08 17:22:08,273::__init__::225::IOProcess::(_processLogs) (274697) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:08,275::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:08,276::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:08,282::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:22:08,283::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:08,284::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:08,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:08,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:08,290::__init__::225::IOProcess::(_processLogs) (274698) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:08,291::__init__::225::IOProcess::(_processLogs) (274698) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:08,293::__init__::225::IOProcess::(_processLogs) (274698) Building response >Thread-18::DEBUG::2014-07-08 17:22:08,295::__init__::225::IOProcess::(_processLogs) (274698) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:08,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:08,298::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:08,304::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:22:08,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:08,307::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:08,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:08,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:08,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:08,315::__init__::225::IOProcess::(_processLogs) (274699) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:08,317::__init__::225::IOProcess::(_processLogs) (274699) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:08,318::__init__::225::IOProcess::(_processLogs) (274699) Building response >Thread-18::DEBUG::2014-07-08 17:22:08,320::__init__::225::IOProcess::(_processLogs) (274699) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:08,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:08,322::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:22:08,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:09,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017304 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:10,238::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:10,240::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:10,241::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:22:10,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`22d31ce4-3b85-46b2-a73d-997c5c4b03a3`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:22:10,314::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:22:10,316::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:10,316::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:22:10,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:10,317::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:10,317::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:10,317::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:10,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:10,318::__init__::225::IOProcess::(_processLogs) (274700) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:22:10,318::__init__::225::IOProcess::(_processLogs) (274700) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:22:10,318::__init__::225::IOProcess::(_processLogs) (274700) Building response >Thread-18::DEBUG::2014-07-08 17:22:10,319::__init__::225::IOProcess::(_processLogs) (274700) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:10,319::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:10,319::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:22:10,321::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:10,321::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:22:10,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:10,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:10,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:10,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:10,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:10,323::__init__::225::IOProcess::(_processLogs) (274701) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:22:10,323::__init__::225::IOProcess::(_processLogs) (274701) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:22:10,323::__init__::225::IOProcess::(_processLogs) (274701) Building response >Thread-18::DEBUG::2014-07-08 17:22:10,323::__init__::225::IOProcess::(_processLogs) (274701) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:10,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:10,324::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:22:10,325::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:22:10,325::task::1191::Storage.TaskManager.Task::(prepare) Task=`22d31ce4-3b85-46b2-a73d-997c5c4b03a3`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:22:10,326::task::595::Storage.TaskManager.Task::(_updateState) Task=`22d31ce4-3b85-46b2-a73d-997c5c4b03a3`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:22:10,326::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:22:10,326::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:22:10,326::task::993::Storage.TaskManager.Task::(_decref) Task=`22d31ce4-3b85-46b2-a73d-997c5c4b03a3`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:22:10,411::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:22:10,412::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:22:11,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:11,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173747 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:22:13,143::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:22:13,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`68e8b5b0-a067-4e3a-8132-8bcbf0905465`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:13,145::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:22:13,159::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:13,160::task::1191::Storage.TaskManager.Task::(prepare) Task=`68e8b5b0-a067-4e3a-8132-8bcbf0905465`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:13,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`68e8b5b0-a067-4e3a-8132-8bcbf0905465`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:13,160::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:13,161::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:13,161::task::993::Storage.TaskManager.Task::(_decref) Task=`68e8b5b0-a067-4e3a-8132-8bcbf0905465`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:22:13,175::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:22:13,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`05e80f4a-f919-4392-916c-58ad6922d714`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:22:13,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:22:13,178::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`354f0810-1a5a-462a-8675-03b75f44bca1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:22:13,178::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:22:13,178::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:22:13,179::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`354f0810-1a5a-462a-8675-03b75f44bca1`::Granted request >Thread-7083::DEBUG::2014-07-08 17:22:13,183::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`05e80f4a-f919-4392-916c-58ad6922d714`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:22:13,184::task::993::Storage.TaskManager.Task::(_decref) Task=`05e80f4a-f919-4392-916c-58ad6922d714`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:22:13,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:13,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`05e80f4a-f919-4392-916c-58ad6922d714`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:13,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`05e80f4a-f919-4392-916c-58ad6922d714`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:22:13,203::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:22:13,204::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:22:13,204::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:22:13,205::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:22:13,205::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:22:13,205::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:22:13,205::task::993::Storage.TaskManager.Task::(_decref) Task=`05e80f4a-f919-4392-916c-58ad6922d714`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:22:13,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:13,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172953 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:15,248::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:15,249::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:15,250::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:22:15,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`fafc972c-22a6-427d-9bc6-0967ba42b716`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:15,457::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:22:15,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471836', 'lastCheck': '7.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:22:15,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`fafc972c-22a6-427d-9bc6-0967ba42b716`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471836', 'lastCheck': '7.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:22:15,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`fafc972c-22a6-427d-9bc6-0967ba42b716`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:15,459::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:15,459::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:15,459::task::993::Storage.TaskManager.Task::(_decref) Task=`fafc972c-22a6-427d-9bc6-0967ba42b716`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:22:15,493::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:22:15,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:15,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171716 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:22:17,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:18,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175945 s, 58.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:22:18,329::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:18,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:18,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:18,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:18,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:18,330::__init__::225::IOProcess::(_processLogs) (274702) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:18,331::__init__::225::IOProcess::(_processLogs) (274702) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:18,331::__init__::225::IOProcess::(_processLogs) (274702) Building response >Thread-18::DEBUG::2014-07-08 17:22:18,331::__init__::225::IOProcess::(_processLogs) (274702) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:18,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:18,332::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:22:18,333::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:22:18,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000467087 s, 989 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:22:18,502::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:18,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:18,509::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:18,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:18,518::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:18,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:18,527::__init__::225::IOProcess::(_processLogs) (274703) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:18,532::__init__::225::IOProcess::(_processLogs) (274703) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:18,536::__init__::225::IOProcess::(_processLogs) (274703) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:18,540::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:18,544::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:22:18,575::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:22:18,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:18,589::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:18,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:18,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:18,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:18,598::__init__::225::IOProcess::(_processLogs) (274704) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:18,600::__init__::225::IOProcess::(_processLogs) (274704) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:18,602::__init__::225::IOProcess::(_processLogs) (274704) Building response >Thread-18::DEBUG::2014-07-08 17:22:18,603::__init__::225::IOProcess::(_processLogs) (274704) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:18,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:18,606::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:18,612::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:22:18,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:18,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:18,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:18,618::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:18,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:18,622::__init__::225::IOProcess::(_processLogs) (274705) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:18,623::__init__::225::IOProcess::(_processLogs) (274705) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:18,625::__init__::225::IOProcess::(_processLogs) (274705) Building response >Thread-18::DEBUG::2014-07-08 17:22:18,626::__init__::225::IOProcess::(_processLogs) (274705) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:18,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:18,629::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:18,635::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:18,636::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:22:18,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:18,639::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:18,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:18,643::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:18,645::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:18,646::__init__::225::IOProcess::(_processLogs) (274706) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:18,647::__init__::225::IOProcess::(_processLogs) (274706) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:18,648::__init__::225::IOProcess::(_processLogs) (274706) Building response >Thread-18::DEBUG::2014-07-08 17:22:18,650::__init__::225::IOProcess::(_processLogs) (274706) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:18,651::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:18,653::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:22:20,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:20,307::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:20,314::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:20,315::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:22:20,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175577 s, 58.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:22:22,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:22,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017283 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:22:23,235::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:22:23,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5757632-9699-4756-86bd-f9eabfcbcf60`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:23,237::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:22:23,252::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:23,253::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5757632-9699-4756-86bd-f9eabfcbcf60`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:23,253::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5757632-9699-4756-86bd-f9eabfcbcf60`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:23,253::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:23,253::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:23,254::task::993::Storage.TaskManager.Task::(_decref) Task=`e5757632-9699-4756-86bd-f9eabfcbcf60`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:22:23,282::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:22:23,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`970002a0-3d0b-47e1-916e-a2fc807e1bca`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:22:23,284::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:22:23,285::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`17ba6518-4969-4cd0-a4f1-62e3cb6b9981`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:22:23,285::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:22:23,285::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:22:23,286::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`17ba6518-4969-4cd0-a4f1-62e3cb6b9981`::Granted request >Thread-7083::DEBUG::2014-07-08 17:22:23,286::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`970002a0-3d0b-47e1-916e-a2fc807e1bca`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:22:23,287::task::993::Storage.TaskManager.Task::(_decref) Task=`970002a0-3d0b-47e1-916e-a2fc807e1bca`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:22:23,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:23,306::task::1191::Storage.TaskManager.Task::(prepare) Task=`970002a0-3d0b-47e1-916e-a2fc807e1bca`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:23,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`970002a0-3d0b-47e1-916e-a2fc807e1bca`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:22:23,307::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:22:23,307::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:22:23,307::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:22:23,308::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:22:23,308::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:22:23,308::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:22:23,309::task::993::Storage.TaskManager.Task::(_decref) Task=`970002a0-3d0b-47e1-916e-a2fc807e1bca`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:22:24,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:25,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033752 s, 30.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:25,323::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:25,324::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:25,325::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:22:25,592::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:22:25,592::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:22:27,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:27,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172467 s, 59.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:22:27,404::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [2d807c78] >Thread-7082::DEBUG::2014-07-08 17:22:27,407::vm::3329::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug NIC xml: <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > <mac address="00:1a:4a:16:88:5c"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Thread-7082::DEBUG::2014-07-08 17:22:28,106::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 1 edom: 0 level: 2 message: An error occurred, but the cause is unknown >Thread-7082::ERROR::2014-07-08 17:22:28,108::vm::3334::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug failed >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 3332, in hotplugNic > self._dom.attachDevice(nicXml) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 399, in attachDevice > if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) >libvirtError: An error occurred, but the cause is unknown >Thread-7082::DEBUG::2014-07-08 17:22:28,110::BindingXMLRPC::1114::vds::(wrapper) return vmHotplugNic with {'status': {'message': 'An error occurred, but the cause is unknown', 'code': 49}} >Thread-18::DEBUG::2014-07-08 17:22:28,659::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:28,659::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:28,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:28,660::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:28,660::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:28,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:28,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:28,661::__init__::225::IOProcess::(_processLogs) (274707) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:28,661::__init__::225::IOProcess::(_processLogs) (274707) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:28,661::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274707) Building response >Thread-18::DEBUG::2014-07-08 17:22:28,662::__init__::225::IOProcess::(_processLogs) (274707) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:28,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:28,662::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:22:28,664::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:22:28,820::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00195188 s, 237 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:22:28,826::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:28,828::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:28,829::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:28,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:28,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:28,833::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:28,835::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:28,836::__init__::225::IOProcess::(_processLogs) (274708) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:28,837::__init__::225::IOProcess::(_processLogs) (274708) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:28,838::__init__::225::IOProcess::(_processLogs) (274708) Building response >Thread-18::DEBUG::2014-07-08 17:22:28,839::__init__::225::IOProcess::(_processLogs) (274708) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:28,841::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:28,842::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:22:28,851::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:28,853::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:22:28,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:28,856::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:28,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:28,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:28,860::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:28,862::__init__::225::IOProcess::(_processLogs) (274709) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:28,863::__init__::225::IOProcess::(_processLogs) (274709) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:28,864::__init__::225::IOProcess::(_processLogs) (274709) Building response >Thread-18::DEBUG::2014-07-08 17:22:28,865::__init__::225::IOProcess::(_processLogs) (274709) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:28,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:28,868::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:28,873::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:28,874::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:22:28,876::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:28,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:28,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:28,880::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:28,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:28,883::__init__::225::IOProcess::(_processLogs) (274710) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:28,884::__init__::225::IOProcess::(_processLogs) (274710) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:28,885::__init__::225::IOProcess::(_processLogs) (274710) Building response >Thread-18::DEBUG::2014-07-08 17:22:28,887::__init__::225::IOProcess::(_processLogs) (274710) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:28,888::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:28,890::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:28,894::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:28,895::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:22:28,897::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:28,898::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:28,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:28,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:28,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:28,903::__init__::225::IOProcess::(_processLogs) (274711) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:28,905::__init__::225::IOProcess::(_processLogs) (274711) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:28,906::__init__::225::IOProcess::(_processLogs) (274711) Building response >Thread-18::DEBUG::2014-07-08 17:22:28,907::__init__::225::IOProcess::(_processLogs) (274711) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:28,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:28,909::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:22:29,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:29,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175384 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:30,332::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:30,334::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:30,335::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:22:30,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d963eee-c50f-4587-9e64-f24f1b4acb2d`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:30,668::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:22:30,668::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00195188', 'lastCheck': '1.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:22:30,668::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d963eee-c50f-4587-9e64-f24f1b4acb2d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00195188', 'lastCheck': '1.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:22:30,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d963eee-c50f-4587-9e64-f24f1b4acb2d`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:30,669::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:30,669::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:30,669::task::993::Storage.TaskManager.Task::(_decref) Task=`5d963eee-c50f-4587-9e64-f24f1b4acb2d`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:22:30,699::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:22:31,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:31,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0187162 s, 54.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:22:33,302::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7082::DEBUG::2014-07-08 17:22:33,345::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:22:33,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a0ab7e5-5c6f-4480-a567-7736bf2091d8`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:33,347::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:22:33,362::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:33,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a0ab7e5-5c6f-4480-a567-7736bf2091d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:33,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a0ab7e5-5c6f-4480-a567-7736bf2091d8`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:33,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:33,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:33,363::task::993::Storage.TaskManager.Task::(_decref) Task=`9a0ab7e5-5c6f-4480-a567-7736bf2091d8`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:22:33,421::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:22:33,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`aefdfe8b-0989-4641-a0f6-05ce62c32eb9`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:22:33,422::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:22:33,423::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9fbc0f5d-980e-429c-9f39-d60fae9584f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:22:33,424::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:22:33,424::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:22:33,424::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9fbc0f5d-980e-429c-9f39-d60fae9584f0`::Granted request >Thread-7083::DEBUG::2014-07-08 17:22:33,425::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`aefdfe8b-0989-4641-a0f6-05ce62c32eb9`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:22:33,425::task::993::Storage.TaskManager.Task::(_decref) Task=`aefdfe8b-0989-4641-a0f6-05ce62c32eb9`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:22:33,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:33,542::task::1191::Storage.TaskManager.Task::(prepare) Task=`aefdfe8b-0989-4641-a0f6-05ce62c32eb9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:33,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`aefdfe8b-0989-4641-a0f6-05ce62c32eb9`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:22:33,542::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:22:33,542::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:22:33,543::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:22:33,544::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:22:33,544::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:22:33,544::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:22:33,545::task::993::Storage.TaskManager.Task::(_decref) Task=`aefdfe8b-0989-4641-a0f6-05ce62c32eb9`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:22:33,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:34,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178722 s, 57.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:35,343::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:35,344::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:35,345::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:22:36,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:36,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177904 s, 57.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:22:38,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:38,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175102 s, 58.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:22:38,917::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:38,918::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:38,918::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:38,921::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:38,922::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:38,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:38,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:38,922::__init__::225::IOProcess::(_processLogs) (274712) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:38,923::__init__::225::IOProcess::(_processLogs) (274712) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:38,923::__init__::225::IOProcess::(_processLogs) (274712) Building response >Thread-18::DEBUG::2014-07-08 17:22:38,923::__init__::225::IOProcess::(_processLogs) (274712) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:38,923::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:38,924::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:22:38,925::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:22:39,172::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00057436 s, 804 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:22:39,187::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:39,189::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:39,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:39,199::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:39,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:39,206::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:39,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:39,212::__init__::225::IOProcess::(_processLogs) (274713) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:39,215::__init__::225::IOProcess::(_processLogs) (274713) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:39,218::__init__::225::IOProcess::(_processLogs) (274713) Building response >Thread-18::DEBUG::2014-07-08 17:22:39,221::__init__::225::IOProcess::(_processLogs) (274713) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:39,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:39,229::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:22:39,244::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:39,244::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:22:39,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:39,245::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:39,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:39,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:39,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:39,247::__init__::225::IOProcess::(_processLogs) (274714) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:39,247::__init__::225::IOProcess::(_processLogs) (274714) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:39,247::__init__::225::IOProcess::(_processLogs) (274714) Building response >Thread-18::DEBUG::2014-07-08 17:22:39,248::__init__::225::IOProcess::(_processLogs) (274714) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:39,248::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:39,249::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:39,263::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:39,267::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:22:39,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:39,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:39,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:39,290::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:39,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:39,295::__init__::225::IOProcess::(_processLogs) (274715) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:39,296::__init__::225::IOProcess::(_processLogs) (274715) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:39,298::__init__::225::IOProcess::(_processLogs) (274715) Building response >Thread-18::DEBUG::2014-07-08 17:22:39,299::__init__::225::IOProcess::(_processLogs) (274715) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:39,300::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:39,301::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:39,307::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:39,308::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:22:39,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:39,312::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:39,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:39,314::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:39,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:39,317::__init__::225::IOProcess::(_processLogs) (274716) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:39,318::__init__::225::IOProcess::(_processLogs) (274716) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:39,320::__init__::225::IOProcess::(_processLogs) (274716) Building response >Thread-18::DEBUG::2014-07-08 17:22:39,321::__init__::225::IOProcess::(_processLogs) (274716) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:39,322::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:39,324::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:40,353::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:40,354::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:40,355::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:22:40,630::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:22:40,630::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:22:40,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:40,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0189815 s, 53.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:22:42,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:43,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0183359 s, 55.8 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:22:43,571::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:22:43,572::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bffe68a-ae2c-404d-8bbd-96aec03c779b`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:43,573::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:22:43,589::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:43,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`8bffe68a-ae2c-404d-8bbd-96aec03c779b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:43,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bffe68a-ae2c-404d-8bbd-96aec03c779b`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:43,590::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:43,590::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:43,590::task::993::Storage.TaskManager.Task::(_decref) Task=`8bffe68a-ae2c-404d-8bbd-96aec03c779b`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:22:43,602::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:22:43,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9d5db73-1973-459c-8e06-fa40fc74c1cb`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:22:43,603::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:22:43,604::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3e13cdd4-27fb-4347-969b-5c06aa831bfe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:22:43,604::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:22:43,605::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:22:43,605::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3e13cdd4-27fb-4347-969b-5c06aa831bfe`::Granted request >Thread-7083::DEBUG::2014-07-08 17:22:43,605::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b9d5db73-1973-459c-8e06-fa40fc74c1cb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:22:43,606::task::993::Storage.TaskManager.Task::(_decref) Task=`b9d5db73-1973-459c-8e06-fa40fc74c1cb`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:22:43,625::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:43,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9d5db73-1973-459c-8e06-fa40fc74c1cb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:43,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9d5db73-1973-459c-8e06-fa40fc74c1cb`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:22:43,626::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:22:43,626::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:22:43,626::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:22:43,627::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:22:43,627::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:22:43,627::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:22:43,628::task::993::Storage.TaskManager.Task::(_decref) Task=`b9d5db73-1973-459c-8e06-fa40fc74c1cb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:22:45,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:45,399::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:45,407::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:45,423::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:22:45,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0582286 s, 17.6 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:22:45,826::task::595::Storage.TaskManager.Task::(_updateState) Task=`0199eb5b-0dde-4d7b-8183-12611c128cd0`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:45,827::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:22:45,827::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057436', 'lastCheck': '6.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:22:45,828::task::1191::Storage.TaskManager.Task::(prepare) Task=`0199eb5b-0dde-4d7b-8183-12611c128cd0`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057436', 'lastCheck': '6.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:22:45,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`0199eb5b-0dde-4d7b-8183-12611c128cd0`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:45,828::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:45,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:45,829::task::993::Storage.TaskManager.Task::(_decref) Task=`0199eb5b-0dde-4d7b-8183-12611c128cd0`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:22:45,861::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:22:47,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:47,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176091 s, 58.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-08 17:22:49,328::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:22:49,333::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,333::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 17:22:49,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,334::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,337::__init__::225::IOProcess::(_processLogs) (274717) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:22:49,341::__init__::225::IOProcess::(_processLogs) (274717) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:22:49,342::__init__::225::IOProcess::(_processLogs) (274717) Building response >Thread-18::DEBUG::2014-07-08 17:22:49,342::__init__::225::IOProcess::(_processLogs) (274717) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:49,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:49,343::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:22:49,345::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,345::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:22:49,346::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,346::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,346::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,347::__init__::225::IOProcess::(_processLogs) (274718) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:22:49,347::__init__::225::IOProcess::(_processLogs) (274718) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:22:49,347::__init__::225::IOProcess::(_processLogs) (274718) Building response >Thread-18::DEBUG::2014-07-08 17:22:49,347::__init__::225::IOProcess::(_processLogs) (274718) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:49,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:49,348::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:22:49,349::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,350::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:22:49,350::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,350::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,351::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,351::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,351::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,351::__init__::225::IOProcess::(_processLogs) (274719) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:22:49,352::__init__::225::IOProcess::(_processLogs) (274719) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:22:49,352::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274719) Building response >Thread-18::DEBUG::2014-07-08 17:22:49,352::__init__::225::IOProcess::(_processLogs) (274719) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:49,352::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:49,353::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 17:22:49,354::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,355::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 17:22:49,357::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,359::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,363::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,364::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,366::__init__::225::IOProcess::(_processLogs) (274720) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:22:49,368::__init__::225::IOProcess::(_processLogs) (274720) Got request for method 'glob' >Thread-37::DEBUG::2014-07-08 17:22:49,370::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:22:49,370::__init__::225::IOProcess::(_processLogs) (274720) Building response >Thread-18::DEBUG::2014-07-08 17:22:49,372::__init__::225::IOProcess::(_processLogs) (274720) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:49,372::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:49,372::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 17:22:49,374::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,374::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 17:22:49,374::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,375::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,376::__init__::225::IOProcess::(_processLogs) (274721) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 17:22:49,376::__init__::225::IOProcess::(_processLogs) (274721) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 17:22:49,376::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274721) Building response >Thread-18::DEBUG::2014-07-08 17:22:49,376::__init__::225::IOProcess::(_processLogs) (274721) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:49,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:49,377::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 17:22:49,378::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 17:22:49,379::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,379::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 17:22:49,379::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,380::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,380::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,380::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,381::__init__::225::IOProcess::(_processLogs) (274722) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 17:22:49,381::__init__::225::IOProcess::(_processLogs) (274722) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 17:22:49,381::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(274722) Building response >Thread-18::DEBUG::2014-07-08 17:22:49,381::__init__::225::IOProcess::(_processLogs) (274722) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:49,382::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:49,382::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 17:22:49,383::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 17:22:49,384::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,387::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 17:22:49,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,390::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,393::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,396::__init__::225::IOProcess::(_processLogs) (274723) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:49,397::__init__::225::IOProcess::(_processLogs) (274723) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:49,399::__init__::225::IOProcess::(_processLogs) (274723) Building response >Thread-18::DEBUG::2014-07-08 17:22:49,400::__init__::225::IOProcess::(_processLogs) (274723) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:49,402::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:49,403::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:49,409::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,410::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 17:22:49,411::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,418::__init__::225::IOProcess::(_processLogs) (274724) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:22:49,419::__init__::225::IOProcess::(_processLogs) (274724) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:22:49,420::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|(274724) Building response >Thread-18::DEBUG::2014-07-08 17:22:49,421::__init__::225::IOProcess::(_processLogs) (274724) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:49,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:49,424::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-37::DEBUG::2014-07-08 17:22:49,428::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-37::INFO::2014-07-08 17:22:49,434::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 17:22:49,435::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 17:22:49,438::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,438::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:49,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,440::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,450::__init__::225::IOProcess::(_processLogs) (274725) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:49,452::__init__::225::IOProcess::(_processLogs) (274725) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:49,453::__init__::225::IOProcess::(_processLogs) (274725) Building response >Thread-18::DEBUG::2014-07-08 17:22:49,455::__init__::225::IOProcess::(_processLogs) (274725) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:49,456::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:49,458::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:22:49,465::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:22:49,624::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000470159 s, 983 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:22:49,749::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:49,760::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:22:49,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:49,775::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:49,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:49,787::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:49,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:49,795::__init__::225::IOProcess::(_processLogs) (274726) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:22:49,799::__init__::225::IOProcess::(_processLogs) (274726) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:22:49,894::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|(274726) Building response >Dummy-6860::DEBUG::2014-07-08 17:22:49,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:22:49,899::__init__::225::IOProcess::(_processLogs) (274726) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:50,209::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:50,224::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:22:50,258::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:50,263::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:22:50,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:50,270::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:50,273::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:50,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:50,279::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:50,282::__init__::225::IOProcess::(_processLogs) (274727) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:50,285::__init__::225::IOProcess::(_processLogs) (274727) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:50,288::__init__::225::IOProcess::(_processLogs) (274727) Building response >Thread-18::DEBUG::2014-07-08 17:22:50,291::__init__::225::IOProcess::(_processLogs) (274727) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:50,294::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:50,297::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:50,373::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Dummy-6860::DEBUG::2014-07-08 17:22:50,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100697 s, 10.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:22:50,376::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:22:50,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:50,381::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:50,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:50,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:50,388::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:50,391::__init__::225::IOProcess::(_processLogs) (274728) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:50,393::__init__::225::IOProcess::(_processLogs) (274728) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:50,396::__init__::225::IOProcess::(_processLogs) (274728) Building response >Thread-18::DEBUG::2014-07-08 17:22:50,398::__init__::225::IOProcess::(_processLogs) (274728) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:50,401::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:50,403::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:22:50,412::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:22:50,413::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:22:50,416::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:22:50,418::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:22:50,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:22:50,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:22:50,424::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:22:50,425::__init__::225::IOProcess::(_processLogs) (274729) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:22:50,427::__init__::225::IOProcess::(_processLogs) (274729) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:22:50,430::__init__::225::IOProcess::(_processLogs) (274729) Building response >Thread-18::DEBUG::2014-07-08 17:22:50,433::__init__::225::IOProcess::(_processLogs) (274729) Queuing response >Thread-18::DEBUG::2014-07-08 17:22:50,437::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:22:50,445::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:50,449::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:50,464::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:50,472::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:22:52,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:52,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178203 s, 57.5 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:22:53,642::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:22:53,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`a32c0fa8-237d-47d4-ae11-735fed85fc15`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:22:53,644::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:22:53,659::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:53,659::task::1191::Storage.TaskManager.Task::(prepare) Task=`a32c0fa8-237d-47d4-ae11-735fed85fc15`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:22:53,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`a32c0fa8-237d-47d4-ae11-735fed85fc15`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:22:53,660::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:22:53,660::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:22:53,660::task::993::Storage.TaskManager.Task::(_decref) Task=`a32c0fa8-237d-47d4-ae11-735fed85fc15`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:22:53,672::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:22:53,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`52da647d-c8db-4156-b12d-609de7675c19`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:22:53,673::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:22:53,674::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c3b7a35e-6f54-4242-8c18-b3ddd66ebf09`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:22:53,675::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:22:53,675::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:22:53,675::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`c3b7a35e-6f54-4242-8c18-b3ddd66ebf09`::Granted request >Thread-7083::DEBUG::2014-07-08 17:22:53,676::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`52da647d-c8db-4156-b12d-609de7675c19`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:22:53,676::task::993::Storage.TaskManager.Task::(_decref) Task=`52da647d-c8db-4156-b12d-609de7675c19`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:22:53,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:53,696::task::1191::Storage.TaskManager.Task::(prepare) Task=`52da647d-c8db-4156-b12d-609de7675c19`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:22:53,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`52da647d-c8db-4156-b12d-609de7675c19`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:22:53,696::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:22:53,696::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:22:53,697::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:22:53,697::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:22:53,697::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:22:53,698::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:22:53,698::task::993::Storage.TaskManager.Task::(_decref) Task=`52da647d-c8db-4156-b12d-609de7675c19`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:22:54,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:55,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174934 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:55,488::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:55,491::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:22:55,492::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:22:55,792::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:22:55,793::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:22:57,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:57,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173604 s, 59.0 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:22:59,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:22:59,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175747 s, 58.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:23:00,461::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:00,462::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:00,462::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:00,462::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:00,463::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:00,463::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:00,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:00,463::__init__::225::IOProcess::(_processLogs) (274730) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:00,464::__init__::225::IOProcess::(_processLogs) (274730) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:00,464::__init__::225::IOProcess::(_processLogs) (274730) Building response >Thread-18::DEBUG::2014-07-08 17:23:00,464::__init__::225::IOProcess::(_processLogs) (274730) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:00,464::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:00,465::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:23:00,466::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:00,630::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-37::DEBUG::2014-07-08 17:23:00,630::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000532178 s, 868 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:23:00,738::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:00,739::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:23:00,741::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:00,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:00,749::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:00,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:00,751::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:23:00,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:00,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:00,756::__init__::225::IOProcess::(_processLogs) (274731) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:00,758::__init__::225::IOProcess::(_processLogs) (274731) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:00,760::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|(274731) Building response >Thread-18::DEBUG::2014-07-08 17:23:00,761::__init__::225::IOProcess::(_processLogs) (274731) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:00,763::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:00,764::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:23:00,772::__init__::225::IOProcess::(_processLogs) Message size is 173DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:00,773::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:23:00,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:00,773::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:00,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:00,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:00,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:00,775::__init__::225::IOProcess::(_processLogs) (274732) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:00,775::__init__::225::IOProcess::(_processLogs) (274732) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:00,776::__init__::225::IOProcess::(_processLogs) (274732) Building response >Thread-18::DEBUG::2014-07-08 17:23:00,776::__init__::225::IOProcess::(_processLogs) (274732) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:00,777::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:00,777::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:00,781::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:00,782::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:23:00,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:00,786::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:00,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:00,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:00,792::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:00,794::__init__::225::IOProcess::(_processLogs) (274733) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:00,797::__init__::225::IOProcess::(_processLogs) (274733) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:00,798::__init__::225::IOProcess::(_processLogs) (274733) Building response >Thread-18::DEBUG::2014-07-08 17:23:00,800::__init__::225::IOProcess::(_processLogs) (274733) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:00,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:00,803::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:00,899::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:00,903::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:23:00,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:00,908::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:00,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:00,913::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:00,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:00,918::__init__::225::IOProcess::(_processLogs) (274734) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:00,920::__init__::225::IOProcess::(_processLogs) (274734) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:00,923::__init__::225::IOProcess::(_processLogs) (274734) Building response >Thread-18::DEBUG::2014-07-08 17:23:00,925::__init__::225::IOProcess::(_processLogs) (274734) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:00,927::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:00,929::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:23:01,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`77cfa4f0-08ab-44a2-bacd-6858d56fc0c0`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:01,065::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:23:01,065::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532178', 'lastCheck': '0.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:23:01,066::task::1191::Storage.TaskManager.Task::(prepare) Task=`77cfa4f0-08ab-44a2-bacd-6858d56fc0c0`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532178', 'lastCheck': '0.1', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:23:01,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`77cfa4f0-08ab-44a2-bacd-6858d56fc0c0`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:01,066::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:01,066::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:01,067::task::993::Storage.TaskManager.Task::(_decref) Task=`77cfa4f0-08ab-44a2-bacd-6858d56fc0c0`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:23:01,097::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:01,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:01,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174068 s, 58.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:23:03,621::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7082::DEBUG::2014-07-08 17:23:03,711::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:23:03,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0164514-a7a5-499c-903b-aac5154ca944`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:03,713::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:23:03,728::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:03,728::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0164514-a7a5-499c-903b-aac5154ca944`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:03,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0164514-a7a5-499c-903b-aac5154ca944`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:03,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:03,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:03,729::task::993::Storage.TaskManager.Task::(_decref) Task=`d0164514-a7a5-499c-903b-aac5154ca944`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:23:03,743::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:23:03,744::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eeef0a0-34b8-4ceb-8e8e-8744784be581`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:23:03,744::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:23:03,745::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`087b5275-156e-4053-9fd8-8497d5450ba7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:23:03,745::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:23:03,746::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:23:03,746::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`087b5275-156e-4053-9fd8-8497d5450ba7`::Granted request >Thread-7083::DEBUG::2014-07-08 17:23:03,747::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4eeef0a0-34b8-4ceb-8e8e-8744784be581`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:23:03,747::task::993::Storage.TaskManager.Task::(_decref) Task=`4eeef0a0-34b8-4ceb-8e8e-8744784be581`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:23:03,766::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:03,766::task::1191::Storage.TaskManager.Task::(prepare) Task=`4eeef0a0-34b8-4ceb-8e8e-8744784be581`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:03,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eeef0a0-34b8-4ceb-8e8e-8744784be581`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:23:03,767::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:23:03,767::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:23:03,768::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:23:03,768::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:23:03,768::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:23:03,769::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:23:03,769::task::993::Storage.TaskManager.Task::(_decref) Task=`4eeef0a0-34b8-4ceb-8e8e-8744784be581`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:23:03,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:04,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173755 s, 58.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:05,763::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:05,764::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:05,766::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:06,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:06,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387609 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:23:08,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:08,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173149 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:10,772::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:10,774::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:10,775::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:10,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7086::DEBUG::2014-07-08 17:23:10,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac821230-acbb-4f38-b06d-1d779ffbd714`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:23:10,950::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:23:10,951::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:10,953::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:10,954::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:10,955::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:10,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:10,958::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:10,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:10,961::__init__::225::IOProcess::(_processLogs) (274735) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:10,962::__init__::225::IOProcess::(_processLogs) (274735) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:10,963::__init__::225::IOProcess::(_processLogs) (274735) Building response >Thread-18::DEBUG::2014-07-08 17:23:10,964::__init__::225::IOProcess::(_processLogs) (274735) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:10,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:10,966::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:23:10,973::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-37::DEBUG::2014-07-08 17:23:10,975::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-18::DEBUG::2014-07-08 17:23:10,977::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:23:11,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-37::DEBUG::2014-07-08 17:23:11,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000481334 s, 960 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:23:11,145::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:11,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:11,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:11,159::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:11,162::__init__::225::IOProcess::(_processLogs) (274736) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:23:11,164::__init__::225::IOProcess::(_processLogs) (274736) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:23:11,168::__init__::225::IOProcess::(_processLogs) (274736) Building response >Thread-18::DEBUG::2014-07-08 17:23:11,236::__init__::225::IOProcess::(_processLogs) (274736) Queuing response >Dummy-6860::DEBUG::2014-07-08 17:23:11,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.225273 s, 4.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:23:11,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:11,244::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:23:11,261::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:11,263::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:11,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:11,268::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:11,271::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:11,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:11,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:11,278::__init__::225::IOProcess::(_processLogs) (274737) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:11,280::__init__::225::IOProcess::(_processLogs) (274737) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:11,283::__init__::225::IOProcess::(_processLogs) DEBUG|(274737) Building response >Thread-18::DEBUG::2014-07-08 17:23:11,285::__init__::225::IOProcess::(_processLogs) (274737) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:11,287::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:11,289::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:23:11,301::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:11,304::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:23:11,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:11,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:11,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:11,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:11,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:11,319::__init__::225::IOProcess::(_processLogs) (274738) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:23:11,322::__init__::225::IOProcess::(_processLogs) (274738) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:23:11,324::__init__::225::IOProcess::(_processLogs) (274738) Building response >Thread-18::DEBUG::2014-07-08 17:23:11,327::__init__::225::IOProcess::(_processLogs) (274738) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:11,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:11,331::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:23:11,347::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-18::DEBUG::2014-07-08 17:23:11,347::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7086::DEBUG::2014-07-08 17:23:11,352::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac821230-acbb-4f38-b06d-1d779ffbd714`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-18::DEBUG::2014-07-08 17:23:11,353::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7086::DEBUG::2014-07-08 17:23:11,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac821230-acbb-4f38-b06d-1d779ffbd714`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:23:11,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7086::DEBUG::2014-07-08 17:23:11,360::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:23:11,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:23:11,364::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7086::DEBUG::2014-07-08 17:23:11,369::task::993::Storage.TaskManager.Task::(_decref) Task=`ac821230-acbb-4f38-b06d-1d779ffbd714`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:23:11,369::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:11,374::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:11,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:11,378::__init__::225::IOProcess::(_processLogs) (274739) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:11,380::__init__::225::IOProcess::(_processLogs) (274739) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:11,383::__init__::225::IOProcess::(_processLogs) (274739) Building response >Thread-18::DEBUG::2014-07-08 17:23:11,386::__init__::225::IOProcess::(_processLogs) (274739) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:11,387::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:11,389::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:11,400::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:11,403::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:23:11,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:11,496::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:11,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:11,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:11,504::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:11,506::__init__::225::IOProcess::(_processLogs) (274740) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:11,509::__init__::225::IOProcess::(_processLogs) (274740) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:11,511::__init__::225::IOProcess::(_processLogs) (274740) Building response >Thread-18::DEBUG::2014-07-08 17:23:11,519::__init__::225::IOProcess::(_processLogs) (274740) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:11,524::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:11,530::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:11,551::__init__::225::IOProcess::(_processLogs) (274740) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:11,557::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:23:11,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:11,567::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:11,572::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:11,577::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:11,583::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:11,670::__init__::225::IOProcess::(_processLogs) (274741) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:11,678::__init__::225::IOProcess::(_processLogs) (274741) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:11,679::__init__::225::IOProcess::(_processLogs) (274741) Building response >Thread-18::DEBUG::2014-07-08 17:23:11,684::__init__::225::IOProcess::(_processLogs) (274741) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:11,686::__init__::225::IOProcess::(_processLogs) (274740) Finding callback 'access'...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:23:11,688::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:23:11,730::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:23:11,734::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7082::DEBUG::2014-07-08 17:23:13,786::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:23:13,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`83b79651-c6c2-4e7d-95bc-49bcfa5cc6b8`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:13,788::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:23:13,802::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:13,803::task::1191::Storage.TaskManager.Task::(prepare) Task=`83b79651-c6c2-4e7d-95bc-49bcfa5cc6b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:13,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`83b79651-c6c2-4e7d-95bc-49bcfa5cc6b8`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:13,803::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:13,804::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:13,804::task::993::Storage.TaskManager.Task::(_decref) Task=`83b79651-c6c2-4e7d-95bc-49bcfa5cc6b8`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:23:13,816::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:23:13,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9347a75-326f-446f-991b-a0251f6e80e5`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:23:13,817::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:23:13,820::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9a65100f-5813-44f0-b249-b69e6dfb2110`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:23:13,821::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:23:13,821::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:23:13,821::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`9a65100f-5813-44f0-b249-b69e6dfb2110`::Granted request >Thread-7083::DEBUG::2014-07-08 17:23:13,822::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a9347a75-326f-446f-991b-a0251f6e80e5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:23:13,822::task::993::Storage.TaskManager.Task::(_decref) Task=`a9347a75-326f-446f-991b-a0251f6e80e5`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:23:13,841::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:13,842::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9347a75-326f-446f-991b-a0251f6e80e5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:13,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9347a75-326f-446f-991b-a0251f6e80e5`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:23:13,842::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:23:13,842::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:23:13,843::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:23:13,843::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:23:13,843::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:23:13,843::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:23:13,844::task::993::Storage.TaskManager.Task::(_decref) Task=`a9347a75-326f-446f-991b-a0251f6e80e5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:23:13,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:14,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178029 s, 57.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:15,782::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:15,784::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:15,785::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:16,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:23:16,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`e26a4338-322e-45b4-91c3-86796bd1ae31`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:16,295::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:23:16,296::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481334', 'lastCheck': '4.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:23:16,296::task::1191::Storage.TaskManager.Task::(prepare) Task=`e26a4338-322e-45b4-91c3-86796bd1ae31`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481334', 'lastCheck': '4.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:23:16,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`e26a4338-322e-45b4-91c3-86796bd1ae31`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:16,297::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:16,298::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:16,298::task::993::Storage.TaskManager.Task::(_decref) Task=`e26a4338-322e-45b4-91c3-86796bd1ae31`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:23:16,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0523 s, 19.6 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:23:16,426::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:18,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:18,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309635 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:23:20,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:20,864::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:20,865::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:20,867::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:20,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173319 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:23:21,701::__init__::225::IOProcess::(_processLogs) (274740) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:21,702::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:21,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:21,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:21,702::__init__::225::IOProcess::(_processLogs) (274740) Finding callback 'access'...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:21,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:21,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:21,703::__init__::225::IOProcess::(_processLogs) (274742) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:21,703::__init__::225::IOProcess::(_processLogs) (274742) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:21,704::__init__::225::IOProcess::(_processLogs) (274742) Building response >Thread-18::DEBUG::2014-07-08 17:23:21,704::__init__::225::IOProcess::(_processLogs) (274742) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:21,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:21,704::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:23:21,706::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:23:21,854::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000429094 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:23:21,856::__init__::225::IOProcess::(_processLogs) (274740) Finding callback 'access'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:21,857::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:21,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:21,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:21,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:21,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:21,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:21,858::__init__::225::IOProcess::(_processLogs) (274743) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:21,858::__init__::225::IOProcess::(_processLogs) (274743) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:21,859::__init__::225::IOProcess::(_processLogs) (274743) Building response >Thread-18::DEBUG::2014-07-08 17:23:21,859::__init__::225::IOProcess::(_processLogs) (274743) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:21,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:21,859::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:23:21,862::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:23:21,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:21,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:21,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:21,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:21,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:21,863::__init__::225::IOProcess::(_processLogs) (274744) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:21,863::__init__::225::IOProcess::(_processLogs) (274744) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:21,864::__init__::225::IOProcess::(_processLogs) (274744) Building response >Thread-18::DEBUG::2014-07-08 17:23:21,864::__init__::225::IOProcess::(_processLogs) (274744) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:21,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:21,864::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:21,865::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:21,866::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:23:21,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:21,866::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:21,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:21,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:21,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:21,867::__init__::225::IOProcess::(_processLogs) (274745) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:21,867::__init__::225::IOProcess::(_processLogs) (274745) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:21,868::__init__::225::IOProcess::(_processLogs) (274745) Building response >Thread-18::DEBUG::2014-07-08 17:23:21,868::__init__::225::IOProcess::(_processLogs) (274745) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:21,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:21,869::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:21,878::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:21,880::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:23:21,882::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:21,884::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:21,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:21,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:21,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:21,890::__init__::225::IOProcess::(_processLogs) (274746) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:21,891::__init__::225::IOProcess::(_processLogs) (274746) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:21,893::__init__::225::IOProcess::(_processLogs) (274746) Building response >Thread-18::DEBUG::2014-07-08 17:23:21,894::__init__::225::IOProcess::(_processLogs) (274746) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:21,896::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:21,897::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:23:22,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:23,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017299 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:23:23,859::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:23:23,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6f5ddd3-5421-4006-8b4e-3b70466f9af7`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:23,861::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:23:23,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:23,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6f5ddd3-5421-4006-8b4e-3b70466f9af7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:23,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6f5ddd3-5421-4006-8b4e-3b70466f9af7`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:23,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:23,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:23,877::task::993::Storage.TaskManager.Task::(_decref) Task=`f6f5ddd3-5421-4006-8b4e-3b70466f9af7`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:23:23,888::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:23:23,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d2a475c-9868-4b11-9b9d-4a98212faabf`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:23:23,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:23:23,891::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5944867b-90b7-4dad-99da-e876a365a86a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:23:23,891::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:23:23,892::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:23:23,892::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5944867b-90b7-4dad-99da-e876a365a86a`::Granted request >Thread-7083::DEBUG::2014-07-08 17:23:23,892::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2d2a475c-9868-4b11-9b9d-4a98212faabf`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:23:23,893::task::993::Storage.TaskManager.Task::(_decref) Task=`2d2a475c-9868-4b11-9b9d-4a98212faabf`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:23:23,912::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:23,912::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d2a475c-9868-4b11-9b9d-4a98212faabf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:23,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d2a475c-9868-4b11-9b9d-4a98212faabf`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:23:23,913::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:23:23,913::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:23:23,914::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:23:23,914::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:23:23,914::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:23:23,914::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:23:23,915::task::993::Storage.TaskManager.Task::(_decref) Task=`2d2a475c-9868-4b11-9b9d-4a98212faabf`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:23:25,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:25,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0206786 s, 49.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:25,874::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:25,875::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:25,877::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:23:26,880::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:23:26,880::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:23:27,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:27,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897728 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:23:29,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:30,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017625 s, 58.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:30,884::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:30,886::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:30,887::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:23:31,548::task::595::Storage.TaskManager.Task::(_updateState) Task=`e35b9711-6781-4d73-895b-6aa1928abd8b`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:31,548::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:23:31,549::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429094', 'lastCheck': '9.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:23:31,549::task::1191::Storage.TaskManager.Task::(prepare) Task=`e35b9711-6781-4d73-895b-6aa1928abd8b`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429094', 'lastCheck': '9.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:23:31,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`e35b9711-6781-4d73-895b-6aa1928abd8b`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:31,549::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:31,550::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:31,550::task::993::Storage.TaskManager.Task::(_decref) Task=`e35b9711-6781-4d73-895b-6aa1928abd8b`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:23:31,585::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:23:31,904::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:31,905::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:31,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:31,905::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:31,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:31,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:31,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:31,906::__init__::225::IOProcess::(_processLogs) (274747) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:31,906::__init__::225::IOProcess::(_processLogs) (274747) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:31,907::__init__::225::IOProcess::(_processLogs) (274747) Building response >Thread-18::DEBUG::2014-07-08 17:23:31,907::__init__::225::IOProcess::(_processLogs) (274747) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:31,907::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:23:31,908::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:23:31,909::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:23:32,070::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000475468 s, 972 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:23:32,075::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:32,078::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:32,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:32,080::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:32,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:32,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:32,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:32,086::__init__::225::IOProcess::(_processLogs) (274748) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:32,087::__init__::225::IOProcess::(_processLogs) (274748) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:32,089::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274748) Building response >Thread-18::DEBUG::2014-07-08 17:23:32,091::__init__::225::IOProcess::(_processLogs) (274748) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:32,092::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:32,093::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:23:32,103::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:32,105::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:23:32,106::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:32,108::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:32,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:32,111::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:32,113::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:32,114::__init__::225::IOProcess::(_processLogs) (274749) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:32,115::__init__::225::IOProcess::(_processLogs) (274749) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:32,117::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274749) Building response >Thread-18::DEBUG::2014-07-08 17:23:32,119::__init__::225::IOProcess::(_processLogs) (274749) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:32,120::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:32,122::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:32,128::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:32,129::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:23:32,130::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:32,132::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:32,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:32,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:32,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:32,139::__init__::225::IOProcess::(_processLogs) (274750) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:32,141::__init__::225::IOProcess::(_processLogs) (274750) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:32,142::__init__::225::IOProcess::(_processLogs) (274750) Building response >Thread-18::DEBUG::2014-07-08 17:23:32,143::__init__::225::IOProcess::(_processLogs) (274750) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:32,145::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:32,146::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:32,152::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:32,154::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:23:32,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:32,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:32,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:32,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:32,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:32,163::__init__::225::IOProcess::(_processLogs) (274751) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:32,164::__init__::225::IOProcess::(_processLogs) (274751) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:32,166::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(274751) Building response >Thread-18::DEBUG::2014-07-08 17:23:32,167::__init__::225::IOProcess::(_processLogs) (274751) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:32,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:32,170::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:23:32,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:32,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042432 s, 24.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:23:33,736::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7082::DEBUG::2014-07-08 17:23:33,929::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:23:33,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`73e659bf-0c26-4233-bcf7-28eb3ad65941`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:33,931::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:23:33,946::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:33,946::task::1191::Storage.TaskManager.Task::(prepare) Task=`73e659bf-0c26-4233-bcf7-28eb3ad65941`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:33,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`73e659bf-0c26-4233-bcf7-28eb3ad65941`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:33,947::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:33,947::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:33,947::task::993::Storage.TaskManager.Task::(_decref) Task=`73e659bf-0c26-4233-bcf7-28eb3ad65941`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:23:33,959::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:23:33,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`0277e453-7314-4899-8259-d6cff7bfd992`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:23:33,960::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:23:33,961::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e7bae25b-30a7-4e68-80c6-e4a1c75a17d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:23:33,961::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:23:33,962::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:23:33,962::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`e7bae25b-30a7-4e68-80c6-e4a1c75a17d9`::Granted request >Thread-7083::DEBUG::2014-07-08 17:23:33,963::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0277e453-7314-4899-8259-d6cff7bfd992`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:23:33,963::task::993::Storage.TaskManager.Task::(_decref) Task=`0277e453-7314-4899-8259-d6cff7bfd992`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:23:33,982::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:33,983::task::1191::Storage.TaskManager.Task::(prepare) Task=`0277e453-7314-4899-8259-d6cff7bfd992`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:33,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`0277e453-7314-4899-8259-d6cff7bfd992`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:23:33,983::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:23:33,983::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:23:33,984::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:23:33,984::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:23:33,984::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:23:33,985::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:23:33,985::task::993::Storage.TaskManager.Task::(_decref) Task=`0277e453-7314-4899-8259-d6cff7bfd992`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:23:34,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:34,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177554 s, 57.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:35,891::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:35,893::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:35,894::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:36,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:37,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176803 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:23:39,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:39,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247383 s, 41.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:40,901::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:40,903::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:40,904::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:41,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:41,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171453 s, 59.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:23:41,918::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:23:41,919::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:23:42,177::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:42,178::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:42,178::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:42,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:42,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:42,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:42,179::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:42,179::__init__::225::IOProcess::(_processLogs) (274752) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:42,179::__init__::225::IOProcess::(_processLogs) (274752) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:42,180::__init__::225::IOProcess::(_processLogs) (274752) Building response >Thread-18::DEBUG::2014-07-08 17:23:42,180::__init__::225::IOProcess::(_processLogs) (274752) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:42,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:42,180::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:23:42,182::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:23:42,333::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000431887 s, 1.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:23:42,335::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:42,336::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:42,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:42,336::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:42,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:42,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:42,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:42,337::__init__::225::IOProcess::(_processLogs) (274753) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:42,338::__init__::225::IOProcess::(_processLogs) (274753) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:42,338::__init__::225::IOProcess::(_processLogs) (274753) Building response >Thread-18::DEBUG::2014-07-08 17:23:42,338::__init__::225::IOProcess::(_processLogs) (274753) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:42,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:42,339::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:23:42,341::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:42,341::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:23:42,341::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:42,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:42,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:42,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:42,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:42,343::__init__::225::IOProcess::(_processLogs) (274754) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:42,343::__init__::225::IOProcess::(_processLogs) (274754) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:42,343::__init__::225::IOProcess::(_processLogs) (274754) Building response >Thread-18::DEBUG::2014-07-08 17:23:42,343::__init__::225::IOProcess::(_processLogs) (274754) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:42,344::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:42,344::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:42,345::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:42,345::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:23:42,345::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:42,346::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:42,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:42,346::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:42,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:42,347::__init__::225::IOProcess::(_processLogs) (274755) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:42,347::__init__::225::IOProcess::(_processLogs) (274755) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:42,347::__init__::225::IOProcess::(_processLogs) (274755) Building response >Thread-18::DEBUG::2014-07-08 17:23:42,347::__init__::225::IOProcess::(_processLogs) (274755) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:42,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:42,348::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:42,349::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:42,349::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:23:42,349::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:42,350::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:42,350::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:42,350::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:42,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:42,351::__init__::225::IOProcess::(_processLogs) (274756) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:42,351::__init__::225::IOProcess::(_processLogs) (274756) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:42,351::__init__::225::IOProcess::(_processLogs) (274756) Building response >Thread-18::DEBUG::2014-07-08 17:23:42,351::__init__::225::IOProcess::(_processLogs) (274756) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:42,352::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:42,352::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:23:43,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:44,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.108542 s, 9.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:23:44,048::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:23:44,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`30afefe0-0b40-4212-b0aa-e5cda054a9ff`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:44,056::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:23:44,073::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:44,074::task::1191::Storage.TaskManager.Task::(prepare) Task=`30afefe0-0b40-4212-b0aa-e5cda054a9ff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:44,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`30afefe0-0b40-4212-b0aa-e5cda054a9ff`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:44,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:44,077::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:44,077::task::993::Storage.TaskManager.Task::(_decref) Task=`30afefe0-0b40-4212-b0aa-e5cda054a9ff`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:23:44,129::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:23:44,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`467a4ab1-a86b-472a-a898-fe3e9844b7cb`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:23:44,130::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:23:44,131::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d6de1d30-a1d8-4d17-ab58-7902695bea26`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:23:44,132::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:23:44,132::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:23:44,132::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d6de1d30-a1d8-4d17-ab58-7902695bea26`::Granted request >Thread-7083::DEBUG::2014-07-08 17:23:44,133::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`467a4ab1-a86b-472a-a898-fe3e9844b7cb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:23:44,133::task::993::Storage.TaskManager.Task::(_decref) Task=`467a4ab1-a86b-472a-a898-fe3e9844b7cb`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:23:44,152::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:44,153::task::1191::Storage.TaskManager.Task::(prepare) Task=`467a4ab1-a86b-472a-a898-fe3e9844b7cb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:44,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`467a4ab1-a86b-472a-a898-fe3e9844b7cb`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:23:44,153::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:23:44,154::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:23:44,154::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:23:44,155::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:23:44,155::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:23:44,155::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:23:44,155::task::993::Storage.TaskManager.Task::(_decref) Task=`467a4ab1-a86b-472a-a898-fe3e9844b7cb`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:45,911::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:45,913::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:45,915::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:46,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:46,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173227 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:23:46,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`56b7b5da-18ab-41b4-a2fa-f1323adf5b4d`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:46,998::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:23:46,999::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431887', 'lastCheck': '4.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:23:46,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`56b7b5da-18ab-41b4-a2fa-f1323adf5b4d`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431887', 'lastCheck': '4.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:23:46,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`56b7b5da-18ab-41b4-a2fa-f1323adf5b4d`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:47,000::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:47,000::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:47,000::task::993::Storage.TaskManager.Task::(_decref) Task=`56b7b5da-18ab-41b4-a2fa-f1323adf5b4d`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:23:47,033::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:23:48,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:48,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172543 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:23:50,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:50,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174157 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:50,922::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:50,924::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:50,925::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:23:52,355::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:52,356::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:52,356::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:52,356::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:52,356::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:52,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:52,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:52,357::__init__::225::IOProcess::(_processLogs) (274757) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:52,357::__init__::225::IOProcess::(_processLogs) (274757) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:52,358::__init__::225::IOProcess::(_processLogs) (274757) Building response >Thread-18::DEBUG::2014-07-08 17:23:52,358::__init__::225::IOProcess::(_processLogs) (274757) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:52,358::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:52,358::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:23:52,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:23:52,519::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000499493 s, 925 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:23:52,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:52,522::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:23:52,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:52,523::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:52,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:52,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:52,524::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:52,524::__init__::225::IOProcess::(_processLogs) (274758) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:23:52,524::__init__::225::IOProcess::(_processLogs) (274758) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:23:52,524::__init__::225::IOProcess::(_processLogs) (274758) Building response >Thread-18::DEBUG::2014-07-08 17:23:52,525::__init__::225::IOProcess::(_processLogs) (274758) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:52,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:52,525::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:23:52,527::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:52,527::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:23:52,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:52,528::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:52,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:52,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:52,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:52,529::__init__::225::IOProcess::(_processLogs) (274759) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:52,529::__init__::225::IOProcess::(_processLogs) (274759) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:52,529::__init__::225::IOProcess::(_processLogs) (274759) Building response >Thread-18::DEBUG::2014-07-08 17:23:52,530::__init__::225::IOProcess::(_processLogs) (274759) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:52,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:52,530::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:52,531::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:52,531::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:23:52,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:52,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:52,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:52,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:52,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:52,533::__init__::225::IOProcess::(_processLogs) (274760) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:52,533::__init__::225::IOProcess::(_processLogs) (274760) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:52,533::__init__::225::IOProcess::(_processLogs) (274760) Building response >Thread-18::DEBUG::2014-07-08 17:23:52,534::__init__::225::IOProcess::(_processLogs) (274760) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:52,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:52,534::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:23:52,535::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:23:52,535::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:23:52,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:23:52,536::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:23:52,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:23:52,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:23:52,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:23:52,537::__init__::225::IOProcess::(_processLogs) (274761) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:23:52,537::__init__::225::IOProcess::(_processLogs) (274761) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:23:52,537::__init__::225::IOProcess::(_processLogs) (274761) Building response >Thread-18::DEBUG::2014-07-08 17:23:52,538::__init__::225::IOProcess::(_processLogs) (274761) Queuing response >Thread-18::DEBUG::2014-07-08 17:23:52,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:23:52,538::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:23:52,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:53,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177359 s, 57.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:23:54,168::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:23:54,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a1edb6d-bdc1-43d3-ad5b-ff31e895c861`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:23:54,170::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:23:54,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:54,185::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a1edb6d-bdc1-43d3-ad5b-ff31e895c861`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:23:54,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a1edb6d-bdc1-43d3-ad5b-ff31e895c861`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:23:54,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:23:54,186::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:23:54,186::task::993::Storage.TaskManager.Task::(_decref) Task=`6a1edb6d-bdc1-43d3-ad5b-ff31e895c861`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:23:54,197::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:23:54,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`c76fd15a-79b6-4587-88e1-ab8c8f60eeb8`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:23:54,198::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:23:54,199::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`06bbdfe5-b8a9-4473-bdd6-6d4fd4ac5e7d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:23:54,200::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:23:54,200::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:23:54,200::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`06bbdfe5-b8a9-4473-bdd6-6d4fd4ac5e7d`::Granted request >Thread-7083::DEBUG::2014-07-08 17:23:54,201::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c76fd15a-79b6-4587-88e1-ab8c8f60eeb8`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:23:54,201::task::993::Storage.TaskManager.Task::(_decref) Task=`c76fd15a-79b6-4587-88e1-ab8c8f60eeb8`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:23:54,220::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:54,221::task::1191::Storage.TaskManager.Task::(prepare) Task=`c76fd15a-79b6-4587-88e1-ab8c8f60eeb8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:23:54,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`c76fd15a-79b6-4587-88e1-ab8c8f60eeb8`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:23:54,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:23:54,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:23:54,222::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:23:54,222::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:23:54,222::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:23:54,223::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:23:54,223::task::993::Storage.TaskManager.Task::(_decref) Task=`c76fd15a-79b6-4587-88e1-ab8c8f60eeb8`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:23:55,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:55,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348242 s, 29.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:55,932::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:55,934::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:23:55,935::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:23:56,995::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:23:56,996::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:23:57,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:23:57,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171409 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:23:59,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:00,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0893398 s, 11.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:00,942::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:00,944::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:00,945::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:02,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:24:02,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`1838a6ca-e895-4d89-a3e4-a4f224ede478`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:24:02,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:24:02,308::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499493', 'lastCheck': '9.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:24:02,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`1838a6ca-e895-4d89-a3e4-a4f224ede478`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499493', 'lastCheck': '9.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:24:02,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`1838a6ca-e895-4d89-a3e4-a4f224ede478`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:24:02,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:02,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:02,315::task::993::Storage.TaskManager.Task::(_decref) Task=`1838a6ca-e895-4d89-a3e4-a4f224ede478`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:24:02,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439835 s, 23.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:24:02,441::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:24:02,541::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:02,541::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:02,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:02,542::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:02,542::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:02,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:02,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:02,543::__init__::225::IOProcess::(_processLogs) (274762) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:02,543::__init__::225::IOProcess::(_processLogs) (274762) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:02,543::__init__::225::IOProcess::(_processLogs) (274762) Building response >Thread-18::DEBUG::2014-07-08 17:24:02,544::__init__::225::IOProcess::(_processLogs) (274762) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:02,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:02,544::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:24:02,546::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:24:02,699::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00068331 s, 676 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:24:02,704::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:02,705::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:02,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:02,708::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:02,709::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:02,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:02,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:02,713::__init__::225::IOProcess::(_processLogs) (274763) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:02,714::__init__::225::IOProcess::(_processLogs) (274763) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:02,716::__init__::225::IOProcess::(_processLogs) (274763) Building response >Thread-18::DEBUG::2014-07-08 17:24:02,717::__init__::225::IOProcess::(_processLogs) (274763) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:02,718::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:02,719::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:24:02,726::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:02,728::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:24:02,729::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:02,730::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:02,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:02,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:02,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:02,736::__init__::225::IOProcess::(_processLogs) (274764) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:02,737::__init__::225::IOProcess::(_processLogs) (274764) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:02,738::__init__::225::IOProcess::(_processLogs) (274764) Building response >Thread-18::DEBUG::2014-07-08 17:24:02,739::__init__::225::IOProcess::(_processLogs) (274764) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:02,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:02,742::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:02,747::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:02,750::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:24:02,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:02,754::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:02,756::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:02,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:02,759::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:02,760::__init__::225::IOProcess::(_processLogs) (274765) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:02,762::__init__::225::IOProcess::(_processLogs) (274765) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:02,763::__init__::225::IOProcess::(_processLogs) (274765) Building response >Thread-18::DEBUG::2014-07-08 17:24:02,765::__init__::225::IOProcess::(_processLogs) (274765) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:02,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:02,767::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:02,772::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:02,773::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:24:02,775::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:02,776::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:02,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:02,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:02,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:02,782::__init__::225::IOProcess::(_processLogs) (274766) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:02,783::__init__::225::IOProcess::(_processLogs) (274766) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:02,784::__init__::225::IOProcess::(_processLogs) (274766) Building response >Thread-18::DEBUG::2014-07-08 17:24:02,786::__init__::225::IOProcess::(_processLogs) (274766) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:02,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:02,789::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >VM Channels Listener::DEBUG::2014-07-08 17:24:04,116::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7082::DEBUG::2014-07-08 17:24:04,245::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:24:04,246::task::595::Storage.TaskManager.Task::(_updateState) Task=`78ecd49a-cc25-4f8b-a1f0-eca4a8f6ce0c`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:24:04,246::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:24:04,261::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:04,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`78ecd49a-cc25-4f8b-a1f0-eca4a8f6ce0c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:04,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`78ecd49a-cc25-4f8b-a1f0-eca4a8f6ce0c`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:24:04,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:04,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:04,263::task::993::Storage.TaskManager.Task::(_decref) Task=`78ecd49a-cc25-4f8b-a1f0-eca4a8f6ce0c`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:24:04,275::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:24:04,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bf05027-bef1-4690-8b23-962a77d6c43d`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:24:04,277::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:24:04,278::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`307b3a37-9fa1-454e-ba47-200040f1fb04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:24:04,278::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:24:04,278::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:24:04,279::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`307b3a37-9fa1-454e-ba47-200040f1fb04`::Granted request >Thread-7083::DEBUG::2014-07-08 17:24:04,279::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3bf05027-bef1-4690-8b23-962a77d6c43d`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:24:04,280::task::993::Storage.TaskManager.Task::(_decref) Task=`3bf05027-bef1-4690-8b23-962a77d6c43d`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:24:04,299::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:04,299::task::1191::Storage.TaskManager.Task::(prepare) Task=`3bf05027-bef1-4690-8b23-962a77d6c43d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:04,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bf05027-bef1-4690-8b23-962a77d6c43d`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:24:04,300::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:24:04,300::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:24:04,300::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:24:04,301::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:24:04,301::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:24:04,301::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:24:04,302::task::993::Storage.TaskManager.Task::(_decref) Task=`3bf05027-bef1-4690-8b23-962a77d6c43d`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:24:04,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:04,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211519 s, 48.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:05,952::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:05,954::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:05,955::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:06,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:06,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178155 s, 57.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:24:08,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:09,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171266 s, 59.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:10,962::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:10,964::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:10,965::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:11,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:11,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173294 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:24:12,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`669633b5-ce5a-4bf4-9545-2c6e07c61047`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:24:12,023::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:24:12,025::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:12,025::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:24:12,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:12,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:12,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:12,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:12,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:12,027::__init__::225::IOProcess::(_processLogs) (274767) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:24:12,027::__init__::225::IOProcess::(_processLogs) (274767) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:24:12,027::__init__::225::IOProcess::(_processLogs) (274767) Building response >Thread-18::DEBUG::2014-07-08 17:24:12,028::__init__::225::IOProcess::(_processLogs) (274767) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:12,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:12,028::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:24:12,030::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:12,030::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:24:12,030::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:12,031::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:12,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:12,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:12,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:12,032::__init__::225::IOProcess::(_processLogs) (274768) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:24:12,032::__init__::225::IOProcess::(_processLogs) (274768) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:24:12,032::__init__::225::IOProcess::(_processLogs) (274768) Building response >Thread-18::DEBUG::2014-07-08 17:24:12,032::__init__::225::IOProcess::(_processLogs) (274768) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:12,033::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:12,033::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:24:12,034::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:24:12,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`669633b5-ce5a-4bf4-9545-2c6e07c61047`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:24:12,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`669633b5-ce5a-4bf4-9545-2c6e07c61047`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:24:12,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:24:12,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:24:12,035::task::993::Storage.TaskManager.Task::(_decref) Task=`669633b5-ce5a-4bf4-9545-2c6e07c61047`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:24:12,115::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:24:12,115::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-18::DEBUG::2014-07-08 17:24:12,794::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:12,794::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:12,795::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:12,795::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:12,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:12,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:12,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:12,796::__init__::225::IOProcess::(_processLogs) (274769) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:12,796::__init__::225::IOProcess::(_processLogs) (274769) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:12,796::__init__::225::IOProcess::(_processLogs) (274769) Building response >Thread-18::DEBUG::2014-07-08 17:24:12,797::__init__::225::IOProcess::(_processLogs) (274769) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:12,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:12,797::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:24:12,799::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:24:12,950::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000484407 s, 954 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:24:12,956::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:12,957::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:12,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:12,959::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:12,961::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:12,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:12,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:12,965::__init__::225::IOProcess::(_processLogs) (274770) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:12,966::__init__::225::IOProcess::(_processLogs) (274770) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:12,967::__init__::225::IOProcess::(_processLogs) (274770) Building response >Thread-18::DEBUG::2014-07-08 17:24:12,968::__init__::225::IOProcess::(_processLogs) (274770) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:12,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:12,970::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:24:12,980::__init__::225::IOProcess::(_processLogs) (274770) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:12,981::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:24:12,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:12,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:12,986::__init__::225::IOProcess::(_processLogs) (274770) Finding callback 'statvfs'...DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:12,987::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:12,988::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:12,990::__init__::225::IOProcess::(_processLogs) (274771) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:12,991::__init__::225::IOProcess::(_processLogs) (274771) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:12,992::__init__::225::IOProcess::(_processLogs) (274771) Building response >Thread-18::DEBUG::2014-07-08 17:24:12,993::__init__::225::IOProcess::(_processLogs) (274771) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:12,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:12,996::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:13,001::__init__::225::IOProcess::(_processLogs) (274770) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:13,003::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:24:13,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:13,006::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:13,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:13,008::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:13,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:13,012::__init__::225::IOProcess::(_processLogs) (274772) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:13,014::__init__::225::IOProcess::(_processLogs) (274772) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:13,015::__init__::225::IOProcess::(_processLogs) (274772) Building response >Thread-18::DEBUG::2014-07-08 17:24:13,016::__init__::225::IOProcess::(_processLogs) (274772) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:13,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:13,019::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:13,023::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:13,025::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:24:13,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:13,028::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:13,030::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:13,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:13,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:13,034::__init__::225::IOProcess::(_processLogs) (274773) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:13,035::__init__::225::IOProcess::(_processLogs) (274773) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:13,037::__init__::225::IOProcess::(_processLogs) (274773) Building response >Thread-18::DEBUG::2014-07-08 17:24:13,038::__init__::225::IOProcess::(_processLogs) (274773) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:13,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:13,040::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:24:13,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:13,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.053989 s, 19.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:24:14,324::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:24:14,325::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0a7befe-0163-4288-acd5-1a5773ccfc2f`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:24:14,326::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:24:14,341::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:14,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0a7befe-0163-4288-acd5-1a5773ccfc2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:14,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0a7befe-0163-4288-acd5-1a5773ccfc2f`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:24:14,342::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:14,342::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:14,342::task::993::Storage.TaskManager.Task::(_decref) Task=`e0a7befe-0163-4288-acd5-1a5773ccfc2f`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:24:14,360::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:24:14,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1d14110-70d5-4603-8ebc-2a87eaf1a0a5`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:24:14,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:24:14,362::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`02b19097-d4f1-415a-b450-ea1e23029790`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:24:14,363::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:24:14,363::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:24:14,364::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`02b19097-d4f1-415a-b450-ea1e23029790`::Granted request >Thread-7083::DEBUG::2014-07-08 17:24:14,364::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f1d14110-70d5-4603-8ebc-2a87eaf1a0a5`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:24:14,364::task::993::Storage.TaskManager.Task::(_decref) Task=`f1d14110-70d5-4603-8ebc-2a87eaf1a0a5`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:24:14,383::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:14,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1d14110-70d5-4603-8ebc-2a87eaf1a0a5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:14,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1d14110-70d5-4603-8ebc-2a87eaf1a0a5`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:24:14,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:24:14,384::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:24:14,385::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:24:14,385::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:24:14,385::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:24:14,386::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:24:14,386::task::993::Storage.TaskManager.Task::(_decref) Task=`f1d14110-70d5-4603-8ebc-2a87eaf1a0a5`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:24:15,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:16,051::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:16,058::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:16,065::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:16,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.125275 s, 8.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:24:17,552::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9cbd450-7ac4-44b5-8234-36b479200b20`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:24:17,552::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:24:17,553::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484407', 'lastCheck': '4.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:24:17,553::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9cbd450-7ac4-44b5-8234-36b479200b20`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484407', 'lastCheck': '4.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:24:17,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9cbd450-7ac4-44b5-8234-36b479200b20`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:24:17,554::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:17,554::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:17,554::task::993::Storage.TaskManager.Task::(_decref) Task=`f9cbd450-7ac4-44b5-8234-36b479200b20`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:24:17,587::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:18,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:18,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01718 s, 59.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:24:20,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:20,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175258 s, 58.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:21,072::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:21,074::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:21,075::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:22,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:23,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017325 s, 59.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:24:23,084::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:23,086::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:23,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:23,090::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:23,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:23,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:23,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:23,102::__init__::225::IOProcess::(_processLogs) (274774) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:23,105::__init__::225::IOProcess::(_processLogs) (274774) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:23,107::__init__::225::IOProcess::(_processLogs) (274774) Building response >Thread-18::DEBUG::2014-07-08 17:24:23,110::__init__::225::IOProcess::(_processLogs) (274774) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:23,112::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:23,114::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:24:23,126::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:24:23,283::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000774101 s, 597 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:24:23,292::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:23,302::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:23,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:23,308::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:23,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:23,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:23,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:23,317::__init__::225::IOProcess::(_processLogs) (274775) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:23,319::__init__::225::IOProcess::(_processLogs) (274775) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:23,322::__init__::225::IOProcess::(_processLogs) DEBUG|(274775) Building response >Thread-18::DEBUG::2014-07-08 17:24:23,325::__init__::225::IOProcess::(_processLogs) (274775) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:23,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:23,329::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:24:23,344::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:23,346::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:24:23,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:23,352::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:23,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:23,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:23,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:23,363::__init__::225::IOProcess::(_processLogs) (274776) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:23,366::__init__::225::IOProcess::(_processLogs) (274776) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:23,368::__init__::225::IOProcess::(_processLogs) (274776) Building response >Thread-18::DEBUG::2014-07-08 17:24:23,371::__init__::225::IOProcess::(_processLogs) (274776) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:23,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:23,376::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:23,385::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:23,388::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:24:23,390::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:23,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:23,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:23,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:23,401::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:23,403::__init__::225::IOProcess::(_processLogs) (274777) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:23,407::__init__::225::IOProcess::(_processLogs) (274777) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:23,410::__init__::225::IOProcess::(_processLogs) (274777) Building response >Thread-18::DEBUG::2014-07-08 17:24:23,412::__init__::225::IOProcess::(_processLogs) (274777) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:23,414::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:23,416::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:23,426::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:23,429::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:24:23,431::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:23,434::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:23,437::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:23,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:23,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:23,445::__init__::225::IOProcess::(_processLogs) (274778) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:23,448::__init__::225::IOProcess::(_processLogs) (274778) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:23,450::__init__::225::IOProcess::(_processLogs) (274778) Building response >Thread-18::DEBUG::2014-07-08 17:24:23,452::__init__::225::IOProcess::(_processLogs) (274778) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:23,454::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:23,457::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:24:24,409::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:24:24,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`65ec99cd-6aa5-4962-9961-c9718183e3e7`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:24:24,410::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:24:24,425::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:24,425::task::1191::Storage.TaskManager.Task::(prepare) Task=`65ec99cd-6aa5-4962-9961-c9718183e3e7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:24,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`65ec99cd-6aa5-4962-9961-c9718183e3e7`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:24:24,426::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:24,426::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:24,426::task::993::Storage.TaskManager.Task::(_decref) Task=`65ec99cd-6aa5-4962-9961-c9718183e3e7`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:24:24,437::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:24:24,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cd3bb85-cb14-4b66-89fd-b6909c11e0bb`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:24:24,439::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:24:24,440::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4d22cc88-4456-4b17-a50c-25084a88ea7f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:24:24,440::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:24:24,440::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:24:24,441::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4d22cc88-4456-4b17-a50c-25084a88ea7f`::Granted request >Thread-7083::DEBUG::2014-07-08 17:24:24,441::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0cd3bb85-cb14-4b66-89fd-b6909c11e0bb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:24:24,442::task::993::Storage.TaskManager.Task::(_decref) Task=`0cd3bb85-cb14-4b66-89fd-b6909c11e0bb`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:24:24,460::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:24,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`0cd3bb85-cb14-4b66-89fd-b6909c11e0bb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:24,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cd3bb85-cb14-4b66-89fd-b6909c11e0bb`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:24:24,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:24:24,461::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:24:24,462::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:24:24,462::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:24:24,462::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:24:24,463::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:24:24,463::task::993::Storage.TaskManager.Task::(_decref) Task=`0cd3bb85-cb14-4b66-89fd-b6909c11e0bb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:24:25,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:25,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0198238 s, 51.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:26,082::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:26,084::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:26,085::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:24:27,144::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:24:27,145::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:24:27,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:28,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349846 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:24:30,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:30,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173839 s, 58.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:31,093::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:31,094::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:31,096::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:32,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:32,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173037 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:24:32,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`778d115e-001c-488e-9c9d-21acc5d0f854`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:24:32,822::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:24:32,823::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774101', 'lastCheck': '9.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:24:32,823::task::1191::Storage.TaskManager.Task::(prepare) Task=`778d115e-001c-488e-9c9d-21acc5d0f854`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774101', 'lastCheck': '9.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:24:32,823::task::595::Storage.TaskManager.Task::(_updateState) Task=`778d115e-001c-488e-9c9d-21acc5d0f854`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:24:32,823::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:32,824::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:32,824::task::993::Storage.TaskManager.Task::(_decref) Task=`778d115e-001c-488e-9c9d-21acc5d0f854`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:24:32,855::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:24:33,465::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:33,466::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:33,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:33,466::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:33,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:33,467::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:33,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:33,467::__init__::225::IOProcess::(_processLogs) (274779) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:33,468::__init__::225::IOProcess::(_processLogs) (274779) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:33,468::__init__::225::IOProcess::(_processLogs) (274779) Building response >Thread-18::DEBUG::2014-07-08 17:24:33,468::__init__::225::IOProcess::(_processLogs) (274779) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:33,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:33,469::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:24:33,470::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:24:33,624::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000481892 s, 959 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:24:33,629::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:33,631::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:33,633::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:33,634::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:33,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:33,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:33,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:33,641::__init__::225::IOProcess::(_processLogs) (274780) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:33,642::__init__::225::IOProcess::(_processLogs) (274780) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:33,644::__init__::225::IOProcess::(_processLogs) DEBUG|(274780) Building response >Thread-18::DEBUG::2014-07-08 17:24:33,646::__init__::225::IOProcess::(_processLogs) (274780) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:33,648::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:33,649::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:24:33,662::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:33,664::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:24:33,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:33,666::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:33,668::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:33,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:33,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:33,672::__init__::225::IOProcess::(_processLogs) (274781) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:33,673::__init__::225::IOProcess::(_processLogs) (274781) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:33,674::__init__::225::IOProcess::(_processLogs) (274781) Building response >Thread-18::DEBUG::2014-07-08 17:24:33,676::__init__::225::IOProcess::(_processLogs) (274781) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:33,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:33,678::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:33,686::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:33,688::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:24:33,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:33,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:33,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:33,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:33,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:33,697::__init__::225::IOProcess::(_processLogs) (274782) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:33,698::__init__::225::IOProcess::(_processLogs) (274782) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:33,700::__init__::225::IOProcess::(_processLogs) (274782) Building response >Thread-18::DEBUG::2014-07-08 17:24:33,701::__init__::225::IOProcess::(_processLogs) (274782) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:33,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:33,704::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:33,709::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:33,710::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:24:33,711::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:33,712::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:33,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:33,715::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:33,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:33,718::__init__::225::IOProcess::(_processLogs) (274783) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:33,719::__init__::225::IOProcess::(_processLogs) (274783) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:33,720::__init__::225::IOProcess::(_processLogs) (274783) Building response >Thread-18::DEBUG::2014-07-08 17:24:33,722::__init__::225::IOProcess::(_processLogs) (274783) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:33,723::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:33,725::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >VM Channels Listener::DEBUG::2014-07-08 17:24:34,314::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-7082::DEBUG::2014-07-08 17:24:34,477::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:24:34,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6395e37-021c-43b7-b081-a74e6013997d`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:24:34,479::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:24:34,494::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:34,494::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6395e37-021c-43b7-b081-a74e6013997d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:34,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6395e37-021c-43b7-b081-a74e6013997d`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:24:34,495::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:34,495::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:34,495::task::993::Storage.TaskManager.Task::(_decref) Task=`c6395e37-021c-43b7-b081-a74e6013997d`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:24:34,512::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:24:34,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`35adfd56-93cc-4c53-8fa5-45a2236a38ca`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:24:34,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:24:34,514::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cb301634-8741-4e20-9902-eefef6497a02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:24:34,514::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:24:34,514::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:24:34,515::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`cb301634-8741-4e20-9902-eefef6497a02`::Granted request >Thread-7083::DEBUG::2014-07-08 17:24:34,515::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`35adfd56-93cc-4c53-8fa5-45a2236a38ca`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:24:34,516::task::993::Storage.TaskManager.Task::(_decref) Task=`35adfd56-93cc-4c53-8fa5-45a2236a38ca`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:24:34,534::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:34,535::task::1191::Storage.TaskManager.Task::(prepare) Task=`35adfd56-93cc-4c53-8fa5-45a2236a38ca`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:34,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`35adfd56-93cc-4c53-8fa5-45a2236a38ca`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:24:34,535::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:24:34,536::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:24:34,536::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:24:34,537::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:24:34,537::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:24:34,537::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:24:34,537::task::993::Storage.TaskManager.Task::(_decref) Task=`35adfd56-93cc-4c53-8fa5-45a2236a38ca`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:24:34,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:34,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184136 s, 55.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:36,100::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:36,102::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:36,103::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:36,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:37,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176711 s, 57.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:24:39,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:39,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172981 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:41,110::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:41,112::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:41,113::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:41,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:41,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173582 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:24:42,319::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:24:42,320::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:24:43,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:24:43,897::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:43,902::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:43,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:43,909::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:43,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:43,916::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:43,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:43,922::__init__::225::IOProcess::(_processLogs) (274784) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:43,925::__init__::225::IOProcess::(_processLogs) (274784) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:43,928::__init__::225::IOProcess::(_processLogs) DEBUG|(274784) Building response >Thread-18::DEBUG::2014-07-08 17:24:43,932::__init__::225::IOProcess::(_processLogs) (274784) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:43,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:43,937::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:24:43,952::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:24:44,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000515975 s, 895 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:24:44,119::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:44,123::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:44,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Dummy-6860::DEBUG::2014-07-08 17:24:44,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.250032 s, 4.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:24:44,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:44,198::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:44,201::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:44,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:44,208::__init__::225::IOProcess::(_processLogs) (274785) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:44,210::__init__::225::IOProcess::(_processLogs) (274785) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:44,212::__init__::225::IOProcess::(_processLogs) (274785) Building response >Thread-18::DEBUG::2014-07-08 17:24:44,215::__init__::225::IOProcess::(_processLogs) (274785) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:44,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:44,221::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:24:44,237::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:44,240::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:24:44,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:44,246::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:44,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:44,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:44,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:44,258::__init__::225::IOProcess::(_processLogs) (274786) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:44,261::__init__::225::IOProcess::(_processLogs) (274786) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:44,264::__init__::225::IOProcess::(_processLogs) (274786) Building response >Thread-18::DEBUG::2014-07-08 17:24:44,267::__init__::225::IOProcess::(_processLogs) (274786) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:44,270::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:24:44,273::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:44,293::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:44,298::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:24:44,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:44,314::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:44,321::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:44,329::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:44,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:44,340::__init__::225::IOProcess::(_processLogs) (274787) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:44,345::__init__::225::IOProcess::(_processLogs) (274787) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:44,352::__init__::225::IOProcess::(_processLogs) (274787) Building response >Thread-18::DEBUG::2014-07-08 17:24:44,357::__init__::225::IOProcess::(_processLogs) (274787) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:44,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:44,369::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:44,391::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:44,398::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:24:44,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:44,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:44,416::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:44,418::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:44,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:44,425::__init__::225::IOProcess::(_processLogs) (274788) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:44,429::__init__::225::IOProcess::(_processLogs) (274788) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:44,431::__init__::225::IOProcess::(_processLogs) (274788) Building response >Thread-18::DEBUG::2014-07-08 17:24:44,433::__init__::225::IOProcess::(_processLogs) (274788) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:44,436::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:44,439::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:24:44,557::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:24:44,563::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7c530a2-81a2-46f5-8271-aa523b72359e`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:24:44,567::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:24:44,585::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:44,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7c530a2-81a2-46f5-8271-aa523b72359e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:44,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7c530a2-81a2-46f5-8271-aa523b72359e`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:24:44,594::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:44,598::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:44,601::task::993::Storage.TaskManager.Task::(_decref) Task=`f7c530a2-81a2-46f5-8271-aa523b72359e`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:24:44,622::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:24:44,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bd14618-3528-4c4e-859b-1dd59833dd71`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:24:44,627::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:24:44,631::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`abd1beff-724c-444e-bde9-3748a95a8298`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:24:44,633::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:24:44,635::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:24:44,637::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`abd1beff-724c-444e-bde9-3748a95a8298`::Granted request >Thread-7083::DEBUG::2014-07-08 17:24:44,638::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2bd14618-3528-4c4e-859b-1dd59833dd71`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:24:44,638::task::993::Storage.TaskManager.Task::(_decref) Task=`2bd14618-3528-4c4e-859b-1dd59833dd71`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:24:44,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:44,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`2bd14618-3528-4c4e-859b-1dd59833dd71`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:44,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bd14618-3528-4c4e-859b-1dd59833dd71`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:24:44,658::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:24:44,658::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:24:44,659::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:24:44,659::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:24:44,659::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:24:44,660::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:24:44,660::task::993::Storage.TaskManager.Task::(_decref) Task=`2bd14618-3528-4c4e-859b-1dd59833dd71`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:46,120::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:46,121::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:46,122::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:46,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:46,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172652 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:24:47,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`953b8932-8ad8-4abf-9f3b-6753306fb6d0`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:24:47,952::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:24:47,952::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515975', 'lastCheck': '3.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:24:47,953::task::1191::Storage.TaskManager.Task::(prepare) Task=`953b8932-8ad8-4abf-9f3b-6753306fb6d0`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515975', 'lastCheck': '3.5', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:24:47,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`953b8932-8ad8-4abf-9f3b-6753306fb6d0`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:24:47,953::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:47,953::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:47,954::task::993::Storage.TaskManager.Task::(_decref) Task=`953b8932-8ad8-4abf-9f3b-6753306fb6d0`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:24:47,985::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:48,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:49,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172258 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:51,128::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:51,130::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:51,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:51,289::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:24:51,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172154 s, 59.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:24:53,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:53,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0886596 s, 11.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:24:54,448::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:54,449::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:54,449::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:54,449::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:54,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:54,450::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:54,450::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:54,450::__init__::225::IOProcess::(_processLogs) (274789) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:54,451::__init__::225::IOProcess::(_processLogs) (274789) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:54,451::__init__::225::IOProcess::(_processLogs) (274789) Building response >Thread-18::DEBUG::2014-07-08 17:24:54,451::__init__::225::IOProcess::(_processLogs) (274789) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:54,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:54,452::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:24:54,453::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:24:54,604::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00047882 s, 965 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:24:54,611::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:54,613::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:24:54,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:54,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:54,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:54,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:54,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:54,623::__init__::225::IOProcess::(_processLogs) (274790) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:24:54,625::__init__::225::IOProcess::(_processLogs) (274790) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:24:54,627::__init__::225::IOProcess::(_processLogs) DEBUG|(274790) Building response >Thread-18::DEBUG::2014-07-08 17:24:54,627::__init__::225::IOProcess::(_processLogs) (274790) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:54,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:54,629::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:24:54,636::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:54,638::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:24:54,639::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:24:54,640::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:54,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:54,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:54,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:54,653::__init__::225::IOProcess::(_processLogs) (274791) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:54,657::__init__::225::IOProcess::(_processLogs) (274791) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:54,662::__init__::225::IOProcess::(_processLogs) (274791) Building response >Thread-18::DEBUG::2014-07-08 17:24:54,666::__init__::225::IOProcess::(_processLogs) (274791) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:54,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:54,669::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:24:54,677::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:24:54,679::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:24:54,684::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7082::DEBUG::2014-07-08 17:24:54,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`e840ae8a-5bc1-4417-b2c0-cb2b9469ed6c`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:24:54,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::INFO::2014-07-08 17:24:54,689::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:24:54,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:24:54,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:54,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:54,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:54,700::__init__::225::IOProcess::(_processLogs) (274792) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:54,700::__init__::225::IOProcess::(_processLogs) (274792) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:54,702::__init__::225::IOProcess::(_processLogs) (274792) Building response >Thread-18::DEBUG::2014-07-08 17:24:54,702::__init__::225::IOProcess::(_processLogs) (274792) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:54,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:24:54,703::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:24:54,706::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7082::INFO::2014-07-08 17:24:54,707::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:24:54,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 17:24:54,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`e840ae8a-5bc1-4417-b2c0-cb2b9469ed6c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:24:54,711::task::595::Storage.TaskManager.Task::(_updateState) Task=`e840ae8a-5bc1-4417-b2c0-cb2b9469ed6c`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:24:54,711::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 17:24:54,712::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:24:54,714::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:24:54,715::task::993::Storage.TaskManager.Task::(_decref) Task=`e840ae8a-5bc1-4417-b2c0-cb2b9469ed6c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:24:54,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:24:54,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:24:54,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:24:54,724::__init__::225::IOProcess::(_processLogs) (274793) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:24:54,725::__init__::225::IOProcess::(_processLogs) (274793) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:24:54,727::__init__::225::IOProcess::(_processLogs) (274793) Building response >Thread-18::DEBUG::2014-07-08 17:24:54,728::__init__::225::IOProcess::(_processLogs) (274793) Queuing response >Thread-18::DEBUG::2014-07-08 17:24:54,731::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:24:54,734::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:24:54,736::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:24:54,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`b047f124-a975-4b36-8a57-1e8046421118`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:24:54,741::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:24:54,749::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3ba5f533-3073-40da-829d-949fdbc685e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:24:54,750::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:24:54,753::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:24:54,754::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`3ba5f533-3073-40da-829d-949fdbc685e2`::Granted request >Thread-7083::DEBUG::2014-07-08 17:24:54,757::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b047f124-a975-4b36-8a57-1e8046421118`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:24:54,758::task::993::Storage.TaskManager.Task::(_decref) Task=`b047f124-a975-4b36-8a57-1e8046421118`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:24:54,792::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:54,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`b047f124-a975-4b36-8a57-1e8046421118`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:24:54,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`b047f124-a975-4b36-8a57-1e8046421118`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:24:54,796::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:24:54,797::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:24:54,799::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:24:54,801::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:24:54,802::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:24:54,803::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:24:54,805::task::993::Storage.TaskManager.Task::(_decref) Task=`b047f124-a975-4b36-8a57-1e8046421118`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:24:55,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:56,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195377 s, 52.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:56,297::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:56,298::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:24:56,300::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:24:57,353::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:24:57,354::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:24:58,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:24:58,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174451 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:25:00,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:00,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171973 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:01,307::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:01,308::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:01,315::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:02,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:02,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.043265 s, 23.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:25:03,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`09c42b6a-9ebd-4088-bfab-0385f7fafb78`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:25:03,084::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:25:03,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047882', 'lastCheck': '8.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:25:03,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`09c42b6a-9ebd-4088-bfab-0385f7fafb78`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047882', 'lastCheck': '8.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:25:03,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`09c42b6a-9ebd-4088-bfab-0385f7fafb78`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:25:03,086::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:25:03,086::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:25:03,086::task::993::Storage.TaskManager.Task::(_decref) Task=`09c42b6a-9ebd-4088-bfab-0385f7fafb78`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:25:03,120::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:25:04,541::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-18::DEBUG::2014-07-08 17:25:04,748::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:25:04,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:04,749::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:04,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:04,749::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:04,749::__init__::225::IOProcess::(_processLogs) (274794) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:25:04,750::__init__::225::IOProcess::(_processLogs) (274794) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:25:04,750::__init__::225::IOProcess::(_processLogs) (274794) Building response >Thread-18::DEBUG::2014-07-08 17:25:04,750::__init__::225::IOProcess::(_processLogs) (274794) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:04,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:04,751::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:25:04,752::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:04,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 17:25:04,919::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000603414 s, 766 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:25:05,076::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:25:05,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d2eabe4-eae4-4d66-819d-2a85893b85e5`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:25:05,125::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 17:25:05,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:05,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:05,149::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:05,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:05,159::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 17:25:05,163::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:25:05,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 17:25:05,169::task::1191::Storage.TaskManager.Task::(prepare) Task=`0d2eabe4-eae4-4d66-819d-2a85893b85e5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:25:05,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d2eabe4-eae4-4d66-819d-2a85893b85e5`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:25:05,177::__init__::225::IOProcess::(_processLogs) (274795) Finding callback 'statvfs'... >Thread-7082::DEBUG::2014-07-08 17:25:05,181::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:25:05,188::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:25:05,188::__init__::225::IOProcess::(_processLogs) (274795) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 17:25:05,195::task::993::Storage.TaskManager.Task::(_decref) Task=`0d2eabe4-eae4-4d66-819d-2a85893b85e5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:25:05,203::__init__::225::IOProcess::(_processLogs) (274795) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:05,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:05,221::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:25:05,231::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:25:05,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`607b511f-c2fe-46a7-8278-93bea78e9b2a`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:25:05,248::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:25:05,273::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`328b9820-9e58-4135-84ef-c9e27ae5570e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:25:05,278::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:25:05,280::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:25:05,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:05,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:25:05,297::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:25:05,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:25:05,308::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`328b9820-9e58-4135-84ef-c9e27ae5570e`::Granted request >Thread-18::DEBUG::2014-07-08 17:25:05,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:05,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-6860::DEBUG::2014-07-08 17:25:05,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.225973 s, 4.5 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:25:05,399::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`607b511f-c2fe-46a7-8278-93bea78e9b2a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:25:05,403::__init__::225::IOProcess::(_processLogs) (274796) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:25:05,407::task::993::Storage.TaskManager.Task::(_decref) Task=`607b511f-c2fe-46a7-8278-93bea78e9b2a`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:25:05,411::__init__::225::IOProcess::(_processLogs) (274796) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:05,416::__init__::225::IOProcess::(_processLogs) (274796) Building response >Thread-18::DEBUG::2014-07-08 17:25:05,420::__init__::225::IOProcess::(_processLogs) (274796) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:05,426::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:05,431::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:25:05,449::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:25:05,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:05,461::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:05,465::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:05,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:05,474::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:05,479::__init__::225::IOProcess::(_processLogs) (274797) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:05,484::__init__::225::IOProcess::(_processLogs) (274797) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:05,489::__init__::225::IOProcess::(_processLogs) (274797) Building response >Thread-18::DEBUG::2014-07-08 17:25:05,493::__init__::225::IOProcess::(_processLogs) (274797) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:05,498::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:05,503::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:25:05,520::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:25:05,523::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 17:25:05,525::task::1191::Storage.TaskManager.Task::(prepare) Task=`607b511f-c2fe-46a7-8278-93bea78e9b2a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:25:05,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:25:05,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`607b511f-c2fe-46a7-8278-93bea78e9b2a`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:25:05,531::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:25:05,534::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:25:05,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:25:05,539::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:25:05,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:05,546::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:25:05,551::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:25:05,551::__init__::225::IOProcess::(_processLogs) (274798) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:05,556::__init__::225::IOProcess::(_processLogs) (274798) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:25:05,559::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:25:05,561::__init__::225::IOProcess::(_processLogs) (274798) Building response >Thread-7083::DEBUG::2014-07-08 17:25:05,563::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:25:05,565::__init__::225::IOProcess::(_processLogs) (274798) Queuing response >Thread-7083::DEBUG::2014-07-08 17:25:05,568::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:25:05,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:05,576::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:25:05,579::task::993::Storage.TaskManager.Task::(_decref) Task=`607b511f-c2fe-46a7-8278-93bea78e9b2a`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:06,322::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:06,324::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:06,325::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:07,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:08,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362668 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:25:10,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:10,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172939 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:11,333::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:11,334::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:11,335::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:12,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7086::DEBUG::2014-07-08 17:25:12,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f88ae36-0a04-48a3-a3be-3c89793602b5`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:25:12,651::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:25:12,653::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:25:12,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:12,655::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:12,656::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:12,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:12,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:12,660::__init__::225::IOProcess::(_processLogs) (274799) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:25:12,661::__init__::225::IOProcess::(_processLogs) (274799) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:25:12,663::__init__::225::IOProcess::(_processLogs) (274799) Building response >Thread-18::DEBUG::2014-07-08 17:25:12,665::__init__::225::IOProcess::(_processLogs) (274799) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:12,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:12,667::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:25:12,677::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:25:12,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:12,679::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:12,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:12,682::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:12,684::__init__::225::IOProcess::(_processLogs) (274800) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:25:12,686::__init__::225::IOProcess::(_processLogs) (274800) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:25:12,750::__init__::225::IOProcess::(_processLogs) (274800) Building response >Dummy-6860::DEBUG::2014-07-08 17:25:12,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401376 s, 25.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:25:12,751::__init__::225::IOProcess::(_processLogs) (274800) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:12,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:12,753::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:25:12,757::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:25:12,759::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f88ae36-0a04-48a3-a3be-3c89793602b5`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:25:12,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f88ae36-0a04-48a3-a3be-3c89793602b5`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:25:12,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:25:12,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:25:12,762::task::993::Storage.TaskManager.Task::(_decref) Task=`2f88ae36-0a04-48a3-a3be-3c89793602b5`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:25:12,846::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:25:12,846::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:25:14,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:15,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172037 s, 59.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:25:15,596::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:25:15,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:15,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:15,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:15,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:15,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:15,598::__init__::225::IOProcess::(_processLogs) (274801) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:25:15,598::__init__::225::IOProcess::(_processLogs) (274801) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:25:15,598::__init__::225::IOProcess::(_processLogs) (274801) Building response >Thread-18::DEBUG::2014-07-08 17:25:15,599::__init__::225::IOProcess::(_processLogs) (274801) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:15,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:15,599::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:25:15,601::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:25:15,758::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000559834 s, 825 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:25:15,762::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:25:15,764::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::DEBUG::2014-07-08 17:25:15,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`27b93a0e-183a-493e-bbb0-aba60830ad70`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:25:15,767::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::INFO::2014-07-08 17:25:15,769::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:15,769::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:15,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:15,776::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:15,777::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:15,777::__init__::225::IOProcess::(_processLogs) (274802) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:25:15,777::__init__::225::IOProcess::(_processLogs) (274802) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:25:15,779::__init__::225::IOProcess::(_processLogs) (274802) Building response >Thread-18::DEBUG::2014-07-08 17:25:15,779::__init__::225::IOProcess::(_processLogs) (274802) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:15,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:15,780::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::INFO::2014-07-08 17:25:15,797::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:25:15,801::task::1191::Storage.TaskManager.Task::(prepare) Task=`27b93a0e-183a-493e-bbb0-aba60830ad70`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:25:15,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`27b93a0e-183a-493e-bbb0-aba60830ad70`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:25:15,805::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:25:15,806::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 17:25:15,808::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:25:15,810::task::993::Storage.TaskManager.Task::(_decref) Task=`27b93a0e-183a-493e-bbb0-aba60830ad70`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:25:15,811::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:25:15,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:15,818::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:15,821::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:15,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:15,825::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:15,827::__init__::225::IOProcess::(_processLogs) (274803) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:15,828::__init__::225::IOProcess::(_processLogs) (274803) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:15,830::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(274803) Building response >Thread-18::DEBUG::2014-07-08 17:25:15,831::__init__::225::IOProcess::(_processLogs) (274803) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:15,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:15,834::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:25:15,841::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:25:15,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`12c326dd-0af1-48b3-bd2b-7164687a3437`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:25:15,847::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::INFO::2014-07-08 17:25:15,851::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:15,852::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:25:15,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:15,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:25:15,859::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`dbaf0d5b-0819-4835-aa61-82a5821615f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:25:15,863::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:25:15,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:25:15,867::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:25:15,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:25:15,870::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`dbaf0d5b-0819-4835-aa61-82a5821615f9`::Granted request >Thread-18::DEBUG::2014-07-08 17:25:15,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:15,875::__init__::225::IOProcess::(_processLogs) (274804) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:25:15,878::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`12c326dd-0af1-48b3-bd2b-7164687a3437`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:25:15,879::__init__::225::IOProcess::(_processLogs) (274804) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:25:15,882::task::993::Storage.TaskManager.Task::(_decref) Task=`12c326dd-0af1-48b3-bd2b-7164687a3437`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:25:15,883::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(274804) Building response >Thread-18::DEBUG::2014-07-08 17:25:15,888::__init__::225::IOProcess::(_processLogs) (274804) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:15,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:15,895::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:25:15,907::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:25:15,912::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:25:15,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:15,920::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:15,925::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:15,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:15,929::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:15,930::__init__::225::IOProcess::(_processLogs) (274805) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:15,932::__init__::225::IOProcess::(_processLogs) (274805) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:15,933::__init__::225::IOProcess::(_processLogs) (274805) Building response >Thread-18::DEBUG::2014-07-08 17:25:15,935::__init__::225::IOProcess::(_processLogs) (274805) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:15,936::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:15,939::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:25:15,945::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:25:15,947::task::1191::Storage.TaskManager.Task::(prepare) Task=`12c326dd-0af1-48b3-bd2b-7164687a3437`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:25:15,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`12c326dd-0af1-48b3-bd2b-7164687a3437`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:25:15,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:25:15,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:25:15,953::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:25:15,955::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:25:15,956::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:25:15,957::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:25:15,959::task::993::Storage.TaskManager.Task::(_decref) Task=`12c326dd-0af1-48b3-bd2b-7164687a3437`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:16,342::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:16,344::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:16,345::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:17,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:17,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172791 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:25:18,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`b02cf48f-6eb7-4531-b36f-212d78b51c28`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:25:18,222::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:25:18,222::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559834', 'lastCheck': '2.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:25:18,222::task::1191::Storage.TaskManager.Task::(prepare) Task=`b02cf48f-6eb7-4531-b36f-212d78b51c28`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559834', 'lastCheck': '2.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:25:18,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`b02cf48f-6eb7-4531-b36f-212d78b51c28`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:25:18,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:25:18,223::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:25:18,223::task::993::Storage.TaskManager.Task::(_decref) Task=`b02cf48f-6eb7-4531-b36f-212d78b51c28`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:25:18,253::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:19,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:19,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033509 s, 30.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:21,352::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:21,354::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:21,355::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:21,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:21,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174792 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:25:23,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:24,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172627 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:25:26,017::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:25:26,025::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 17:25:26,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`287003f7-beed-4b6b-a068-88e3d5420cb8`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:25:26,032::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 17:25:26,037::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:26,039::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:26,043::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:26,046::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:26,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:26,049::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:26,050::__init__::225::IOProcess::(_processLogs) (274806) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:25:26,051::__init__::225::IOProcess::(_processLogs) (274806) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:25:26,054::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(274806) Building response >Thread-18::DEBUG::2014-07-08 17:25:26,055::__init__::225::IOProcess::(_processLogs) (274806) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:26,057::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::INFO::2014-07-08 17:25:26,059::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:25:26,059::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 17:25:26,062::task::1191::Storage.TaskManager.Task::(prepare) Task=`287003f7-beed-4b6b-a068-88e3d5420cb8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:25:26,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`287003f7-beed-4b6b-a068-88e3d5420cb8`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:25:26,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:25:26,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:25:26,077::task::993::Storage.TaskManager.Task::(_decref) Task=`287003f7-beed-4b6b-a068-88e3d5420cb8`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 17:25:26,081::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:26,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-37::DEBUG::2014-07-08 17:25:26,253::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000778291 s, 594 kB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:26,429::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7083::DEBUG::2014-07-08 17:25:26,434::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:25:26,435::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:25:26,446::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7083::DEBUG::2014-07-08 17:25:26,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0356c64-8aa4-486f-990f-5aece5763d29`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:25:26,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 17:25:26,461::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:26,462::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:26,472::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:25:26,473::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:26,482::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:25:26,484::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`49ec8bd7-fcb8-4139-8313-94dc7b99383c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:25:26,491::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:25:26,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:26,503::__init__::225::IOProcess::(_processLogs) (274807) Finding callback 'statvfs'... >Thread-7083::DEBUG::2014-07-08 17:25:26,503::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:26,510::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:25:26,511::__init__::225::IOProcess::(_processLogs) (274807) Got request for method 'statvfs' >Thread-7083::DEBUG::2014-07-08 17:25:26,512::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`49ec8bd7-fcb8-4139-8313-94dc7b99383c`::Granted request >Thread-18::DEBUG::2014-07-08 17:25:26,521::__init__::225::IOProcess::(_processLogs) (274807) Building response >Thread-18::DEBUG::2014-07-08 17:25:26,529::__init__::225::IOProcess::(_processLogs) (274807) Queuing response >Thread-7083::DEBUG::2014-07-08 17:25:26,536::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c0356c64-8aa4-486f-990f-5aece5763d29`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:25:26,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:25:26,542::task::993::Storage.TaskManager.Task::(_decref) Task=`c0356c64-8aa4-486f-990f-5aece5763d29`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:25:26,545::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:25:26,573::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:25:26,577::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:25:26,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:26,589::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:26,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:26,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:26,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:26,672::__init__::225::IOProcess::(_processLogs) (274808) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:26,675::__init__::225::IOProcess::(_processLogs) (274808) Got request for method 'access' >Dummy-6860::DEBUG::2014-07-08 17:25:26,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.186749 s, 5.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:25:26,677::__init__::225::IOProcess::(_processLogs) (274808) Building response >Thread-18::DEBUG::2014-07-08 17:25:26,681::__init__::225::IOProcess::(_processLogs) (274808) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:26,683::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:26,686::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:25:26,692::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:25:26,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:26,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:26,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:26,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:26,702::__init__::225::IOProcess::(_processLogs) (274809) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:26,704::__init__::225::IOProcess::(_processLogs) (274809) Got request for method 'access' >Thread-7083::INFO::2014-07-08 17:25:26,707::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:25:26,711::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0356c64-8aa4-486f-990f-5aece5763d29`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:25:26,710::__init__::225::IOProcess::(_processLogs) (274809) Building response >Thread-7083::DEBUG::2014-07-08 17:25:26,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0356c64-8aa4-486f-990f-5aece5763d29`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:25:26,721::__init__::225::IOProcess::(_processLogs) (274809) Queuing response >Thread-7083::DEBUG::2014-07-08 17:25:26,721::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:25:26,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:25:26,727::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:25:26,731::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:25:26,735::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:25:26,743::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:25:26,745::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 17:25:26,747::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:25:26,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:25:26,751::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:25:26,757::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:25:26,761::task::993::Storage.TaskManager.Task::(_decref) Task=`c0356c64-8aa4-486f-990f-5aece5763d29`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:25:26,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:26,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:26,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:26,776::__init__::225::IOProcess::(_processLogs) (274810) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:26,782::__init__::225::IOProcess::(_processLogs) (274810) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:26,786::__init__::225::IOProcess::(_processLogs) (274810) Building response >Thread-18::DEBUG::2014-07-08 17:25:26,789::__init__::225::IOProcess::(_processLogs) (274810) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:26,792::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7086::DEBUG::2014-07-08 17:25:27,972::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:25:27,973::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:25:28,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:29,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175057 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:25:31,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:31,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0891532 s, 11.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:31,550::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:31,641::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:31,653::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:25:33,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb98fa5f-84d2-40a0-ab84-57c6e3472f3e`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:25:33,353::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:25:33,353::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778291', 'lastCheck': '6.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:25:33,353::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb98fa5f-84d2-40a0-ab84-57c6e3472f3e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778291', 'lastCheck': '6.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:25:33,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb98fa5f-84d2-40a0-ab84-57c6e3472f3e`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:25:33,354::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:25:33,354::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:25:33,354::task::993::Storage.TaskManager.Task::(_decref) Task=`eb98fa5f-84d2-40a0-ab84-57c6e3472f3e`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:25:33,387::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:33,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:33,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364495 s, 28.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:25:34,862::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:25:35,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:36,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175875 s, 58.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:36,663::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:36,664::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:36,666::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:25:36,834::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:25:36,834::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:25:36,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:36,840::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 17:25:36,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`98af8f15-c69c-4bb8-9d3f-91e6119348cf`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:25:36,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::INFO::2014-07-08 17:25:36,842::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:36,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:36,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:36,845::__init__::225::IOProcess::(_processLogs) (274811) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:25:36,845::__init__::225::IOProcess::(_processLogs) (274811) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:25:36,845::__init__::225::IOProcess::(_processLogs) (274811) Building response >Thread-18::DEBUG::2014-07-08 17:25:36,846::__init__::225::IOProcess::(_processLogs) (274811) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:36,846::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:36,846::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:25:36,852::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::INFO::2014-07-08 17:25:37,005::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:25:37,098::task::1191::Storage.TaskManager.Task::(prepare) Task=`98af8f15-c69c-4bb8-9d3f-91e6119348cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:25:37,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`98af8f15-c69c-4bb8-9d3f-91e6119348cf`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-08 17:25:37,100::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000512623 s, 901 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:25:37,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:25:37,115::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:25:37,122::task::993::Storage.TaskManager.Task::(_decref) Task=`98af8f15-c69c-4bb8-9d3f-91e6119348cf`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:25:37,127::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:25:37,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:37,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:37,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:37,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:37,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:37,145::__init__::225::IOProcess::(_processLogs) (274812) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:25:37,146::__init__::225::IOProcess::(_processLogs) (274812) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:25:37,148::__init__::225::IOProcess::(_processLogs) (274812) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:37,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:37,151::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:25:37,159::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:25:37,167::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bc2a713-bf0f-4746-85c8-5f544cea14bd`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:25:37,173::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:37,175::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:25:37,181::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2108b512-2d4e-4cf5-bf79-fa05c836c2ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:25:37,184::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:25:37,184::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:37,193::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:25:37,193::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:25:37,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:25:37,196::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2108b512-2d4e-4cf5-bf79-fa05c836c2ee`::Granted request >Thread-18::DEBUG::2014-07-08 17:25:37,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:37,202::__init__::225::IOProcess::(_processLogs) (274813) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:25:37,205::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4bc2a713-bf0f-4746-85c8-5f544cea14bd`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:25:37,206::__init__::225::IOProcess::(_processLogs) (274813) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:25:37,208::task::993::Storage.TaskManager.Task::(_decref) Task=`4bc2a713-bf0f-4746-85c8-5f544cea14bd`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:25:37,210::__init__::225::IOProcess::(_processLogs) (274813) Building response >Thread-18::DEBUG::2014-07-08 17:25:37,214::__init__::225::IOProcess::(_processLogs) (274813) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:37,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:37,222::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:25:37,239::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:25:37,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:37,253::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:37,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:37,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:37,267::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:37,268::__init__::225::IOProcess::(_processLogs) (274814) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:37,271::__init__::225::IOProcess::(_processLogs) (274814) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:37,274::__init__::225::IOProcess::(_processLogs) (274814) Building response >Thread-18::DEBUG::2014-07-08 17:25:37,278::__init__::225::IOProcess::(_processLogs) (274814) Queuing response >Thread-7083::INFO::2014-07-08 17:25:37,284::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:25:37,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:25:37,290::task::1191::Storage.TaskManager.Task::(prepare) Task=`4bc2a713-bf0f-4746-85c8-5f544cea14bd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:25:37,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bc2a713-bf0f-4746-85c8-5f544cea14bd`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:25:37,295::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:25:37,300::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:25:37,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:25:37,318::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:25:37,326::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 17:25:37,329::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:25:37,333::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:25:37,333::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:25:37,336::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:25:37,340::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:25:37,342::task::993::Storage.TaskManager.Task::(_decref) Task=`4bc2a713-bf0f-4746-85c8-5f544cea14bd`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:25:37,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:37,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:37,360::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:37,363::__init__::225::IOProcess::(_processLogs) (274815) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:37,366::__init__::225::IOProcess::(_processLogs) (274815) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:37,370::__init__::225::IOProcess::(_processLogs) (274815) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:37,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:37,376::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:25:38,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:38,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188729 s, 54.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:25:40,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:40,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172898 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:41,673::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:41,674::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:41,676::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:42,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:42,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176552 s, 58.0 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:25:43,157::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:25:43,157::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:25:45,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:45,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171657 s, 59.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:46,683::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:46,684::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:46,686::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:25:47,208::BindingXMLRPC::1107::vds::(wrapper) client [10.35.162.23]::call vmHotplugNic with ({'nic': {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:88:5c', 'linkActive': 'true', 'network': 'net5', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1bd7c118-9cf8-4012-89ec-a9ad88b06007', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, 'vmId': '9b0bd5aa-d706-426a-a077-62a64954b803'},) {} flowID [43b93ea] >Thread-7082::DEBUG::2014-07-08 17:25:47,211::vm::3329::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug NIC xml: <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > <mac address="00:1a:4a:16:88:5c"/> > <model type="virtio"/> > <source bridge="net5"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> ></interface> > >Dummy-6860::DEBUG::2014-07-08 17:25:47,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:25:47,467::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 17:25:47,470::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:25:47,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:47,476::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7087::DEBUG::2014-07-08 17:25:47,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`3587f7fe-e869-4132-b562-f20c954acf89`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:25:47,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7087::INFO::2014-07-08 17:25:47,481::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:47,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:47,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:47,488::__init__::225::IOProcess::(_processLogs) (274816) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:25:47,490::__init__::225::IOProcess::(_processLogs) (274816) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:25:47,492::__init__::225::IOProcess::(_processLogs) (274816) Building response >Thread-18::DEBUG::2014-07-08 17:25:47,492::__init__::225::IOProcess::(_processLogs) (274816) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:47,492::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:47,493::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:25:47,496::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::INFO::2014-07-08 17:25:47,652::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:25:47,666::task::1191::Storage.TaskManager.Task::(prepare) Task=`3587f7fe-e869-4132-b562-f20c954acf89`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 17:25:47,667::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000667108 s, 693 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:25:47,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`3587f7fe-e869-4132-b562-f20c954acf89`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:25:47,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:25:47,772::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:25:47,777::task::993::Storage.TaskManager.Task::(_decref) Task=`3587f7fe-e869-4132-b562-f20c954acf89`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:25:47,776::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:25:47,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:47,792::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:47,797::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:47,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:25:47,813::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Dummy-6860::DEBUG::2014-07-08 17:25:47,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.357865 s, 2.9 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:25:47,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`76e51e2e-28a4-4cb5-a7c8-2f37a08f5449`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:25:47,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::INFO::2014-07-08 17:25:47,985::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:47,993::__init__::225::IOProcess::(_processLogs) (274817) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:25:48,001::__init__::225::IOProcess::(_processLogs) (274817) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:25:48,010::__init__::225::IOProcess::(_processLogs) (274817) Building response >Thread-7083::DEBUG::2014-07-08 17:25:48,014::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`daf9201d-ffce-4d41-9d3f-fd24c149d91f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:25:48,017::__init__::225::IOProcess::(_processLogs) (274817) Queuing response >Thread-7083::DEBUG::2014-07-08 17:25:48,024::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:25:48,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:48,038::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:25:48,039::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7082::DEBUG::2014-07-08 17:25:48,045::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 1 edom: 0 level: 2 message: An error occurred, but the cause is unknown >Thread-7083::DEBUG::2014-07-08 17:25:48,051::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`daf9201d-ffce-4d41-9d3f-fd24c149d91f`::Granted request >Thread-7082::ERROR::2014-07-08 17:25:48,058::vm::3334::vm.Vm::(hotplugNic) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Hotplug failed >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 3332, in hotplugNic > self._dom.attachDevice(nicXml) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 399, in attachDevice > if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) >libvirtError: An error occurred, but the cause is unknown >Thread-7083::DEBUG::2014-07-08 17:25:48,086::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`76e51e2e-28a4-4cb5-a7c8-2f37a08f5449`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7082::DEBUG::2014-07-08 17:25:48,089::BindingXMLRPC::1114::vds::(wrapper) return vmHotplugNic with {'status': {'message': 'An error occurred, but the cause is unknown', 'code': 49}} >Thread-7083::DEBUG::2014-07-08 17:25:48,097::task::993::Storage.TaskManager.Task::(_decref) Task=`76e51e2e-28a4-4cb5-a7c8-2f37a08f5449`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:25:48,102::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:25:48,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:48,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:48,133::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:48,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:48,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:48,154::__init__::225::IOProcess::(_processLogs) (274818) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:48,163::__init__::225::IOProcess::(_processLogs) (274818) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:48,171::__init__::225::IOProcess::(_processLogs) (274818) Building response >Thread-18::DEBUG::2014-07-08 17:25:48,181::__init__::225::IOProcess::(_processLogs) (274818) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:48,188::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:48,195::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:25:48,220::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:25:48,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:48,234::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:48,237::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:48,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:48,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::INFO::2014-07-08 17:25:48,250::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:25:48,254::__init__::225::IOProcess::(_processLogs) (274819) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:25:48,258::task::1191::Storage.TaskManager.Task::(prepare) Task=`76e51e2e-28a4-4cb5-a7c8-2f37a08f5449`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:25:48,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`76e51e2e-28a4-4cb5-a7c8-2f37a08f5449`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:25:48,264::__init__::225::IOProcess::(_processLogs) (274819) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:25:48,269::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:25:48,274::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:25:48,275::__init__::225::IOProcess::(_processLogs) (274819) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:48,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:25:48,285::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:25:48,292::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:25:48,294::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:25:48,297::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:25:48,299::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:25:48,307::task::993::Storage.TaskManager.Task::(_decref) Task=`76e51e2e-28a4-4cb5-a7c8-2f37a08f5449`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:25:48,309::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:25:48,314::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:48,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:48,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:48,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:48,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:48,335::__init__::225::IOProcess::(_processLogs) (274820) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:48,338::__init__::225::IOProcess::(_processLogs) (274820) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:48,340::__init__::225::IOProcess::(_processLogs) (274820) Building response >Thread-18::DEBUG::2014-07-08 17:25:48,343::__init__::225::IOProcess::(_processLogs) (274820) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:48,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:48,350::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:25:48,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`491759cb-0ec0-4fda-9fcf-900e10c77c45`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:25:48,518::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:25:48,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667108', 'lastCheck': '0.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:25:48,524::task::1191::Storage.TaskManager.Task::(prepare) Task=`491759cb-0ec0-4fda-9fcf-900e10c77c45`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667108', 'lastCheck': '0.2', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:25:48,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`491759cb-0ec0-4fda-9fcf-900e10c77c45`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:25:48,527::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:25:48,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:25:48,530::task::993::Storage.TaskManager.Task::(_decref) Task=`491759cb-0ec0-4fda-9fcf-900e10c77c45`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:25:48,597::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:50,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:50,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172241 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:51,693::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:51,694::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:51,695::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:52,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:53,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174468 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:25:55,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:55,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175146 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:56,702::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:56,704::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:25:56,705::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:25:57,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:57,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172987 s, 59.2 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:25:58,240::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:25:58,240::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Thread-7082::DEBUG::2014-07-08 17:25:58,347::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:25:58,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5ac8122-74b0-4001-b551-4a4df4ca919e`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:25:58,348::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:58,359::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:25:58,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:58,360::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:58,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:58,362::__init__::225::IOProcess::(_processLogs) (274821) Got request for method 'statvfs' >Thread-7082::INFO::2014-07-08 17:25:58,363::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:25:58,364::__init__::225::IOProcess::(_processLogs) (274821) Queuing response >Thread-7082::DEBUG::2014-07-08 17:25:58,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5ac8122-74b0-4001-b551-4a4df4ca919e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:25:58,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 17:25:58,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5ac8122-74b0-4001-b551-4a4df4ca919e`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:25:58,368::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 17:25:58,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:25:58,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:25:58,372::task::993::Storage.TaskManager.Task::(_decref) Task=`e5ac8122-74b0-4001-b551-4a4df4ca919e`::ref 0 aborting False >Thread-37::DEBUG::2014-07-08 17:25:58,375::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:25:58,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000881654 s, 524 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:25:58,658::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7083::DEBUG::2014-07-08 17:25:58,658::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:25:58,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:25:58,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fb5cc2e-7f1c-468c-ae4b-55cf0a08b7e3`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:25:58,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::INFO::2014-07-08 17:25:58,684::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:25:58,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:58,695::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:58,703::__init__::225::IOProcess::(_processLogs) (274822) Finding callback 'statvfs'... >Thread-7083::DEBUG::2014-07-08 17:25:58,705::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8633767b-00d2-45c4-b369-caae696bfde2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:25:58,709::__init__::225::IOProcess::(_processLogs) (274822) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:25:58,715::__init__::225::IOProcess::(_processLogs) (274822) Building response >Thread-7083::DEBUG::2014-07-08 17:25:58,714::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:25:58,807::__init__::225::IOProcess::(_processLogs) (274822) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:58,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:58,823::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:25:58,818::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:25:58,842::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`8633767b-00d2-45c4-b369-caae696bfde2`::Granted request >Thread-18::DEBUG::2014-07-08 17:25:58,865::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:25:58,866::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5fb5cc2e-7f1c-468c-ae4b-55cf0a08b7e3`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:25:58,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:58,873::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:25:58,872::task::993::Storage.TaskManager.Task::(_decref) Task=`5fb5cc2e-7f1c-468c-ae4b-55cf0a08b7e3`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:25:58,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:58,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:58,885::__init__::225::IOProcess::(_processLogs) (274823) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:58,891::__init__::225::IOProcess::(_processLogs) (274823) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:58,898::__init__::225::IOProcess::(_processLogs) (274823) Building response >Thread-18::DEBUG::2014-07-08 17:25:58,906::__init__::225::IOProcess::(_processLogs) (274823) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:58,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:58,918::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:25:58,941::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:25:58,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:25:58,954::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:25:58,957::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:25:58,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:58,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:25:58,965::__init__::225::IOProcess::(_processLogs) (274824) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:25:58,967::__init__::225::IOProcess::(_processLogs) (274824) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:25:58,969::__init__::225::IOProcess::(_processLogs) (274824) Building response >Thread-18::DEBUG::2014-07-08 17:25:58,969::__init__::225::IOProcess::(_processLogs) (274824) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:58,970::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:25:58,971::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:25:58,978::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:25:58,981::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:25:58,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:25:58,983::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fb5cc2e-7f1c-468c-ae4b-55cf0a08b7e3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:25:58,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:25:58,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fb5cc2e-7f1c-468c-ae4b-55cf0a08b7e3`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:25:58,990::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:25:58,991::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:25:58,994::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:25:58,993::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:25:58,997::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:25:58,998::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:25:59,000::__init__::225::IOProcess::(_processLogs) (274825) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:25:59,002::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:25:59,002::__init__::225::IOProcess::(_processLogs) (274825) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:25:59,004::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:25:59,005::__init__::225::IOProcess::(_processLogs) (274825) Building response >Thread-7083::DEBUG::2014-07-08 17:25:59,006::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:25:59,008::__init__::225::IOProcess::(_processLogs) (274825) Queuing response >Thread-18::DEBUG::2014-07-08 17:25:59,010::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:25:59,011::task::993::Storage.TaskManager.Task::(_decref) Task=`5fb5cc2e-7f1c-468c-ae4b-55cf0a08b7e3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:25:59,013::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:25:59,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:25:59,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174666 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:01,710::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:01,711::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:01,712::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:01,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:02,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173923 s, 58.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:26:03,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`27763ce8-e645-47cb-8b8c-91b1de06b00e`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:26:03,792::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:26:03,792::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000881654', 'lastCheck': '4.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:26:03,792::task::1191::Storage.TaskManager.Task::(prepare) Task=`27763ce8-e645-47cb-8b8c-91b1de06b00e`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000881654', 'lastCheck': '4.8', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:26:03,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`27763ce8-e645-47cb-8b8c-91b1de06b00e`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:26:03,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:26:03,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:26:03,794::task::993::Storage.TaskManager.Task::(_decref) Task=`27763ce8-e645-47cb-8b8c-91b1de06b00e`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:26:03,827::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:04,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:04,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176384 s, 58.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:26:05,326::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:26:06,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:06,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176535 s, 58.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:06,720::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:06,722::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:06,724::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:08,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:08,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170121 s, 60.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:26:09,024::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:09,025::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:26:09,025::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:09,025::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:09,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:09,026::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:09,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:09,026::__init__::225::IOProcess::(_processLogs) (274826) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:26:09,027::__init__::225::IOProcess::(_processLogs) (274826) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:26:09,027::__init__::225::IOProcess::(_processLogs) (274826) Building response >Thread-18::DEBUG::2014-07-08 17:26:09,027::__init__::225::IOProcess::(_processLogs) (274826) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:09,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:09,028::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:26:09,029::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:26:09,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000527148 s, 876 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:26:09,193::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:26:09,209::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 17:26:09,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`a61ddd8f-35eb-443c-9848-32a638d9d00d`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:26:09,219::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 17:26:09,220::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:26:09,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:09,233::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:09,236::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:09,242::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 17:26:09,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:26:09,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 17:26:09,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`a61ddd8f-35eb-443c-9848-32a638d9d00d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:26:09,257::__init__::225::IOProcess::(_processLogs) (274827) Finding callback 'statvfs'... >Thread-7082::DEBUG::2014-07-08 17:26:09,266::task::595::Storage.TaskManager.Task::(_updateState) Task=`a61ddd8f-35eb-443c-9848-32a638d9d00d`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:26:09,269::__init__::225::IOProcess::(_processLogs) (274827) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 17:26:09,270::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:26:09,276::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:26:09,277::__init__::225::IOProcess::(_processLogs) DEBUG|(274827) Building response >Thread-7082::DEBUG::2014-07-08 17:26:09,282::task::993::Storage.TaskManager.Task::(_decref) Task=`a61ddd8f-35eb-443c-9848-32a638d9d00d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:26:09,284::__init__::225::IOProcess::(_processLogs) (274827) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:09,293::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:09,300::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:26:09,331::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:26:09,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`94028c20-0a12-48e6-9823-be43feee595a`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:26:09,435::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:26:09,435::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:26:09,440::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ed9467e8-fad1-431e-b19d-9a34c49b2f1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:26:09,441::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:26:09,441::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:26:09,443::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:26:09,445::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`ed9467e8-fad1-431e-b19d-9a34c49b2f1c`::Granted request >Thread-18::DEBUG::2014-07-08 17:26:09,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:26:09,450::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`94028c20-0a12-48e6-9823-be43feee595a`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:26:09,450::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:26:09,452::task::993::Storage.TaskManager.Task::(_decref) Task=`94028c20-0a12-48e6-9823-be43feee595a`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:26:09,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:09,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:09,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:09,480::__init__::225::IOProcess::(_processLogs) (274828) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:09,487::__init__::225::IOProcess::(_processLogs) (274828) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:09,489::__init__::225::IOProcess::(_processLogs) (274828) Building response >Thread-18::DEBUG::2014-07-08 17:26:09,491::__init__::225::IOProcess::(_processLogs) (274828) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:09,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:09,495::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:26:09,503::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:26:09,502::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:26:09,505::task::1191::Storage.TaskManager.Task::(prepare) Task=`94028c20-0a12-48e6-9823-be43feee595a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:26:09,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`94028c20-0a12-48e6-9823-be43feee595a`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:26:09,507::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::DEBUG::2014-07-08 17:26:09,508::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:26:09,510::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:26:09,511::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:26:09,512::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:26:09,514::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:26:09,514::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:26:09,515::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:26:09,516::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:26:09,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:26:09,518::task::993::Storage.TaskManager.Task::(_decref) Task=`94028c20-0a12-48e6-9823-be43feee595a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:26:09,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:09,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:09,617::__init__::225::IOProcess::(_processLogs) (274829) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:09,619::__init__::225::IOProcess::(_processLogs) (274829) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:09,621::__init__::225::IOProcess::(_processLogs) (274829) Building response >Thread-18::DEBUG::2014-07-08 17:26:09,623::__init__::225::IOProcess::(_processLogs) (274829) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:09,625::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:09,628::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:26:09,643::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:09,645::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:26:09,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:09,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:09,651::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:09,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:09,655::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:09,657::__init__::225::IOProcess::(_processLogs) (274830) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:09,659::__init__::225::IOProcess::(_processLogs) (274830) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:09,661::__init__::225::IOProcess::(_processLogs) (274830) Building response >Thread-18::DEBUG::2014-07-08 17:26:09,663::__init__::225::IOProcess::(_processLogs) (274830) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:09,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:09,667::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:26:10,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:11,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172481 s, 59.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:11,731::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:11,732::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:11,734::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:13,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7086::DEBUG::2014-07-08 17:26:13,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`7700bd1a-be1c-4bbc-ac96-b1489753be2a`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:26:13,392::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:26:13,403::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:13,407::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:26:13,411::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:13,416::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:13,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:13,425::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:13,429::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:13,432::__init__::225::IOProcess::(_processLogs) (274831) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:26:13,436::__init__::225::IOProcess::(_processLogs) (274831) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:26:13,439::__init__::225::IOProcess::(_processLogs) (274831) Building response >Thread-18::DEBUG::2014-07-08 17:26:13,442::__init__::225::IOProcess::(_processLogs) (274831) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:13,446::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:13,449::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:26:13,473::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:13,475::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:26:13,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:13,476::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:13,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:13,477::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:13,480::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:13,546::__init__::225::IOProcess::(_processLogs) (274832) Finding callback 'stat'... >Dummy-6860::DEBUG::2014-07-08 17:26:13,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0927204 s, 11.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:26:13,547::__init__::225::IOProcess::(_processLogs) (274832) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:26:13,548::__init__::225::IOProcess::(_processLogs) (274832) Building response >Thread-18::DEBUG::2014-07-08 17:26:13,549::__init__::225::IOProcess::(_processLogs) (274832) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:13,550::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:13,551::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:26:13,555::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:26:13,555::task::1191::Storage.TaskManager.Task::(prepare) Task=`7700bd1a-be1c-4bbc-ac96-b1489753be2a`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:26:13,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`7700bd1a-be1c-4bbc-ac96-b1489753be2a`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:26:13,556::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:26:13,556::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:26:13,556::task::993::Storage.TaskManager.Task::(_decref) Task=`7700bd1a-be1c-4bbc-ac96-b1489753be2a`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:26:13,674::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:26:13,675::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:26:15,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:15,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172646 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:16,741::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:16,742::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:16,743::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:17,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:18,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172559 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:26:18,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fd13f8c-f7d2-4522-845b-8826c32bbc9a`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:26:18,940::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:26:18,941::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527148', 'lastCheck': '9.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:26:18,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fd13f8c-f7d2-4522-845b-8826c32bbc9a`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527148', 'lastCheck': '9.3', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:26:18,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fd13f8c-f7d2-4522-845b-8826c32bbc9a`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:26:18,942::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:26:18,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:26:18,942::task::993::Storage.TaskManager.Task::(_decref) Task=`9fd13f8c-f7d2-4522-845b-8826c32bbc9a`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:26:18,972::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:26:19,655::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:26:19,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`02a45cfb-3abf-454b-ada9-aa818a0a1927`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:26:19,656::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:26:19,671::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:26:19,671::task::1191::Storage.TaskManager.Task::(prepare) Task=`02a45cfb-3abf-454b-ada9-aa818a0a1927`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:26:19,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`02a45cfb-3abf-454b-ada9-aa818a0a1927`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:26:19,672::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:26:19,672::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:26:19,672::task::993::Storage.TaskManager.Task::(_decref) Task=`02a45cfb-3abf-454b-ada9-aa818a0a1927`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:26:19,676::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:19,677::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:26:19,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:19,677::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:19,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:19,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:19,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:19,678::__init__::225::IOProcess::(_processLogs) (274833) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:26:19,678::__init__::225::IOProcess::(_processLogs) (274833) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:26:19,679::__init__::225::IOProcess::(_processLogs) (274833) Building response >Thread-18::DEBUG::2014-07-08 17:26:19,679::__init__::225::IOProcess::(_processLogs) (274833) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:19,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:19,679::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:26:19,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:26:19,844::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:26:19,844::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000484686 s, 953 kB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:26:19,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3b6336d-893c-4920-bb62-2980e28dd00c`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:26:19,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:26:19,857::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:19,862::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7083::DEBUG::2014-07-08 17:26:19,863::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a1b48984-e17d-47c5-bd06-514f3e8cd331`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:26:19,866::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:26:19,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:26:19,871::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:26:19,872::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:26:19,872::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a1b48984-e17d-47c5-bd06-514f3e8cd331`::Granted request >Thread-18::DEBUG::2014-07-08 17:26:19,874::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:19,878::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:19,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:26:19,882::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e3b6336d-893c-4920-bb62-2980e28dd00c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:26:19,884::__init__::225::IOProcess::(_processLogs) (274834) Finding callback 'statvfs'... >Thread-7083::DEBUG::2014-07-08 17:26:19,886::task::993::Storage.TaskManager.Task::(_decref) Task=`e3b6336d-893c-4920-bb62-2980e28dd00c`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:26:19,887::__init__::225::IOProcess::(_processLogs) (274834) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:26:19,891::__init__::225::IOProcess::(_processLogs) (274834) Building response >Thread-18::DEBUG::2014-07-08 17:26:19,894::__init__::225::IOProcess::(_processLogs) (274834) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:19,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:19,901::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:26:19,917::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:19,920::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:26:19,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:19,928::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:19,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:19,935::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:19,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:19,938::__init__::225::IOProcess::(_processLogs) (274835) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:19,940::__init__::225::IOProcess::(_processLogs) (274835) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:19,942::__init__::225::IOProcess::(_processLogs) (274835) Building response >Thread-18::DEBUG::2014-07-08 17:26:19,947::__init__::225::IOProcess::(_processLogs) (274835) Queuing response >Thread-7083::INFO::2014-07-08 17:26:19,950::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:26:19,951::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:26:19,952::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3b6336d-893c-4920-bb62-2980e28dd00c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:26:19,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3b6336d-893c-4920-bb62-2980e28dd00c`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:26:19,956::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:26:19,956::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:26:19,959::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:26:19,964::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:26:19,968::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:26:19,970::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:26:19,971::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:26:19,973::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::DEBUG::2014-07-08 17:26:19,974::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:26:19,977::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:26:19,980::task::993::Storage.TaskManager.Task::(_decref) Task=`e3b6336d-893c-4920-bb62-2980e28dd00c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:26:19,980::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:19,985::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:19,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:19,992::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:19,995::__init__::225::IOProcess::(_processLogs) (274836) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:19,997::__init__::225::IOProcess::(_processLogs) (274836) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:19,998::__init__::225::IOProcess::(_processLogs) (274836) Building response >Thread-18::DEBUG::2014-07-08 17:26:19,999::__init__::225::IOProcess::(_processLogs) (274836) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:20,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:20,002::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:26:20,007::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:20,009::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:26:20,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:20,012::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:20,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:20,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:20,017::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:20,018::__init__::225::IOProcess::(_processLogs) (274837) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:20,019::__init__::225::IOProcess::(_processLogs) (274837) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:20,021::__init__::225::IOProcess::(_processLogs) (274837) Building response >Thread-18::DEBUG::2014-07-08 17:26:20,022::__init__::225::IOProcess::(_processLogs) (274837) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:20,024::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:20,025::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:26:20,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:20,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137607 s, 7.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:21,751::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:21,752::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:21,753::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:22,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:22,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174831 s, 58.6 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:26:24,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:25,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176487 s, 58.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:26,761::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:26,762::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:26,764::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:27,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:27,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017254 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:26:28,870::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:26:28,870::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:26:29,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:29,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0206337 s, 49.6 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:26:30,006::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:26:30,008::task::595::Storage.TaskManager.Task::(_updateState) Task=`0758d801-4781-4025-9642-63f017d4d371`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:26:30,008::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:26:30,023::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:26:30,023::task::1191::Storage.TaskManager.Task::(prepare) Task=`0758d801-4781-4025-9642-63f017d4d371`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:26:30,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`0758d801-4781-4025-9642-63f017d4d371`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:26:30,024::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:26:30,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:26:30,024::task::993::Storage.TaskManager.Task::(_decref) Task=`0758d801-4781-4025-9642-63f017d4d371`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:26:30,031::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:30,031::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:26:30,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:30,032::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:30,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:30,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:30,033::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:30,033::__init__::225::IOProcess::(_processLogs) (274838) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:26:30,033::__init__::225::IOProcess::(_processLogs) (274838) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:26:30,033::__init__::225::IOProcess::(_processLogs) (274838) Building response >Thread-18::DEBUG::2014-07-08 17:26:30,033::__init__::225::IOProcess::(_processLogs) (274838) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:30,034::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:30,034::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:26:30,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:26:30,039::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:26:30,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000595592 s, 776 kB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:26:30,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e0e521f-ce48-4642-aa32-dcfd400fb107`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:26:30,197::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:26:30,197::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:30,200::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7083::DEBUG::2014-07-08 17:26:30,202::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0d642aa5-ac53-4c58-b8db-974b22beac8b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:26:30,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:26:30,203::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:26:30,205::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-7083::DEBUG::2014-07-08 17:26:30,205::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:26:30,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:26:30,207::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0d642aa5-ac53-4c58-b8db-974b22beac8b`::Granted request >Thread-18::DEBUG::2014-07-08 17:26:30,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:26:30,210::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6e0e521f-ce48-4642-aa32-dcfd400fb107`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:26:30,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:26:30,211::task::993::Storage.TaskManager.Task::(_decref) Task=`6e0e521f-ce48-4642-aa32-dcfd400fb107`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:26:30,213::__init__::225::IOProcess::(_processLogs) (274839) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:26:30,215::__init__::225::IOProcess::(_processLogs) (274839) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:26:30,216::__init__::225::IOProcess::(_processLogs) (274839) Building response >Thread-18::DEBUG::2014-07-08 17:26:30,217::__init__::225::IOProcess::(_processLogs) (274839) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:30,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:30,221::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:26:30,232::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:30,233::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:26:30,233::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:30,234::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:30,234::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:30,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:30,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:30,235::__init__::225::IOProcess::(_processLogs) (274840) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:30,235::__init__::225::IOProcess::(_processLogs) (274840) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:30,236::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274840) Building response >Thread-18::DEBUG::2014-07-08 17:26:30,236::__init__::225::IOProcess::(_processLogs) (274840) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:30,236::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:30,236::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:26:30,246::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:30,247::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:26:30,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:30,248::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:30,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:30,248::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:30,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:30,249::__init__::225::IOProcess::(_processLogs) (274841) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:30,249::__init__::225::IOProcess::(_processLogs) (274841) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:30,249::__init__::225::IOProcess::(_processLogs) (274841) Building response >Thread-18::DEBUG::2014-07-08 17:26:30,249::__init__::225::IOProcess::(_processLogs) (274841) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:30,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:30,250::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:26:30,251::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:30,252::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:26:30,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:30,254::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::INFO::2014-07-08 17:26:30,254::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:26:30,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:26:30,256::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e0e521f-ce48-4642-aa32-dcfd400fb107`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:26:30,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:26:30,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e0e521f-ce48-4642-aa32-dcfd400fb107`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:26:30,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:26:30,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:26:30,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:26:30,260::__init__::225::IOProcess::(_processLogs) (274842) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:30,262::__init__::225::IOProcess::(_processLogs) (274842) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:26:30,262::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:26:30,263::__init__::225::IOProcess::(_processLogs) (274842) Building response >Thread-7083::DEBUG::2014-07-08 17:26:30,264::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-18::DEBUG::2014-07-08 17:26:30,265::__init__::225::IOProcess::(_processLogs) (274842) Queuing response >Thread-7083::DEBUG::2014-07-08 17:26:30,265::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:26:30,267::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:26:30,267::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:26:30,268::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:26:30,269::task::993::Storage.TaskManager.Task::(_decref) Task=`6e0e521f-ce48-4642-aa32-dcfd400fb107`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:26:31,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:31,798::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:31,809::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:31,821::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:31,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0577017 s, 17.7 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:26:33,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:34,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0191911 s, 53.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:26:34,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`31eb1ff0-fb4d-4e26-b599-d2a47967072c`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:26:34,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:26:34,210::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595592', 'lastCheck': '3.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:26:34,212::task::1191::Storage.TaskManager.Task::(prepare) Task=`31eb1ff0-fb4d-4e26-b599-d2a47967072c`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595592', 'lastCheck': '3.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:26:34,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`31eb1ff0-fb4d-4e26-b599-d2a47967072c`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:26:34,214::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:26:34,215::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:26:34,217::task::993::Storage.TaskManager.Task::(_decref) Task=`31eb1ff0-fb4d-4e26-b599-d2a47967072c`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:26:34,275::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:26:35,530::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:26:36,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:36,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896731 s, 11.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:36,838::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:36,840::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:36,841::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:38,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:38,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173892 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:26:40,274::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:40,274::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:26:40,274::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:40,275::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:40,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:40,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:40,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:40,276::__init__::225::IOProcess::(_processLogs) (274843) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:26:40,276::__init__::225::IOProcess::(_processLogs) (274843) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:26:40,276::__init__::225::IOProcess::(_processLogs) (274843) Building response >Thread-18::DEBUG::2014-07-08 17:26:40,276::__init__::225::IOProcess::(_processLogs) (274843) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:40,276::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:40,277::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:26:40,278::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:26:40,435::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:26:40,438::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00105933 s, 436 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:26:40,440::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b4e0910-73c6-43dd-89aa-5ecc972ab512`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:26:40,443::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-7082::INFO::2014-07-08 17:26:40,444::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:26:40,444::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:26:40,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:40,447::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:40,447::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:40,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:40,447::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:40,448::__init__::225::IOProcess::(_processLogs) (274844) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:26:40,448::__init__::225::IOProcess::(_processLogs) (274844) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:26:40,448::__init__::225::IOProcess::(_processLogs) (274844) Building response >Thread-18::DEBUG::2014-07-08 17:26:40,448::__init__::225::IOProcess::(_processLogs) (274844) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:40,449::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:40,449::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:26:40,460::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-7082::INFO::2014-07-08 17:26:40,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:26:40,461::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7082::DEBUG::2014-07-08 17:26:40,462::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b4e0910-73c6-43dd-89aa-5ecc972ab512`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:26:40,463::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 17:26:40,463::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b4e0910-73c6-43dd-89aa-5ecc972ab512`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:26:40,465::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:26:40,465::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-7082::DEBUG::2014-07-08 17:26:40,466::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:26:40,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 17:26:40,467::task::993::Storage.TaskManager.Task::(_decref) Task=`9b4e0910-73c6-43dd-89aa-5ecc972ab512`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:26:40,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:40,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:40,471::__init__::225::IOProcess::(_processLogs) (274845) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:40,472::__init__::225::IOProcess::(_processLogs) (274845) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:40,473::__init__::225::IOProcess::(_processLogs) (274845) Building response >Thread-18::DEBUG::2014-07-08 17:26:40,473::__init__::225::IOProcess::(_processLogs) (274845) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:40,473::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:40,473::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:26:40,475::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:40,475::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:26:40,475::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:40,475::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:40,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:40,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:40,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:40,476::__init__::225::IOProcess::(_processLogs) (274846) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:40,477::__init__::225::IOProcess::(_processLogs) (274846) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:40,477::__init__::225::IOProcess::(_processLogs) (274846) Building response >Thread-18::DEBUG::2014-07-08 17:26:40,477::__init__::225::IOProcess::(_processLogs) (274846) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:40,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:40,477::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:26:40,479::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:26:40,479::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:26:40,479::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:40,479::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:40,480::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:40,480::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:40,480::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:40,480::__init__::225::IOProcess::(_processLogs) (274847) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:40,481::__init__::225::IOProcess::(_processLogs) (274847) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:40,481::__init__::225::IOProcess::(_processLogs) (274847) Building response >Thread-18::DEBUG::2014-07-08 17:26:40,481::__init__::225::IOProcess::(_processLogs) (274847) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:40,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:40,483::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:26:40,484::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:26:40,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a689863-2f23-4e4f-b2c8-1e17865e6a67`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:26:40,488::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:26:40,489::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0be2942b-5782-44b6-99bf-42934c76b2fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:26:40,489::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:26:40,490::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:26:40,490::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`0be2942b-5782-44b6-99bf-42934c76b2fb`::Granted request >Thread-7083::DEBUG::2014-07-08 17:26:40,491::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5a689863-2f23-4e4f-b2c8-1e17865e6a67`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:26:40,491::task::993::Storage.TaskManager.Task::(_decref) Task=`5a689863-2f23-4e4f-b2c8-1e17865e6a67`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:26:40,510::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:26:40,510::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a689863-2f23-4e4f-b2c8-1e17865e6a67`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:26:40,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a689863-2f23-4e4f-b2c8-1e17865e6a67`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:26:40,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:26:40,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:26:40,511::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:26:40,512::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:26:40,512::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:26:40,512::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:26:40,513::task::993::Storage.TaskManager.Task::(_decref) Task=`5a689863-2f23-4e4f-b2c8-1e17865e6a67`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:26:40,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:41,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170515 s, 60.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:41,849::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:41,941::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:41,949::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:43,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:43,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171816 s, 59.6 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:26:43,965::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:26:43,966::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:26:45,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:45,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175029 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:46,957::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:46,959::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:46,960::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:47,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:47,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176015 s, 58.2 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:26:49,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`960a6fe0-27f0-4274-9777-ddcf137df9bc`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:26:49,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:26:49,486::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105933', 'lastCheck': '9.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:26:49,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`960a6fe0-27f0-4274-9777-ddcf137df9bc`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105933', 'lastCheck': '9.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:26:49,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`960a6fe0-27f0-4274-9777-ddcf137df9bc`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:26:49,487::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:26:49,487::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:26:49,487::task::993::Storage.TaskManager.Task::(_decref) Task=`960a6fe0-27f0-4274-9777-ddcf137df9bc`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:26:49,518::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:50,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:50,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365205 s, 28.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:26:50,490::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:26:50,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:50,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:50,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:50,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:50,491::__init__::225::IOProcess::(_processLogs) (274848) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:26:50,492::__init__::225::IOProcess::(_processLogs) (274848) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:26:50,492::__init__::225::IOProcess::(_processLogs) (274848) Building response >Thread-18::DEBUG::2014-07-08 17:26:50,492::__init__::225::IOProcess::(_processLogs) (274848) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:50,492::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-37::DEBUG::2014-07-08 17:26:50,494::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:26:50,657::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:26:50,660::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000532457 s, 868 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:26:50,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cfb086a-242c-4ae3-811f-28c77e0b9876`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:26:50,665::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 17:26:50,666::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:26:50,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:50,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:50,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:50,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:50,669::__init__::225::IOProcess::(_processLogs) (274849) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:26:50,669::__init__::225::IOProcess::(_processLogs) (274849) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:26:50,669::__init__::225::IOProcess::(_processLogs) (274849) Building response >Thread-18::DEBUG::2014-07-08 17:26:50,670::__init__::225::IOProcess::(_processLogs) (274849) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:50,670::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:50,670::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:26:50,672::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:26:50,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:50,673::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:50,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:50,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:50,674::__init__::225::IOProcess::(_processLogs) (274850) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:50,674::__init__::225::IOProcess::(_processLogs) (274850) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:50,674::__init__::225::IOProcess::(_processLogs) (274850) Building response >Thread-18::DEBUG::2014-07-08 17:26:50,674::__init__::225::IOProcess::(_processLogs) (274850) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:50,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:26:50,675::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:26:50,676::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:26:50,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:50,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:50,677::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:50,678::__init__::225::IOProcess::(_processLogs) (274851) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:50,678::__init__::225::IOProcess::(_processLogs) (274851) Queuing response >Thread-18::DEBUG::2014-07-08 17:26:50,680::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:26:50,680::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:26:50,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:26:50,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:26:50,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:26:50,681::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:26:50,682::__init__::225::IOProcess::(_processLogs) (274852) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:26:50,682::__init__::225::IOProcess::(_processLogs) (274852) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:26:50,682::__init__::225::IOProcess::(_processLogs) (274852) Building response >Thread-7082::INFO::2014-07-08 17:26:50,683::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:26:50,683::__init__::225::IOProcess::(_processLogs) (274852) Queuing response >Thread-7082::DEBUG::2014-07-08 17:26:50,685::task::1191::Storage.TaskManager.Task::(prepare) Task=`9cfb086a-242c-4ae3-811f-28c77e0b9876`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:26:50,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 17:26:50,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cfb086a-242c-4ae3-811f-28c77e0b9876`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:26:50,687::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:26:50,688::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:26:50,689::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:26:50,690::task::993::Storage.TaskManager.Task::(_decref) Task=`9cfb086a-242c-4ae3-811f-28c77e0b9876`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:26:50,703::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:26:50,707::task::595::Storage.TaskManager.Task::(_updateState) Task=`83740a0f-dc6c-4d84-9510-c877b4ffe0ec`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:26:50,709::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:26:50,713::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`43ee87a7-de87-4cec-b4d0-05af67bba7c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:26:50,715::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:26:50,717::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:26:50,719::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`43ee87a7-de87-4cec-b4d0-05af67bba7c3`::Granted request >Thread-7083::DEBUG::2014-07-08 17:26:50,722::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`83740a0f-dc6c-4d84-9510-c877b4ffe0ec`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:26:50,724::task::993::Storage.TaskManager.Task::(_decref) Task=`83740a0f-dc6c-4d84-9510-c877b4ffe0ec`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:26:50,762::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:26:50,765::task::1191::Storage.TaskManager.Task::(prepare) Task=`83740a0f-dc6c-4d84-9510-c877b4ffe0ec`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:26:50,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`83740a0f-dc6c-4d84-9510-c877b4ffe0ec`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:26:50,767::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:26:50,768::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:26:50,771::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:26:50,774::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:26:50,775::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:26:50,776::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:26:50,779::task::993::Storage.TaskManager.Task::(_decref) Task=`83740a0f-dc6c-4d84-9510-c877b4ffe0ec`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:51,967::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:51,968::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:51,969::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:52,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:52,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.091204 s, 11.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:26:54,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:55,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017318 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:56,975::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:56,976::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:26:56,977::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:26:57,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:57,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204535 s, 50.1 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:26:59,006::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:26:59,007::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:26:59,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:26:59,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172613 s, 59.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:27:00,694::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:00,694::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:27:00,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:00,695::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:00,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:00,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:00,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:00,697::__init__::225::IOProcess::(_processLogs) (274853) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:27:00,697::__init__::225::IOProcess::(_processLogs) (274853) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:00,697::__init__::225::IOProcess::(_processLogs) (274853) Building response >Thread-18::DEBUG::2014-07-08 17:27:00,697::__init__::225::IOProcess::(_processLogs) (274853) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:00,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:00,698::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:27:00,700::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:27:00,856::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000464852 s, 994 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:27:00,863::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:27:00,866::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:27:00,869::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:00,872::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 17:27:00,873::task::595::Storage.TaskManager.Task::(_updateState) Task=`07563ead-f1cb-48f9-9bfa-1dde4c6c5cd8`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:27:00,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:00,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 17:27:00,878::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:27:00,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:00,883::__init__::225::IOProcess::(_processLogs) (274854) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:27:00,888::__init__::225::IOProcess::(_processLogs) (274854) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:00,890::__init__::225::IOProcess::(_processLogs) (274854) Building response >Thread-18::DEBUG::2014-07-08 17:27:00,891::__init__::225::IOProcess::(_processLogs) (274854) Queuing response >Thread-7082::INFO::2014-07-08 17:27:00,897::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:27:00,899::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 17:27:00,900::task::1191::Storage.TaskManager.Task::(prepare) Task=`07563ead-f1cb-48f9-9bfa-1dde4c6c5cd8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:27:00,902::task::595::Storage.TaskManager.Task::(_updateState) Task=`07563ead-f1cb-48f9-9bfa-1dde4c6c5cd8`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:27:00,902::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 17:27:00,904::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:27:00,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:27:00,908::task::993::Storage.TaskManager.Task::(_decref) Task=`07563ead-f1cb-48f9-9bfa-1dde4c6c5cd8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:27:00,921::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:27:00,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:00,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:00,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:00,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:00,927::__init__::225::IOProcess::(_processLogs) (274855) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:00,929::__init__::225::IOProcess::(_processLogs) (274855) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:27:00,932::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:27:00,933::__init__::225::IOProcess::(_processLogs) (274855) Building response >Thread-18::DEBUG::2014-07-08 17:27:00,937::__init__::225::IOProcess::(_processLogs) (274855) Queuing response >Thread-7083::DEBUG::2014-07-08 17:27:00,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac4ffb30-da99-43d4-93ef-e6f6cd6a6f1c`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:27:00,940::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::INFO::2014-07-08 17:27:00,941::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:27:00,942::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:27:00,949::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`53beb660-133c-4318-9190-75dbc1993b4d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:27:00,952::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:27:00,954::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:27:00,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:27:00,958::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:27:00,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:27:00,961::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`53beb660-133c-4318-9190-75dbc1993b4d`::Granted request >Thread-18::DEBUG::2014-07-08 17:27:00,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:27:00,967::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac4ffb30-da99-43d4-93ef-e6f6cd6a6f1c`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:27:00,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:27:00,969::task::993::Storage.TaskManager.Task::(_decref) Task=`ac4ffb30-da99-43d4-93ef-e6f6cd6a6f1c`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:27:00,970::__init__::225::IOProcess::(_processLogs) (274856) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:00,973::__init__::225::IOProcess::(_processLogs) (274856) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:00,977::__init__::225::IOProcess::(_processLogs) (274856) Building response >Thread-18::DEBUG::2014-07-08 17:27:00,980::__init__::225::IOProcess::(_processLogs) (274856) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:00,984::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:00,987::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:27:01,000::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:27:01,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:01,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:01,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:01,017::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:01,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:01,020::__init__::225::IOProcess::(_processLogs) (274857) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:01,025::__init__::225::IOProcess::(_processLogs) (274857) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:01,026::__init__::225::IOProcess::(_processLogs) (274857) Building response >Thread-18::DEBUG::2014-07-08 17:27:01,027::__init__::225::IOProcess::(_processLogs) (274857) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:01,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:01,029::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:27:01,033::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:27:01,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac4ffb30-da99-43d4-93ef-e6f6cd6a6f1c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:27:01,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac4ffb30-da99-43d4-93ef-e6f6cd6a6f1c`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:27:01,041::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:27:01,042::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:27:01,045::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:27:01,047::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:27:01,049::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:27:01,049::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:27:01,052::task::993::Storage.TaskManager.Task::(_decref) Task=`ac4ffb30-da99-43d4-93ef-e6f6cd6a6f1c`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:27:01,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:01,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018025 s, 56.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:01,984::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:01,985::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:01,987::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:03,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:04,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175314 s, 58.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:27:04,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`03cf33e8-c279-4f0d-ac7e-2ce79e6d2c60`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:27:04,783::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:27:04,783::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464852', 'lastCheck': '3.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:27:04,784::task::1191::Storage.TaskManager.Task::(prepare) Task=`03cf33e8-c279-4f0d-ac7e-2ce79e6d2c60`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464852', 'lastCheck': '3.7', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:27:04,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`03cf33e8-c279-4f0d-ac7e-2ce79e6d2c60`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:27:04,784::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:27:04,784::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:27:04,785::task::993::Storage.TaskManager.Task::(_decref) Task=`03cf33e8-c279-4f0d-ac7e-2ce79e6d2c60`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:27:04,815::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:27:05,763::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:27:06,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:06,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176079 s, 58.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:06,991::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:06,992::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:06,993::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:08,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:08,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121095 s, 8.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:27:10,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-07-08 17:27:11,061::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:27:11,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:11,064::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:11,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:11,067::__init__::225::IOProcess::(_processLogs) (274858) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:27:11,067::__init__::225::IOProcess::(_processLogs) (274858) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:11,068::__init__::225::IOProcess::(_processLogs) (274858) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:11,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:11,068::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 17:27:11,079::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:27:11,085::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:27:11,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`2647f659-d740-4224-a5dd-064859b8e37e`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:27:11,248::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 17:27:11,255::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000577992 s, 799 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:27:11,266::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:27:11,267::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:11,269::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:11,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::INFO::2014-07-08 17:27:11,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:27:11,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 17:27:11,280::task::1191::Storage.TaskManager.Task::(prepare) Task=`2647f659-d740-4224-a5dd-064859b8e37e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:27:11,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 17:27:11,286::task::595::Storage.TaskManager.Task::(_updateState) Task=`2647f659-d740-4224-a5dd-064859b8e37e`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:27:11,291::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:27:11,291::__init__::225::IOProcess::(_processLogs) (274859) Finding callback 'statvfs'... >Thread-7082::DEBUG::2014-07-08 17:27:11,295::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:27:11,298::__init__::225::IOProcess::(_processLogs) (274859) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 17:27:11,303::task::993::Storage.TaskManager.Task::(_decref) Task=`2647f659-d740-4224-a5dd-064859b8e37e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:27:11,304::__init__::225::IOProcess::(_processLogs) (274859) Building response >Thread-18::DEBUG::2014-07-08 17:27:11,310::__init__::225::IOProcess::(_processLogs) (274859) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:11,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:11,322::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:27:11,334::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:27:11,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0e83bac-9d02-4955-ab83-d7865b52f034`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:27:11,343::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:27:11,356::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:27:11,358::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d58ff3e4-64c1-44f0-8885-5f9e0746031d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:27:11,361::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:27:11,363::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:27:11,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:11,434::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:27:11,435::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Dummy-6860::DEBUG::2014-07-08 17:27:11,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.300997 s, 3.4 MB/s\n'; <rc> = 0 >Thread-7083::DEBUG::2014-07-08 17:27:11,440::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`d58ff3e4-64c1-44f0-8885-5f9e0746031d`::Granted request >Thread-18::DEBUG::2014-07-08 17:27:11,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:11,450::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:11,456::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:27:11,456::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c0e83bac-9d02-4955-ab83-d7865b52f034`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:27:11,461::__init__::225::IOProcess::(_processLogs) (274860) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:27:11,462::task::993::Storage.TaskManager.Task::(_decref) Task=`c0e83bac-9d02-4955-ab83-d7865b52f034`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:27:11,466::__init__::225::IOProcess::(_processLogs) (274860) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:11,470::__init__::225::IOProcess::(_processLogs) (274860) Building response >Thread-18::DEBUG::2014-07-08 17:27:11,475::__init__::225::IOProcess::(_processLogs) (274860) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:11,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:11,486::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:27:11,503::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:11,507::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:27:11,510::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:11,513::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:11,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:11,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:11,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:11,534::__init__::225::IOProcess::(_processLogs) (274861) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:11,540::__init__::225::IOProcess::(_processLogs) (274861) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:11,542::__init__::225::IOProcess::(_processLogs) (274861) Building response >Thread-18::DEBUG::2014-07-08 17:27:11,543::__init__::225::IOProcess::(_processLogs) (274861) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:11,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:11,545::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:27:11,558::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:27:11,558::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:11,565::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 17:27:11,565::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0e83bac-9d02-4955-ab83-d7865b52f034`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:27:11,570::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:27:11,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0e83bac-9d02-4955-ab83-d7865b52f034`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:27:11,575::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:27:11,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:27:11,580::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:27:11,581::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:27:11,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:11,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:27:11,588::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-18::DEBUG::2014-07-08 17:27:11,594::__init__::225::IOProcess::(_processLogs) (274862) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:27:11,596::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:27:11,600::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:27:11,601::__init__::225::IOProcess::(_processLogs) (274862) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:27:11,604::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-18::DEBUG::2014-07-08 17:27:11,607::__init__::225::IOProcess::(_processLogs) (274862) Building response >Thread-7083::DEBUG::2014-07-08 17:27:11,611::task::993::Storage.TaskManager.Task::(_decref) Task=`c0e83bac-9d02-4955-ab83-d7865b52f034`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:27:11,613::__init__::225::IOProcess::(_processLogs) (274862) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:11,617::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:11,622::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:11,996::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:11,997::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:11,998::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:13,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7086::DEBUG::2014-07-08 17:27:14,057::task::595::Storage.TaskManager.Task::(_updateState) Task=`75691428-3f5d-441f-93f2-f75ad70e62d7`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:27:14,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >Thread-18::DEBUG::2014-07-08 17:27:14,075::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:14,078::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:27:14,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:14,081::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:14,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:14,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:14,092::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:14,237::__init__::225::IOProcess::(_processLogs) (274863) Finding callback 'stat'... >Dummy-6860::DEBUG::2014-07-08 17:27:14,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.134507 s, 7.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:27:14,249::__init__::225::IOProcess::(_processLogs) (274863) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:27:14,250::__init__::225::IOProcess::(_processLogs) (274863) Building response >Thread-18::DEBUG::2014-07-08 17:27:14,252::__init__::225::IOProcess::(_processLogs) (274863) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:14,253::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:14,254::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:27:14,266::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:14,268::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:27:14,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:14,274::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:14,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:14,277::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:14,279::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:14,280::__init__::225::IOProcess::(_processLogs) (274864) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:27:14,281::__init__::225::IOProcess::(_processLogs) (274864) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:27:14,283::__init__::225::IOProcess::(_processLogs) (274864) Building response >Thread-18::DEBUG::2014-07-08 17:27:14,284::__init__::225::IOProcess::(_processLogs) (274864) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:14,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:14,287::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:27:14,292::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:27:14,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`75691428-3f5d-441f-93f2-f75ad70e62d7`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:27:14,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`75691428-3f5d-441f-93f2-f75ad70e62d7`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:27:14,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:27:14,294::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:27:14,294::task::993::Storage.TaskManager.Task::(_decref) Task=`75691428-3f5d-441f-93f2-f75ad70e62d7`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:27:14,378::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:27:14,379::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:27:16,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:16,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172925 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:17,005::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:17,007::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:17,008::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:18,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:18,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345231 s, 29.7 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:27:20,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`6326b159-dce6-4eb4-8415-9b2ca33fcb87`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:27:20,081::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:27:20,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577992', 'lastCheck': '8.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:27:20,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`6326b159-dce6-4eb4-8415-9b2ca33fcb87`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577992', 'lastCheck': '8.4', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:27:20,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`6326b159-dce6-4eb4-8415-9b2ca33fcb87`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:27:20,083::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:27:20,083::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:27:20,083::task::993::Storage.TaskManager.Task::(_decref) Task=`6326b159-dce6-4eb4-8415-9b2ca33fcb87`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:27:20,113::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:20,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:21,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172478 s, 59.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:27:21,636::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:21,636::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:27:21,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:21,637::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:21,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:21,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:21,637::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:21,638::__init__::225::IOProcess::(_processLogs) (274865) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:27:21,638::__init__::225::IOProcess::(_processLogs) (274865) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:21,638::__init__::225::IOProcess::(_processLogs) (274865) Building response >Thread-18::DEBUG::2014-07-08 17:27:21,638::__init__::225::IOProcess::(_processLogs) (274865) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:21,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:21,639::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:27:21,641::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:27:21,788::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:27:21,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`b323a6a0-08c6-479b-8b34-452a997b31ce`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:27:21,790::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::DEBUG::2014-07-08 17:27:21,792::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.0043795 s, 105 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:27:21,794::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:27:21,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:21,795::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:21,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:21,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:21,796::__init__::225::IOProcess::(_processLogs) Message size is 147DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:21,796::__init__::225::IOProcess::(_processLogs) (274866) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:27:21,796::__init__::225::IOProcess::(_processLogs) (274866) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:21,800::__init__::225::IOProcess::(_processLogs) Message size is 147DEBUG|(274866) Building response >Thread-18::DEBUG::2014-07-08 17:27:21,801::__init__::225::IOProcess::(_processLogs) (274866) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:21,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:21,801::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:27:21,803::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:21,804::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:27:21,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:21,805::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:21,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::INFO::2014-07-08 17:27:21,805::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:27:21,807::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 17:27:21,807::task::1191::Storage.TaskManager.Task::(prepare) Task=`b323a6a0-08c6-479b-8b34-452a997b31ce`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:27:21,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7082::DEBUG::2014-07-08 17:27:21,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`b323a6a0-08c6-479b-8b34-452a997b31ce`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:27:21,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:27:21,810::__init__::225::IOProcess::(_processLogs) (274867) Finding callback 'access'... >Thread-7082::DEBUG::2014-07-08 17:27:21,811::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:27:21,811::__init__::225::IOProcess::(_processLogs) (274867) Got request for method 'access' >Thread-7082::DEBUG::2014-07-08 17:27:21,812::task::993::Storage.TaskManager.Task::(_decref) Task=`b323a6a0-08c6-479b-8b34-452a997b31ce`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:27:21,813::__init__::225::IOProcess::(_processLogs) (274867) Building response >Thread-18::DEBUG::2014-07-08 17:27:21,814::__init__::225::IOProcess::(_processLogs) (274867) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:21,816::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-18::DEBUG::2014-07-08 17:27:21,816::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:27:21,821::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:21,823::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:27:21,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:21,828::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-7083::DEBUG::2014-07-08 17:27:21,832::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:27:21,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:27:21,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7167f29-3c72-4c93-b832-0d2b5cfd241b`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:27:21,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::INFO::2014-07-08 17:27:21,841::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:27:21,842::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:21,844::__init__::225::IOProcess::(_processLogs) (274868) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:21,848::__init__::225::IOProcess::(_processLogs) (274868) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:27:21,849::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`668ddb24-338f-4777-882d-1d3ba7bff10d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:27:21,852::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:27:21,852::__init__::225::IOProcess::(_processLogs) (274868) Building response >Thread-18::DEBUG::2014-07-08 17:27:21,857::__init__::225::IOProcess::(_processLogs) (274868) Queuing response >Thread-7083::DEBUG::2014-07-08 17:27:21,857::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:27:21,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:27:21,861::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`668ddb24-338f-4777-882d-1d3ba7bff10d`::Granted request >Thread-18::DEBUG::2014-07-08 17:27:21,863::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:27:21,869::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d7167f29-3c72-4c93-b832-0d2b5cfd241b`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:27:21,873::task::993::Storage.TaskManager.Task::(_decref) Task=`d7167f29-3c72-4c93-b832-0d2b5cfd241b`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:27:21,875::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:21,881::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:27:21,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:21,890::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:21,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:21,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:21,904::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:21,911::__init__::225::IOProcess::(_processLogs) (274869) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:21,913::__init__::225::IOProcess::(_processLogs) (274869) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:21,915::__init__::225::IOProcess::(_processLogs) (274869) Building response >Thread-18::DEBUG::2014-07-08 17:27:21,916::__init__::225::IOProcess::(_processLogs) (274869) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:21,918::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:21,920::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:27:21,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:27:21,931::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7167f29-3c72-4c93-b832-0d2b5cfd241b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:27:21,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7167f29-3c72-4c93-b832-0d2b5cfd241b`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:27:21,934::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:27:21,936::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:27:21,939::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:27:21,944::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:27:21,946::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:27:21,947::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:27:21,949::task::993::Storage.TaskManager.Task::(_decref) Task=`d7167f29-3c72-4c93-b832-0d2b5cfd241b`::ref 0 aborting False >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:22,015::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:22,016::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:22,017::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:23,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:23,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173738 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:27:25,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:25,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173392 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:27,025::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:27,026::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:27,028::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:27,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:27,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171509 s, 59.7 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:27:29,503::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:27:29,503::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:27:29,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:30,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0998174 s, 10.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:27:31,931::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:31,932::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:27:31,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:31,932::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:31,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:31,933::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:31,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:31,933::__init__::225::IOProcess::(_processLogs) (274870) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:27:31,933::__init__::225::IOProcess::(_processLogs) (274870) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:31,934::__init__::225::IOProcess::(_processLogs) (274870) Building response >Thread-18::DEBUG::2014-07-08 17:27:31,934::__init__::225::IOProcess::(_processLogs) (274870) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:31,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:31,934::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:27:31,936::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:27:32,098::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:27:32,099::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000476864 s, 969 kB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:32,104::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:27:32,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`98a61b8d-94fb-44b4-8eb7-d2e7e37f374c`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:27:32,117::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7082::INFO::2014-07-08 17:27:32,117::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:27:32,121::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:27:32,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:32,129::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:27:32,129::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:32,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:32,138::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:27:32,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::INFO::2014-07-08 17:27:32,141::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:27:32,148::task::1191::Storage.TaskManager.Task::(prepare) Task=`98a61b8d-94fb-44b4-8eb7-d2e7e37f374c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:27:32,147::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-7082::DEBUG::2014-07-08 17:27:32,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`98a61b8d-94fb-44b4-8eb7-d2e7e37f374c`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:27:32,155::__init__::225::IOProcess::(_processLogs) (274871) Finding callback 'statvfs'... >Thread-7082::DEBUG::2014-07-08 17:27:32,156::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:27:32,159::__init__::225::IOProcess::(_processLogs) (274871) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 17:27:32,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:27:32,162::__init__::225::IOProcess::(_processLogs) (274871) Building response >Thread-7082::DEBUG::2014-07-08 17:27:32,164::task::993::Storage.TaskManager.Task::(_decref) Task=`98a61b8d-94fb-44b4-8eb7-d2e7e37f374c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:27:32,165::__init__::225::IOProcess::(_processLogs) (274871) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:32,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:32,172::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:27:32,181::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:32,186::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-7083::DEBUG::2014-07-08 17:27:32,186::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:27:32,189::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:32,192::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:27:32,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4c5d10c-8ff5-4edb-a3c9-f0d67e063951`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:27:32,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::INFO::2014-07-08 17:27:32,196::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:27:32,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:32,202::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:27:32,205::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a49cca0b-351b-4bd4-a1ff-8c3566c78186`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:27:32,205::__init__::225::IOProcess::(_processLogs) (274872) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:27:32,206::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:27:32,208::__init__::225::IOProcess::(_processLogs) (274872) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:27:32,211::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:27:32,212::__init__::225::IOProcess::(_processLogs) (274872) Building response >Thread-7083::DEBUG::2014-07-08 17:27:32,213::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`a49cca0b-351b-4bd4-a1ff-8c3566c78186`::Granted request >Thread-18::DEBUG::2014-07-08 17:27:32,215::__init__::225::IOProcess::(_processLogs) (274872) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:32,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:27:32,220::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f4c5d10c-8ff5-4edb-a3c9-f0d67e063951`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:27:32,222::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:27:32,223::task::993::Storage.TaskManager.Task::(_decref) Task=`f4c5d10c-8ff5-4edb-a3c9-f0d67e063951`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:27:32,233::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:32,237::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:27:32,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:32,243::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:32,247::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:32,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:32,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:32,260::__init__::225::IOProcess::(_processLogs) (274873) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:32,264::__init__::225::IOProcess::(_processLogs) (274873) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:32,268::__init__::225::IOProcess::(_processLogs) (274873) Building response >Thread-18::DEBUG::2014-07-08 17:27:32,270::__init__::225::IOProcess::(_processLogs) (274873) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:32,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:32,272::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:27:32,278::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:27:32,279::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:27:32,280::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4c5d10c-8ff5-4edb-a3c9-f0d67e063951`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:27:32,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4c5d10c-8ff5-4edb-a3c9-f0d67e063951`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:27:32,283::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:27:32,284::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:27:32,283::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 17:27:32,286::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:27:32,288::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:27:32,289::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-07-08 17:27:32,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:27:32,290::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:27:32,292::task::993::Storage.TaskManager.Task::(_decref) Task=`f4c5d10c-8ff5-4edb-a3c9-f0d67e063951`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:27:32,294::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:32,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:32,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:32,300::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:32,301::__init__::225::IOProcess::(_processLogs) (274874) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:32,302::__init__::225::IOProcess::(_processLogs) (274874) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:32,304::__init__::225::IOProcess::(_processLogs) (274874) Building response >Thread-18::DEBUG::2014-07-08 17:27:32,305::__init__::225::IOProcess::(_processLogs) (274874) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:32,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:32,308::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-6860::DEBUG::2014-07-08 17:27:32,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:32,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328684 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:27:34,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:34,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173551 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:27:35,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7edc6e8-e5df-4721-b4bb-317f9fbb85b3`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:27:35,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:27:35,348::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476864', 'lastCheck': '3.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:27:35,348::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7edc6e8-e5df-4721-b4bb-317f9fbb85b3`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476864', 'lastCheck': '3.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:27:35,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7edc6e8-e5df-4721-b4bb-317f9fbb85b3`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:27:35,349::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:27:35,349::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:27:35,349::task::993::Storage.TaskManager.Task::(_decref) Task=`b7edc6e8-e5df-4721-b4bb-317f9fbb85b3`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:27:35,380::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:27:36,092::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:27:36,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:37,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349142 s, 29.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:37,160::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:37,164::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:37,168::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:39,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:39,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171294 s, 59.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:27:41,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:41,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01714 s, 59.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:42,178::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:42,180::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:42,181::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7082::DEBUG::2014-07-08 17:27:42,313::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:27:42,316::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 17:27:42,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`b760acf3-ee48-44ed-9d0b-e700a36a3e7d`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:27:42,318::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 17:27:42,319::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:27:42,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:42,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:42,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:42,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:42,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:42,323::__init__::225::IOProcess::(_processLogs) (274875) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:27:42,326::__init__::225::IOProcess::(_processLogs) (274875) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:42,327::__init__::225::IOProcess::(_processLogs) DEBUG|(274875) Building response >Thread-18::DEBUG::2014-07-08 17:27:42,327::__init__::225::IOProcess::(_processLogs) (274875) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:42,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:42,327::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:27:42,329::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::INFO::2014-07-08 17:27:42,476::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:27:42,478::task::1191::Storage.TaskManager.Task::(prepare) Task=`b760acf3-ee48-44ed-9d0b-e700a36a3e7d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 17:27:42,479::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000728287 s, 634 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:27:42,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`b760acf3-ee48-44ed-9d0b-e700a36a3e7d`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:27:42,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:27:42,484::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7082::DEBUG::2014-07-08 17:27:42,485::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:27:42,486::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::DEBUG::2014-07-08 17:27:42,487::task::993::Storage.TaskManager.Task::(_decref) Task=`b760acf3-ee48-44ed-9d0b-e700a36a3e7d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:27:42,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:42,490::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:42,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:42,493::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:42,493::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:42,494::__init__::225::IOProcess::(_processLogs) (274876) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:27:42,494::__init__::225::IOProcess::(_processLogs) (274876) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:42,494::__init__::225::IOProcess::(_processLogs) (274876) Building response >Thread-18::DEBUG::2014-07-08 17:27:42,494::__init__::225::IOProcess::(_processLogs) (274876) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:42,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:42,495::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:27:42,497::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:27:42,497::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:42,498::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:42,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:42,498::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:42,498::__init__::225::IOProcess::(_processLogs) (274877) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:42,499::__init__::225::IOProcess::(_processLogs) (274877) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:42,499::__init__::225::IOProcess::(_processLogs) (274877) Building response >Thread-18::DEBUG::2014-07-08 17:27:42,499::__init__::225::IOProcess::(_processLogs) (274877) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:42,499::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:42,500::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:27:42,501::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:27:42,501::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:42,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:42,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:27:42,505::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:27:42,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:27:42,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5efeee7-4306-40fa-83b0-097aeca8d240`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:27:42,508::__init__::225::IOProcess::(_processLogs) (274878) Finding callback 'access'... >Thread-7083::INFO::2014-07-08 17:27:42,509::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:27:42,510::__init__::225::IOProcess::(_processLogs) (274878) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:42,512::__init__::225::IOProcess::(_processLogs) (274878) Building response >Thread-18::DEBUG::2014-07-08 17:27:42,513::__init__::225::IOProcess::(_processLogs) (274878) Queuing response >Thread-7083::DEBUG::2014-07-08 17:27:42,514::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bc8bf689-8c9d-46ba-99ba-8a6fa15c5719`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:27:42,517::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:27:42,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:42,519::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:27:42,519::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:27:42,521::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`bc8bf689-8c9d-46ba-99ba-8a6fa15c5719`::Granted request >Thread-18::DEBUG::2014-07-08 17:27:42,524::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 17:27:42,525::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c5efeee7-4306-40fa-83b0-097aeca8d240`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:27:42,525::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:27:42,527::task::993::Storage.TaskManager.Task::(_decref) Task=`c5efeee7-4306-40fa-83b0-097aeca8d240`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:27:42,527::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:42,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:42,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:42,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:42,533::__init__::225::IOProcess::(_processLogs) (274879) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:42,534::__init__::225::IOProcess::(_processLogs) (274879) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:42,536::__init__::225::IOProcess::(_processLogs) (274879) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:42,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:42,539::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:27:42,579::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:27:42,581::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5efeee7-4306-40fa-83b0-097aeca8d240`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847576002560', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:27:42,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5efeee7-4306-40fa-83b0-097aeca8d240`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:27:42,583::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:27:42,584::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:27:42,586::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:27:42,587::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:27:42,588::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:27:42,588::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:27:42,590::task::993::Storage.TaskManager.Task::(_decref) Task=`c5efeee7-4306-40fa-83b0-097aeca8d240`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:27:43,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:43,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172551 s, 59.3 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:27:44,542::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:27:44,543::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:27:45,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:46,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0964227 s, 10.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:47,188::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:47,190::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:47,191::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:48,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:48,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017687 s, 57.9 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:27:50,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d3038f6-c926-4bbf-9916-11aacf758096`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:27:50,545::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:27:50,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728287', 'lastCheck': '8.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:27:50,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d3038f6-c926-4bbf-9916-11aacf758096`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728287', 'lastCheck': '8.0', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:27:50,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d3038f6-c926-4bbf-9916-11aacf758096`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:27:50,546::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:27:50,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:27:50,547::task::993::Storage.TaskManager.Task::(_decref) Task=`2d3038f6-c926-4bbf-9916-11aacf758096`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:27:50,578::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:50,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:50,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0187977 s, 54.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:52,199::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:52,201::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:52,202::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-37::DEBUG::2014-07-08 17:27:52,544::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:27:52,558::__init__::225::IOProcess::(_processLogs) Message size is 139 >Thread-18::DEBUG::2014-07-08 17:27:52,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,559::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,560::__init__::225::IOProcess::(_processLogs) (274880) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:27:52,560::__init__::225::IOProcess::(_processLogs) (274880) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:27:52,561::__init__::225::IOProcess::(_processLogs) (274880) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,561::__init__::225::IOProcess::(_processLogs) (274880) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,561::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:27:52,562::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:27:52,563::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,564::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,564::__init__::225::IOProcess::(_processLogs) (274881) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:27:52,565::__init__::225::IOProcess::(_processLogs) (274881) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:27:52,565::__init__::225::IOProcess::(_processLogs) (274881) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,565::__init__::225::IOProcess::(_processLogs) (274881) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,565::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,566::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-07-08 17:27:52,567::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-18::DEBUG::2014-07-08 17:27:52,567::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,568::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,568::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,568::__init__::225::IOProcess::(_processLogs) (274882) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:27:52,569::__init__::225::IOProcess::(_processLogs) (274882) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:27:52,569::__init__::225::IOProcess::(_processLogs) (274882) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,569::__init__::225::IOProcess::(_processLogs) (274882) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,570::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-18::DEBUG::2014-07-08 17:27:52,571::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-18::DEBUG::2014-07-08 17:27:52,573::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,574::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,580::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,583::__init__::225::IOProcess::(_processLogs) (274883) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:27:52,585::__init__::225::IOProcess::(_processLogs) (274883) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:27:52,587::__init__::225::IOProcess::(_processLogs) (274883) Building response >Thread-37::DEBUG::2014-07-08 17:27:52,588::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539 >Thread-18::DEBUG::2014-07-08 17:27:52,589::__init__::225::IOProcess::(_processLogs) (274883) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,590::__init__::225::IOProcess::(_processLogs) Sending response sized 172 >Thread-18::DEBUG::2014-07-08 17:27:52,591::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:52,592::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-18::DEBUG::2014-07-08 17:27:52,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,593::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,594::__init__::225::IOProcess::(_processLogs) (274884) Finding callback 'touch'... >Thread-18::DEBUG::2014-07-08 17:27:52,594::__init__::225::IOProcess::(_processLogs) (274884) Got request for method 'touch' >Thread-18::DEBUG::2014-07-08 17:27:52,594::__init__::225::IOProcess::(_processLogs) DEBUG|(274884) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,594::__init__::225::IOProcess::(_processLogs) (274884) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,595::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,595::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-37::DEBUG::2014-07-08 17:27:52,596::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-18::DEBUG::2014-07-08 17:27:52,597::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:52,597::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-18::DEBUG::2014-07-08 17:27:52,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,598::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,599::__init__::225::IOProcess::(_processLogs) (274885) Finding callback 'readfile'... >Thread-18::DEBUG::2014-07-08 17:27:52,599::__init__::225::IOProcess::(_processLogs) (274885) Got request for method 'readfile' >Thread-18::DEBUG::2014-07-08 17:27:52,599::__init__::225::IOProcess::(_processLogs) DEBUG|(274885) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,599::__init__::225::IOProcess::(_processLogs) (274885) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,600::__init__::225::IOProcess::(_processLogs) Sending response sized 690 >Thread-37::DEBUG::2014-07-08 17:27:52,601::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=mstorage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=new-dc', 'POOL_DOMAINS=2b5f401c-f143-45db-8578-1a8666cba539:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=36ffc40d-feca-42ea-a0ae-e40506318f67', 'REMOTE_PATH=10.35.160.108:/RHEV/mstorge', 'ROLE=Master', 'SDUUID=2b5f401c-f143-45db-8578-1a8666cba539', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=96c42bed6afab0fe829e0b06d072714dd5e66fd3'] >Thread-18::DEBUG::2014-07-08 17:27:52,602::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:52,602::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-18::DEBUG::2014-07-08 17:27:52,603::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,603::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,604::__init__::225::IOProcess::(_processLogs) (274886) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:52,604::__init__::225::IOProcess::(_processLogs) (274886) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:52,604::__init__::225::IOProcess::(_processLogs) (274886) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,605::__init__::225::IOProcess::(_processLogs) (274886) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,605::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:27:52,606::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:27:52,606::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-18::DEBUG::2014-07-08 17:27:52,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,607::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,608::__init__::225::IOProcess::(_processLogs) (274887) Finding callback 'glob'... >Thread-18::DEBUG::2014-07-08 17:27:52,608::__init__::225::IOProcess::(_processLogs) (274887) Got request for method 'glob' >Thread-18::DEBUG::2014-07-08 17:27:52,608::__init__::225::IOProcess::(_processLogs) (274887) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,609::__init__::225::IOProcess::(_processLogs) (274887) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7082::DEBUG::2014-07-08 17:27:52,612::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:27:52,613::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-7082::DEBUG::2014-07-08 17:27:52,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea1c19cc-9da1-4af1-9779-a8b805231678`::moving from state init -> state preparing >Thread-37::DEBUG::2014-07-08 17:27:52,617::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-7082::INFO::2014-07-08 17:27:52,618::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-37::INFO::2014-07-08 17:27:52,618::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_imageNS already registered >Thread-37::INFO::2014-07-08 17:27:52,619::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2b5f401c-f143-45db-8578-1a8666cba539_volumeNS already registered >Thread-18::DEBUG::2014-07-08 17:27:52,621::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:27:52,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,622::__init__::225::IOProcess::(_processLogs) (274888) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:27:52,622::__init__::225::IOProcess::(_processLogs) (274888) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:52,623::__init__::225::IOProcess::(_processLogs) (274888) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,623::__init__::225::IOProcess::(_processLogs) (274888) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,623::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-37::DEBUG::2014-07-08 17:27:52,626::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::INFO::2014-07-08 17:27:52,778::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 17:27:52,785::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000511505 s, 903 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:27:52,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea1c19cc-9da1-4af1-9779-a8b805231678`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:27:52,793::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::DEBUG::2014-07-08 17:27:52,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea1c19cc-9da1-4af1-9779-a8b805231678`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:27:52,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 17:27:52,798::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:27:52,799::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 17:27:52,801::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:27:52,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,807::__init__::225::IOProcess::(_processLogs) (274889) Finding callback 'statvfs'... >Thread-7082::DEBUG::2014-07-08 17:27:52,807::task::993::Storage.TaskManager.Task::(_decref) Task=`ea1c19cc-9da1-4af1-9779-a8b805231678`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:27:52,810::__init__::225::IOProcess::(_processLogs) (274889) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:27:52,813::__init__::225::IOProcess::(_processLogs) (274889) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,816::__init__::225::IOProcess::(_processLogs) (274889) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,820::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:27:52,828::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:27:52,829::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,835::__init__::225::IOProcess::(_processLogs) (274890) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:52,836::__init__::225::IOProcess::(_processLogs) (274890) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:52,837::__init__::225::IOProcess::(_processLogs) (274890) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,839::__init__::225::IOProcess::(_processLogs) (274890) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,841::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:27:52,850::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:27:52,849::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:27:52,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::DEBUG::2014-07-08 17:27:52,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`966cfa2f-98a5-4193-ba88-e209b5cc9fd1`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:27:52,858::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:27:52,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:27:52,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:27:52,867::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2c554537-42d1-49ce-bea8-0d7177c5dddd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:27:52,867::__init__::225::IOProcess::(_processLogs) (274891) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:27:52,869::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:27:52,870::__init__::225::IOProcess::(_processLogs) (274891) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:52,873::__init__::225::IOProcess::(_processLogs) (274891) Building response >Thread-7083::DEBUG::2014-07-08 17:27:52,874::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:27:52,875::__init__::225::IOProcess::(_processLogs) (274891) Queuing response >Thread-7083::DEBUG::2014-07-08 17:27:52,877::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`2c554537-42d1-49ce-bea8-0d7177c5dddd`::Granted request >Thread-18::DEBUG::2014-07-08 17:27:52,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,881::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:27:52,884::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`966cfa2f-98a5-4193-ba88-e209b5cc9fd1`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:27:52,887::task::993::Storage.TaskManager.Task::(_decref) Task=`966cfa2f-98a5-4193-ba88-e209b5cc9fd1`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:27:52,891::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:27:52,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:27:52,900::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:27:52,903::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:27:52,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:27:52,910::__init__::225::IOProcess::(_processLogs) (274892) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:27:52,912::__init__::225::IOProcess::(_processLogs) (274892) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:27:52,915::__init__::225::IOProcess::(_processLogs) (274892) Building response >Thread-18::DEBUG::2014-07-08 17:27:52,918::__init__::225::IOProcess::(_processLogs) (274892) Queuing response >Thread-18::DEBUG::2014-07-08 17:27:52,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:27:52,922::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:27:52,941::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847573839872', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:27:52,943::task::1191::Storage.TaskManager.Task::(prepare) Task=`966cfa2f-98a5-4193-ba88-e209b5cc9fd1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847573839872', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:27:52,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`966cfa2f-98a5-4193-ba88-e209b5cc9fd1`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:27:52,946::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:27:52,947::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:27:52,951::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Dummy-6860::DEBUG::2014-07-08 17:27:52,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7083::DEBUG::2014-07-08 17:27:53,124::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:27:53,127::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:27:53,130::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:27:53,134::task::993::Storage.TaskManager.Task::(_decref) Task=`966cfa2f-98a5-4193-ba88-e209b5cc9fd1`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:27:53,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.055835 s, 18.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:27:55,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:55,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017325 s, 59.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:57,209::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:57,210::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:27:57,212::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:27:57,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:27:57,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017323 s, 59.1 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:27:59,609::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:27:59,609::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:27:59,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:00,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172621 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:28:02,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:02,369::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:02,466::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:02,473::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:28:02,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121253 s, 8.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:28:02,929::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:02,929::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:02,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:02,930::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:02,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:02,931::__init__::225::IOProcess::(_processLogs) (274893) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:02,931::__init__::225::IOProcess::(_processLogs) (274893) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:02,931::__init__::225::IOProcess::(_processLogs) (274893) Building response >Thread-18::DEBUG::2014-07-08 17:28:02,931::__init__::225::IOProcess::(_processLogs) (274893) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:02,932::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:02,932::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:28:02,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:28:03,085::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000491112 s, 941 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:28:03,087::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:03,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:03,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:03,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:03,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:03,089::__init__::225::IOProcess::(_processLogs) (274894) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:03,089::__init__::225::IOProcess::(_processLogs) (274894) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:03,089::__init__::225::IOProcess::(_processLogs) (274894) Building response >Thread-18::DEBUG::2014-07-08 17:28:03,090::__init__::225::IOProcess::(_processLogs) (274894) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:03,092::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:28:03,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:03,093::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:03,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:03,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:03,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:03,094::__init__::225::IOProcess::(_processLogs) (274895) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:03,094::__init__::225::IOProcess::(_processLogs) (274895) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:03,094::__init__::225::IOProcess::(_processLogs) (274895) Building response >Thread-18::DEBUG::2014-07-08 17:28:03,095::__init__::225::IOProcess::(_processLogs) (274895) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:03,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:03,095::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:28:03,096::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:28:03,097::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:03,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:03,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:03,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:03,098::__init__::225::IOProcess::(_processLogs) (274896) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:03,098::__init__::225::IOProcess::(_processLogs) (274896) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:03,098::__init__::225::IOProcess::(_processLogs) (274896) Building response >Thread-18::DEBUG::2014-07-08 17:28:03,099::__init__::225::IOProcess::(_processLogs) (274896) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:03,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:03,099::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:28:03,100::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:28:03,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:03,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:03,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:03,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:03,102::__init__::225::IOProcess::(_processLogs) (274897) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:03,103::__init__::225::IOProcess::(_processLogs) (274897) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:03,103::__init__::225::IOProcess::(_processLogs) (274897) Building response >Thread-18::DEBUG::2014-07-08 17:28:03,103::__init__::225::IOProcess::(_processLogs) (274897) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:03,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:03,104::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:28:03,163::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:28:03,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d0a8482-4ae6-4cef-9d6f-2dcd3d0fbf01`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:28:03,169::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7082::INFO::2014-07-08 17:28:03,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:28:03,184::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d0a8482-4ae6-4cef-9d6f-2dcd3d0fbf01`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:28:03,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d0a8482-4ae6-4cef-9d6f-2dcd3d0fbf01`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:28:03,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:28:03,185::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:28:03,185::task::993::Storage.TaskManager.Task::(_decref) Task=`7d0a8482-4ae6-4cef-9d6f-2dcd3d0fbf01`::ref 0 aborting False >Thread-7083::DEBUG::2014-07-08 17:28:03,200::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:28:03,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1f4ae1f-1007-4cd1-9070-82fe49451784`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:28:03,201::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:28:03,202::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4de6be90-a623-4965-b35c-b8ebe029ab64`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:28:03,202::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:28:03,203::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:28:03,203::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`4de6be90-a623-4965-b35c-b8ebe029ab64`::Granted request >Thread-7083::DEBUG::2014-07-08 17:28:03,203::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a1f4ae1f-1007-4cd1-9070-82fe49451784`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:28:03,204::task::993::Storage.TaskManager.Task::(_decref) Task=`a1f4ae1f-1007-4cd1-9070-82fe49451784`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:28:03,222::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847573839872', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:03,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1f4ae1f-1007-4cd1-9070-82fe49451784`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847573839872', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:03,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1f4ae1f-1007-4cd1-9070-82fe49451784`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:28:03,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:28:03,224::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:28:03,224::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:28:03,225::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:28:03,225::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:28:03,225::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:28:03,226::task::993::Storage.TaskManager.Task::(_decref) Task=`a1f4ae1f-1007-4cd1-9070-82fe49451784`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:28:04,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:04,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173451 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:28:05,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`07e68456-5df0-4c11-8b4c-2810ecd1a602`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:28:05,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:28:05,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491112', 'lastCheck': '2.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:28:05,691::task::1191::Storage.TaskManager.Task::(prepare) Task=`07e68456-5df0-4c11-8b4c-2810ecd1a602`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491112', 'lastCheck': '2.6', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:28:05,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`07e68456-5df0-4c11-8b4c-2810ecd1a602`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:28:05,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:28:05,692::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:28:05,692::task::993::Storage.TaskManager.Task::(_decref) Task=`07e68456-5df0-4c11-8b4c-2810ecd1a602`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:28:05,725::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-07-08 17:28:06,368::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >Dummy-6860::DEBUG::2014-07-08 17:28:06,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:07,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174694 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:07,487::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:07,494::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:07,498::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:28:09,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:09,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173752 s, 58.9 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:28:11,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:11,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353679 s, 29.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:12,506::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:12,507::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:12,508::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:28:13,174::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:13,178::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:13,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:13,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:13,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:13,180::__init__::225::IOProcess::(_processLogs) (274898) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:13,180::__init__::225::IOProcess::(_processLogs) (274898) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:13,180::__init__::225::IOProcess::(_processLogs) (274898) Building response >Thread-18::DEBUG::2014-07-08 17:28:13,180::__init__::225::IOProcess::(_processLogs) (274898) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:13,181::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:13,181::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:28:13,189::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:28:13,435::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000518768 s, 891 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:28:13,435::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:28:13,449::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:13,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:13,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:13,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:13,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:13,452::__init__::225::IOProcess::(_processLogs) (274899) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:13,452::__init__::225::IOProcess::(_processLogs) (274899) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:13,453::__init__::225::IOProcess::(_processLogs) (274899) Building response >Thread-18::DEBUG::2014-07-08 17:28:13,453::__init__::225::IOProcess::(_processLogs) (274899) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:13,453::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:13,454::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 17:28:13,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`35b6af53-560f-4f4b-a18e-cf153addcb1f`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:28:13,460::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:28:13,462::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:28:13,462::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:13,463::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:13,463::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:13,463::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:13,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:13,464::__init__::225::IOProcess::(_processLogs) (274900) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:13,464::__init__::225::IOProcess::(_processLogs) (274900) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:13,464::__init__::225::IOProcess::(_processLogs) (274900) Building response >Thread-18::DEBUG::2014-07-08 17:28:13,464::__init__::225::IOProcess::(_processLogs) (274900) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:13,464::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:13,465::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:28:13,466::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:13,467::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:28:13,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:13,467::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:13,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:13,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:13,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:13,468::__init__::225::IOProcess::(_processLogs) (274901) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:13,468::__init__::225::IOProcess::(_processLogs) (274901) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:13,470::__init__::225::IOProcess::(_processLogs) (274901) Building response >Thread-18::DEBUG::2014-07-08 17:28:13,478::__init__::225::IOProcess::(_processLogs) (274901) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:13,479::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-7082::INFO::2014-07-08 17:28:13,479::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:28:13,480::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::DEBUG::2014-07-08 17:28:13,481::task::1191::Storage.TaskManager.Task::(prepare) Task=`35b6af53-560f-4f4b-a18e-cf153addcb1f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:28:13,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`35b6af53-560f-4f4b-a18e-cf153addcb1f`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:28:13,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:28:13,484::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:28:13,484::task::993::Storage.TaskManager.Task::(_decref) Task=`35b6af53-560f-4f4b-a18e-cf153addcb1f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:28:13,487::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:13,489::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:28:13,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:13,493::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:13,495::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:13,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:28:13,505::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:28:13,508::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:28:13,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0e76155-56c2-4c0a-a951-54fb1abf54eb`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:28:13,514::__init__::225::IOProcess::(_processLogs) (274902) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:13,519::__init__::225::IOProcess::(_processLogs) (274902) Got request for method 'access' >Thread-7083::INFO::2014-07-08 17:28:13,520::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:28:13,526::__init__::225::IOProcess::(_processLogs) (274902) Building response >Thread-18::DEBUG::2014-07-08 17:28:13,528::__init__::225::IOProcess::(_processLogs) (274902) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:13,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:28:13,533::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`aea6d2a4-6b9e-41b7-9935-696052d061a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:28:13,533::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:28:13,535::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:28:13,539::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:28:13,542::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`aea6d2a4-6b9e-41b7-9935-696052d061a3`::Granted request >Thread-7083::DEBUG::2014-07-08 17:28:13,551::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e0e76155-56c2-4c0a-a951-54fb1abf54eb`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:28:13,553::task::993::Storage.TaskManager.Task::(_decref) Task=`e0e76155-56c2-4c0a-a951-54fb1abf54eb`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:28:13,591::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847573807104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:13,593::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0e76155-56c2-4c0a-a951-54fb1abf54eb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847573807104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:13,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0e76155-56c2-4c0a-a951-54fb1abf54eb`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:28:13,597::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:28:13,598::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:28:13,600::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:28:13,602::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:28:13,603::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:28:13,605::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:28:13,607::task::993::Storage.TaskManager.Task::(_decref) Task=`e0e76155-56c2-4c0a-a951-54fb1abf54eb`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:28:17,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7086::DEBUG::2014-07-08 17:28:17,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ee722cb-2dc2-474e-a0c6-86c1f57968e1`::moving from state init -> state preparing >Thread-7086::INFO::2014-07-08 17:28:17,573::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='2b5f401c-f143-45db-8578-1a8666cba539', spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', imgUUID='c1abf407-d743-43d7-85bb-157eec06157c', volUUID='f49c2dc9-a84e-484a-b8d7-efe4afd34c76', options=None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:17,579::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:28:17,600::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:17,607::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:28:17,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:17,619::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:17,625::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:28:17,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:17,636::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:17,643::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:17,652::__init__::225::IOProcess::(_processLogs) (274903) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:28:17,660::__init__::225::IOProcess::(_processLogs) (274903) Got request for method 'stat' >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:17,662::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:28:17,669::__init__::225::IOProcess::(_processLogs) DEBUG|(274903) Building response >Thread-18::DEBUG::2014-07-08 17:28:17,676::__init__::225::IOProcess::(_processLogs) (274903) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:17,683::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:17,688::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-18::DEBUG::2014-07-08 17:28:17,707::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:17,712::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-18::DEBUG::2014-07-08 17:28:17,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:17,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:17,729::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:17,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:17,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:17,745::__init__::225::IOProcess::(_processLogs) (274904) Finding callback 'stat'... >Thread-18::DEBUG::2014-07-08 17:28:17,751::__init__::225::IOProcess::(_processLogs) (274904) Got request for method 'stat' >Thread-18::DEBUG::2014-07-08 17:28:17,759::__init__::225::IOProcess::(_processLogs) DEBUG|(274904) Building response >Thread-18::DEBUG::2014-07-08 17:28:17,828::__init__::225::IOProcess::(_processLogs) (274904) Queuing response >Dummy-6860::DEBUG::2014-07-08 17:28:17,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.198857 s, 5.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:28:17,832::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:17,836::__init__::225::IOProcess::(_processLogs) Sending response sized 328 >Thread-7086::INFO::2014-07-08 17:28:17,847::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:28:17,850::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ee722cb-2dc2-474e-a0c6-86c1f57968e1`::finished: {'truesize': '24576', 'apparentsize': '10737418240'} >Thread-7086::DEBUG::2014-07-08 17:28:17,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ee722cb-2dc2-474e-a0c6-86c1f57968e1`::moving from state preparing -> state finished >Thread-7086::DEBUG::2014-07-08 17:28:17,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7086::DEBUG::2014-07-08 17:28:17,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7086::DEBUG::2014-07-08 17:28:17,860::task::993::Storage.TaskManager.Task::(_decref) Task=`0ee722cb-2dc2-474e-a0c6-86c1f57968e1`::ref 0 aborting False >Thread-7086::DEBUG::2014-07-08 17:28:17,952::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:28:17,953::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:28:19,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:20,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172319 s, 59.4 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:28:22,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:22,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171909 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:22,692::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:22,693::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:22,694::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:28:23,543::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:23,544::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:23,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:23,544::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:23,544::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:23,545::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:23,545::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:23,545::__init__::225::IOProcess::(_processLogs) (274905) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:23,545::__init__::225::IOProcess::(_processLogs) (274905) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:23,546::__init__::225::IOProcess::(_processLogs) (274905) Building response >Thread-18::DEBUG::2014-07-08 17:28:23,546::__init__::225::IOProcess::(_processLogs) (274905) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:23,546::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:23,546::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:28:23,548::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:28:23,703::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000641965 s, 720 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:28:23,703::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7087::DEBUG::2014-07-08 17:28:23,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`a43d681e-83fb-47fb-a1c3-f7494b341074`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:28:23,714::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7087::INFO::2014-07-08 17:28:23,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:28:23,717::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:23,720::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:23,721::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:23,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:23,726::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:23,726::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:23,727::__init__::225::IOProcess::(_processLogs) (274906) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:23,729::__init__::225::IOProcess::(_processLogs) (274906) Got request for method 'statvfs' >Thread-7082::DEBUG::2014-07-08 17:28:23,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`c774a510-fc85-4739-83e0-d4106a7836b5`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:28:23,731::__init__::225::IOProcess::(_processLogs) (274906) Building response >Thread-7082::INFO::2014-07-08 17:28:23,732::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-18::DEBUG::2014-07-08 17:28:23,733::__init__::225::IOProcess::(_processLogs) (274906) Queuing response >Thread-7087::INFO::2014-07-08 17:28:23,735::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::INFO::2014-07-08 17:28:23,736::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518768', 'lastCheck': '10.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:28:23,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`a43d681e-83fb-47fb-a1c3-f7494b341074`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:28:23,737::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::DEBUG::2014-07-08 17:28:23,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`a43d681e-83fb-47fb-a1c3-f7494b341074`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:28:23,740::task::1191::Storage.TaskManager.Task::(prepare) Task=`c774a510-fc85-4739-83e0-d4106a7836b5`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518768', 'lastCheck': '10.2', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:28:23,741::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:28:23,743::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:28:23,744::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 17:28:23,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`c774a510-fc85-4739-83e0-d4106a7836b5`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:28:23,745::task::993::Storage.TaskManager.Task::(_decref) Task=`a43d681e-83fb-47fb-a1c3-f7494b341074`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:28:23,747::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:28:23,751::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:28:23,755::task::993::Storage.TaskManager.Task::(_decref) Task=`c774a510-fc85-4739-83e0-d4106a7836b5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:28:23,758::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:23,760::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:28:23,761::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:23,764::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:23,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:28:23,771::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:28:23,773::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:28:23,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef7397fe-9562-4435-a045-3eafa9067625`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:28:23,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:23,781::__init__::225::IOProcess::(_processLogs) (274907) Finding callback 'access'... >Thread-7083::INFO::2014-07-08 17:28:23,781::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:28:23,783::__init__::225::IOProcess::(_processLogs) (274907) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:23,786::__init__::225::IOProcess::(_processLogs) (274907) Building response >Thread-18::DEBUG::2014-07-08 17:28:23,789::__init__::225::IOProcess::(_processLogs) (274907) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:23,792::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:28:23,793::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f1f5e5c5-fe01-42ae-b2d9-3f7d8aceb6ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:28:23,794::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:28:23,796::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:28:23,803::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:28:23,806::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-7083::DEBUG::2014-07-08 17:28:23,808::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f1f5e5c5-fe01-42ae-b2d9-3f7d8aceb6ec`::Granted request >Thread-18::DEBUG::2014-07-08 17:28:23,812::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:28:23,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:23,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7083::DEBUG::2014-07-08 17:28:23,827::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ef7397fe-9562-4435-a045-3eafa9067625`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:28:23,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:23,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:28:23,836::task::993::Storage.TaskManager.Task::(_decref) Task=`ef7397fe-9562-4435-a045-3eafa9067625`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:28:23,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:23,849::__init__::225::IOProcess::(_processLogs) (274908) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:23,857::__init__::225::IOProcess::(_processLogs) (274908) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:23,864::__init__::225::IOProcess::(_processLogs) DEBUG|(274908) Building response >Thread-18::DEBUG::2014-07-08 17:28:23,871::__init__::225::IOProcess::(_processLogs) (274908) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:23,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:23,979::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:28:24,015::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:24,018::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:28:24,020::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:24,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:24,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:24,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:24,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:24,045::__init__::225::IOProcess::(_processLogs) (274909) Finding callback 'access'... >Thread-7082::DEBUG::2014-07-08 17:28:24,048::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:28:24,053::__init__::225::IOProcess::(_processLogs) (274909) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:24,146::__init__::225::IOProcess::(_processLogs) (274909) Building response >Thread-18::DEBUG::2014-07-08 17:28:24,165::__init__::225::IOProcess::(_processLogs) (274909) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:24,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:24,166::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:28:24,175::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847573807104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:24,176::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef7397fe-9562-4435-a045-3eafa9067625`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847573807104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:24,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef7397fe-9562-4435-a045-3eafa9067625`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:28:24,176::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:28:24,177::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:28:24,177::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:28:24,178::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:28:24,178::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:28:24,178::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:28:24,179::task::993::Storage.TaskManager.Task::(_decref) Task=`ef7397fe-9562-4435-a045-3eafa9067625`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:28:24,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:24,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174183 s, 58.8 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:28:26,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:26,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017099 s, 59.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:27,702::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:27,703::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:27,704::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:28:28,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:29,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173406 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:28:31,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:31,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176451 s, 58.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:32,712::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:32,713::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:32,714::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:28:33,179::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:28:33,180::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:28:33,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:33,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176931 s, 57.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:28:34,170::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:34,170::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:34,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:34,171::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:34,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:34,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:34,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:34,172::__init__::225::IOProcess::(_processLogs) (274910) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:34,172::__init__::225::IOProcess::(_processLogs) (274910) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:34,172::__init__::225::IOProcess::(_processLogs) (274910) Building response >Thread-18::DEBUG::2014-07-08 17:28:34,172::__init__::225::IOProcess::(_processLogs) (274910) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:34,173::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:34,173::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:28:34,175::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:28:34,328::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-37::DEBUG::2014-07-08 17:28:34,332::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000642802 s, 719 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:28:34,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`69cdd020-afe6-4e9b-8576-8a0f2f584b96`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:28:34,337::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-7082::INFO::2014-07-08 17:28:34,337::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:28:34,339::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:34,340::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:34,340::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:34,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:34,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:34,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:34,342::__init__::225::IOProcess::(_processLogs) (274911) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:34,342::__init__::225::IOProcess::(_processLogs) (274911) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:34,342::__init__::225::IOProcess::(_processLogs) (274911) Building response >Thread-18::DEBUG::2014-07-08 17:28:34,342::__init__::225::IOProcess::(_processLogs) (274911) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:34,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:34,343::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:28:34,345::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:34,346::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:28:34,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:34,347::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:34,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:34,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:34,347::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:34,348::__init__::225::IOProcess::(_processLogs) (274912) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:34,348::__init__::225::IOProcess::(_processLogs) (274912) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:34,348::__init__::225::IOProcess::(_processLogs) (274912) Building response >Thread-18::DEBUG::2014-07-08 17:28:34,348::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(274912) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:34,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:34,349::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:28:34,350::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-18::DEBUG::2014-07-08 17:28:34,350::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:28:34,351::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:34,351::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:34,351::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:34,351::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:34,352::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:34,352::__init__::225::IOProcess::(_processLogs) (274913) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:34,352::__init__::225::IOProcess::(_processLogs) (274913) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:34,352::__init__::225::IOProcess::(_processLogs) (274913) Building response >Thread-18::DEBUG::2014-07-08 17:28:34,353::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:34,353::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7082::INFO::2014-07-08 17:28:34,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:28:34,356::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7082::DEBUG::2014-07-08 17:28:34,357::task::1191::Storage.TaskManager.Task::(prepare) Task=`69cdd020-afe6-4e9b-8576-8a0f2f584b96`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:28:34,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7082::DEBUG::2014-07-08 17:28:34,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`69cdd020-afe6-4e9b-8576-8a0f2f584b96`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-07-08 17:28:34,359::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-7082::DEBUG::2014-07-08 17:28:34,359::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:28:34,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7082::DEBUG::2014-07-08 17:28:34,361::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:28:34,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7082::DEBUG::2014-07-08 17:28:34,363::task::993::Storage.TaskManager.Task::(_decref) Task=`69cdd020-afe6-4e9b-8576-8a0f2f584b96`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:28:34,363::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:34,365::__init__::225::IOProcess::(_processLogs) (274914) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:34,366::__init__::225::IOProcess::(_processLogs) (274914) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:34,367::__init__::225::IOProcess::(_processLogs) (274914) Building response >Thread-18::DEBUG::2014-07-08 17:28:34,368::__init__::225::IOProcess::(_processLogs) (274914) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:34,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:34,368::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:28:34,378::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7083::DEBUG::2014-07-08 17:28:34,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`63a18281-e2c9-452f-8fd1-064984314912`::moving from state init -> state preparing >Thread-7083::INFO::2014-07-08 17:28:34,379::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-7083::DEBUG::2014-07-08 17:28:34,380::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5ba6632f-c31e-4624-b25a-69ed8dbfcea3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:28:34,380::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-7083::DEBUG::2014-07-08 17:28:34,381::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:28:34,381::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`5ba6632f-c31e-4624-b25a-69ed8dbfcea3`::Granted request >Thread-7083::DEBUG::2014-07-08 17:28:34,382::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`63a18281-e2c9-452f-8fd1-064984314912`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:28:34,382::task::993::Storage.TaskManager.Task::(_decref) Task=`63a18281-e2c9-452f-8fd1-064984314912`::ref 1 aborting False >Thread-7083::INFO::2014-07-08 17:28:34,402::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847572791296', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:34,402::task::1191::Storage.TaskManager.Task::(prepare) Task=`63a18281-e2c9-452f-8fd1-064984314912`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847572791296', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:34,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`63a18281-e2c9-452f-8fd1-064984314912`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:28:34,403::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:28:34,403::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:28:34,404::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:28:34,404::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:28:34,404::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:28:34,405::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:28:34,405::task::993::Storage.TaskManager.Task::(_decref) Task=`63a18281-e2c9-452f-8fd1-064984314912`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:28:35,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:36,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175912 s, 58.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:28:36,525::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:37,722::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:37,727::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:37,735::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:28:38,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:38,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101077 s, 10.1 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:28:39,266::task::595::Storage.TaskManager.Task::(_updateState) Task=`c84ec7ab-bd75-4825-8695-ced6a6aab709`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:28:39,266::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:28:39,267::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642802', 'lastCheck': '4.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:28:39,267::task::1191::Storage.TaskManager.Task::(prepare) Task=`c84ec7ab-bd75-4825-8695-ced6a6aab709`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642802', 'lastCheck': '4.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:28:39,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`c84ec7ab-bd75-4825-8695-ced6a6aab709`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:28:39,268::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:28:39,268::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:28:39,268::task::993::Storage.TaskManager.Task::(_decref) Task=`c84ec7ab-bd75-4825-8695-ced6a6aab709`::ref 0 aborting False >Thread-7082::DEBUG::2014-07-08 17:28:39,300::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:28:40,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:40,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173493 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:42,744::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:42,745::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:42,746::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:28:42,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:43,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171931 s, 59.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:28:44,371::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:44,371::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:44,372::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:44,372::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:44,372::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:44,372::__init__::225::IOProcess::(_processLogs) (274915) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:44,373::__init__::225::IOProcess::(_processLogs) (274915) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:44,373::__init__::225::IOProcess::(_processLogs) (274915) Building response >Thread-18::DEBUG::2014-07-08 17:28:44,373::__init__::225::IOProcess::(_processLogs) (274915) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:44,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:44,374::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:28:44,375::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-37::DEBUG::2014-07-08 17:28:44,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000571288 s, 809 kB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:28:44,533::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-7082::DEBUG::2014-07-08 17:28:44,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3696e45-352a-4784-a499-b2f71314a922`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:28:44,539::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7082::INFO::2014-07-08 17:28:44,542::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:28:44,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:44,544::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:44,545::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:44,545::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:44,548::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:44,551::__init__::225::IOProcess::(_processLogs) (274916) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:44,553::__init__::225::IOProcess::(_processLogs) (274916) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:44,556::__init__::225::IOProcess::(_processLogs) (274916) Building response >Thread-7082::INFO::2014-07-08 17:28:44,559::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7082::DEBUG::2014-07-08 17:28:44,563::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3696e45-352a-4784-a499-b2f71314a922`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-18::DEBUG::2014-07-08 17:28:44,562::__init__::225::IOProcess::(_processLogs) (274916) Queuing response >Thread-7082::DEBUG::2014-07-08 17:28:44,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3696e45-352a-4784-a499-b2f71314a922`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:28:44,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:28:44,571::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:28:44,570::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7082::DEBUG::2014-07-08 17:28:44,574::task::993::Storage.TaskManager.Task::(_decref) Task=`d3696e45-352a-4784-a499-b2f71314a922`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:28:44,590::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:28:44,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:44,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:44,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:44,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:44,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:44,598::__init__::225::IOProcess::(_processLogs) (274917) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:44,601::__init__::225::IOProcess::(_processLogs) (274917) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:28:44,604::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:28:44,605::__init__::225::IOProcess::(_processLogs) (274917) Building response >Thread-18::DEBUG::2014-07-08 17:28:44,610::__init__::225::IOProcess::(_processLogs) (274917) Queuing response >Thread-7083::DEBUG::2014-07-08 17:28:44,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`911425ad-2cb1-41a1-b8d9-99dd2808dbc4`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:28:44,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::INFO::2014-07-08 17:28:44,615::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:28:44,620::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:28:44,623::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`97bfe7c6-04e6-4afb-ac25-d79806f2094c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-7083::DEBUG::2014-07-08 17:28:44,624::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:28:44,625::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-7083::DEBUG::2014-07-08 17:28:44,626::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:28:44,628::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`97bfe7c6-04e6-4afb-ac25-d79806f2094c`::Granted request >Thread-18::DEBUG::2014-07-08 17:28:44,628::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:44,629::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:28:44,630::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`911425ad-2cb1-41a1-b8d9-99dd2808dbc4`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:28:44,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:28:44,632::task::993::Storage.TaskManager.Task::(_decref) Task=`911425ad-2cb1-41a1-b8d9-99dd2808dbc4`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:28:44,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:44,634::__init__::225::IOProcess::(_processLogs) (274918) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:44,636::__init__::225::IOProcess::(_processLogs) (274918) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:44,638::__init__::225::IOProcess::(_processLogs) (274918) Building response >Thread-18::DEBUG::2014-07-08 17:28:44,640::__init__::225::IOProcess::(_processLogs) (274918) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:44,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:44,643::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:28:44,649::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:28:44,651::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:44,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:44,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:44,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:44,653::__init__::225::IOProcess::(_processLogs) (274919) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:44,653::__init__::225::IOProcess::(_processLogs) (274919) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:44,653::__init__::225::IOProcess::(_processLogs) (274919) Building response >Thread-18::DEBUG::2014-07-08 17:28:44,654::__init__::225::IOProcess::(_processLogs) (274919) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:44,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:44,654::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:28:44,668::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847571480576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:44,668::task::1191::Storage.TaskManager.Task::(prepare) Task=`911425ad-2cb1-41a1-b8d9-99dd2808dbc4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847571480576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:28:44,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`911425ad-2cb1-41a1-b8d9-99dd2808dbc4`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:28:44,669::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:28:44,669::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:28:44,670::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:28:44,670::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:28:44,670::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:28:44,670::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:28:44,671::task::993::Storage.TaskManager.Task::(_decref) Task=`911425ad-2cb1-41a1-b8d9-99dd2808dbc4`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:28:45,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:45,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.121051 s, 8.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:28:47,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:47,754::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:47,756::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:47,761::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:28:47,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0201722 s, 50.8 MB/s\n'; <rc> = 0 >Thread-7086::DEBUG::2014-07-08 17:28:48,357::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:28:48,358::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:28:49,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:50,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017325 s, 59.1 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:28:52,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:52,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174333 s, 58.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:52,770::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:52,772::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:52,773::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:28:54,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-7082::DEBUG::2014-07-08 17:28:54,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2688b11-2cc9-4223-aaa5-31a5050e9788`::moving from state init -> state preparing >Thread-7082::INFO::2014-07-08 17:28:54,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7082::INFO::2014-07-08 17:28:54,556::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571288', 'lastCheck': '9.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:28:54,556::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2688b11-2cc9-4223-aaa5-31a5050e9788`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571288', 'lastCheck': '9.9', 'valid': True}} >Thread-7082::DEBUG::2014-07-08 17:28:54,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2688b11-2cc9-4223-aaa5-31a5050e9788`::moving from state preparing -> state finished >Thread-7082::DEBUG::2014-07-08 17:28:54,556::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7082::DEBUG::2014-07-08 17:28:54,557::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7082::DEBUG::2014-07-08 17:28:54,557::task::993::Storage.TaskManager.Task::(_decref) Task=`a2688b11-2cc9-4223-aaa5-31a5050e9788`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:28:54,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360056 s, 28.4 MB/s\n'; <rc> = 0 >Thread-7082::DEBUG::2014-07-08 17:28:54,662::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-18::DEBUG::2014-07-08 17:28:54,665::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:54,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:54,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:54,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:54,679::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:54,681::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:54,684::__init__::225::IOProcess::(_processLogs) (274920) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:28:54,686::__init__::225::IOProcess::(_processLogs) (274920) Got request for method 'statvfs' >Thread-7087::DEBUG::2014-07-08 17:28:54,690::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:28:54,695::__init__::225::IOProcess::(_processLogs) (274920) Queuing response >Thread-7087::DEBUG::2014-07-08 17:28:54,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b050e6e-2428-4993-a4b6-da5b1cb7aeba`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:28:54,700::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::INFO::2014-07-08 17:28:54,705::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:28:54,706::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:28:54,715::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::INFO::2014-07-08 17:28:54,865::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:28:54,869::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b050e6e-2428-4993-a4b6-da5b1cb7aeba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:28:54,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b050e6e-2428-4993-a4b6-da5b1cb7aeba`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-08 17:28:54,876::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.00262457 s, 176 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:28:54,879::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:28:54,886::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:28:54,892::task::993::Storage.TaskManager.Task::(_decref) Task=`5b050e6e-2428-4993-a4b6-da5b1cb7aeba`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:28:54,895::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:28:54,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:54,912::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:54,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:54,924::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:28:54,929::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:28:54,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-7083::DEBUG::2014-07-08 17:28:54,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`93039950-e2c1-4f3c-97ce-c217270ed741`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:28:54,940::__init__::225::IOProcess::(_processLogs) (274921) Finding callback 'statvfs'... >Thread-7083::INFO::2014-07-08 17:28:54,946::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:28:54,947::__init__::225::IOProcess::(_processLogs) (274921) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:28:54,956::__init__::225::IOProcess::(_processLogs) (274921) Queuing response >Thread-7083::DEBUG::2014-07-08 17:28:54,962::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`869796dc-771f-419f-8b9a-5917e1d89cf7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:28:54,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7083::DEBUG::2014-07-08 17:28:54,966::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:28:54,972::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-7083::DEBUG::2014-07-08 17:28:54,977::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-7083::DEBUG::2014-07-08 17:28:54,983::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`869796dc-771f-419f-8b9a-5917e1d89cf7`::Granted request >Thread-7083::DEBUG::2014-07-08 17:28:55,002::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`93039950-e2c1-4f3c-97ce-c217270ed741`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-7083::DEBUG::2014-07-08 17:28:55,008::task::993::Storage.TaskManager.Task::(_decref) Task=`93039950-e2c1-4f3c-97ce-c217270ed741`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:28:55,010::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:28:55,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:55,019::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:28:55,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:55,028::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:55,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:55,032::__init__::225::IOProcess::(_processLogs) (274922) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:55,036::__init__::225::IOProcess::(_processLogs) (274922) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:55,041::__init__::225::IOProcess::(_processLogs) (274922) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:55,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:55,044::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:28:55,046::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:28:55,047::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:55,047::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:55,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:55,049::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:55,050::__init__::225::IOProcess::(_processLogs) (274923) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:28:55,051::__init__::225::IOProcess::(_processLogs) (274923) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:28:55,052::__init__::225::IOProcess::(_processLogs) (274923) Building response >Thread-18::DEBUG::2014-07-08 17:28:55,053::__init__::225::IOProcess::(_processLogs) (274923) Queuing response >Thread-18::DEBUG::2014-07-08 17:28:55,054::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:55,055::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:28:55,059::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-07-08 17:28:55,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:28:55,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:28:55,063::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:28:55,064::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:28:55,065::__init__::225::IOProcess::(_processLogs) (274924) Finding callback 'access'... >Thread-7083::INFO::2014-07-08 17:28:55,066::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847571480576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:28:55,070::__init__::225::IOProcess::(_processLogs) (274924) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:28:55,070::task::1191::Storage.TaskManager.Task::(prepare) Task=`93039950-e2c1-4f3c-97ce-c217270ed741`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847571480576', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-18::DEBUG::2014-07-08 17:28:55,073::__init__::225::IOProcess::(_processLogs) (274924) Building response >Thread-7083::DEBUG::2014-07-08 17:28:55,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`93039950-e2c1-4f3c-97ce-c217270ed741`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:28:55,077::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-18::DEBUG::2014-07-08 17:28:55,076::__init__::225::IOProcess::(_processLogs) (274924) Queuing response >Thread-7083::DEBUG::2014-07-08 17:28:55,078::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:28:55,080::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:28:55,083::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:28:55,083::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:28:55,088::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:28:55,090::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:28:55,092::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:28:55,094::task::993::Storage.TaskManager.Task::(_decref) Task=`93039950-e2c1-4f3c-97ce-c217270ed741`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:28:57,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:57,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0239259 s, 42.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:57,780::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:57,782::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:28:57,783::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:28:59,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:28:59,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175191 s, 58.5 MB/s\n'; <rc> = 0 >Dummy-6860::DEBUG::2014-07-08 17:29:01,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:29:02,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174043 s, 58.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:29:02,790::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:29:02,791::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:29:02,792::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Thread-7086::DEBUG::2014-07-08 17:29:03,398::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 74 edom: 10 level: 2 message: argument unsupported: QEMU driver does not support <metadata> element >Thread-7086::ERROR::2014-07-08 17:29:03,398::vm::319::vm.Vm::(_sampleCpuTune) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Failed to retrieve QoS metadata >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 316, in _sampleCpuTune > libvirt.VIR_DOMAIN_METADATA_ELEMENT, METADATA_VM_TUNE_URI, 0) > File "/usr/share/vdsm/virt/vm.py", line 604, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 111, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 904, in metadata > if ret is None: raise libvirtError ('virDomainGetMetadata() failed', dom=self) >libvirtError: argument unsupported: QEMU driver does not support <metadata> element >Dummy-6860::DEBUG::2014-07-08 17:29:04,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:29:04,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173889 s, 58.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-08 17:29:05,097::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-07-08 17:29:05,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:29:05,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:29:05,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:29:05,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:29:05,109::__init__::225::IOProcess::(_processLogs) (274925) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:29:05,110::__init__::225::IOProcess::(_processLogs) (274925) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:29:05,114::__init__::225::IOProcess::(_processLogs) (274925) Building response >Thread-7087::DEBUG::2014-07-08 17:29:05,117::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:29:05,120::__init__::225::IOProcess::(_processLogs) (274925) Queuing response >Thread-7087::DEBUG::2014-07-08 17:29:05,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`21755ce9-117f-4da0-ad0f-94c7c637c5e4`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:29:05,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-7087::INFO::2014-07-08 17:29:05,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:29:05,130::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-37::DEBUG::2014-07-08 17:29:05,144::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mstorge/2b5f401c-f143-45db-8578-1a8666cba539/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-7087::INFO::2014-07-08 17:29:05,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-7087::DEBUG::2014-07-08 17:29:05,300::task::1191::Storage.TaskManager.Task::(prepare) Task=`21755ce9-117f-4da0-ad0f-94c7c637c5e4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 6L}} >Thread-37::DEBUG::2014-07-08 17:29:05,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n462 bytes (462 B) copied, 0.000564303 s, 819 kB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:29:05,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`21755ce9-117f-4da0-ad0f-94c7c637c5e4`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:29:05,309::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-07-08 17:29:05,310::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-7087::DEBUG::2014-07-08 17:29:05,310::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-07-08 17:29:05,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7087::DEBUG::2014-07-08 17:29:05,312::task::993::Storage.TaskManager.Task::(_decref) Task=`21755ce9-117f-4da0-ad0f-94c7c637c5e4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-08 17:29:05,314::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:29:05,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:29:05,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:29:05,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:29:05,319::__init__::225::IOProcess::(_processLogs) (274926) Finding callback 'statvfs'... >Thread-18::DEBUG::2014-07-08 17:29:05,319::__init__::225::IOProcess::(_processLogs) (274926) Got request for method 'statvfs' >Thread-18::DEBUG::2014-07-08 17:29:05,319::__init__::225::IOProcess::(_processLogs) (274926) Queuing response >Thread-18::DEBUG::2014-07-08 17:29:05,319::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:29:05,320::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-18::DEBUG::2014-07-08 17:29:05,322::__init__::225::IOProcess::(_processLogs) Message size is 164 >Thread-18::DEBUG::2014-07-08 17:29:05,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:29:05,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:29:05,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:29:05,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:29:05,323::__init__::225::IOProcess::(_processLogs) (274927) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:29:05,324::__init__::225::IOProcess::(_processLogs) (274927) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:29:05,324::__init__::225::IOProcess::(_processLogs) (274927) Building response >Thread-18::DEBUG::2014-07-08 17:29:05,324::__init__::225::IOProcess::(_processLogs) (274927) Queuing response >Thread-18::DEBUG::2014-07-08 17:29:05,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:29:05,325::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-18::DEBUG::2014-07-08 17:29:05,326::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-18::DEBUG::2014-07-08 17:29:05,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-07-08 17:29:05,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:29:05,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-07-08 17:29:05,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-18::DEBUG::2014-07-08 17:29:05,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-18::DEBUG::2014-07-08 17:29:05,327::__init__::225::IOProcess::(_processLogs) (274928) Finding callback 'access'... >Thread-18::DEBUG::2014-07-08 17:29:05,328::__init__::225::IOProcess::(_processLogs) (274928) Got request for method 'access' >Thread-18::DEBUG::2014-07-08 17:29:05,328::__init__::225::IOProcess::(_processLogs) (274928) Building response >Thread-18::DEBUG::2014-07-08 17:29:05,328::__init__::225::IOProcess::(_processLogs) (274928) Queuing response >Thread-18::DEBUG::2014-07-08 17:29:05,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:29:05,329::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::DEBUG::2014-07-08 17:29:05,332::BindingXMLRPC::298::vds::(wrapper) client [10.35.162.23] >Thread-18::DEBUG::2014-07-08 17:29:05,335::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-7083::DEBUG::2014-07-08 17:29:05,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4b29982-ec8d-4a73-bb6f-0786add819a0`::moving from state init -> state preparing >Thread-18::DEBUG::2014-07-08 17:29:05,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-7083::INFO::2014-07-08 17:29:05,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='36ffc40d-feca-42ea-a0ae-e40506318f67', options=None) >Thread-18::DEBUG::2014-07-08 17:29:05,339::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-07-08 17:29:05,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-7083::DEBUG::2014-07-08 17:29:05,343::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f0a881c8-a394-4693-8934-58830dfedea8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2607' at 'getStoragePoolInfo' >Thread-18::DEBUG::2014-07-08 17:29:05,343::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-7083::DEBUG::2014-07-08 17:29:05,344::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' for lock type 'shared' >Thread-18::DEBUG::2014-07-08 17:29:05,345::__init__::225::IOProcess::(_processLogs) (274929) Finding callback 'access'... >Thread-7083::DEBUG::2014-07-08 17:29:05,349::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free. Now locking as 'shared' (1 active user) >Thread-18::DEBUG::2014-07-08 17:29:05,351::__init__::225::IOProcess::(_processLogs) (274929) Got request for method 'access' >Thread-7083::DEBUG::2014-07-08 17:29:05,352::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.36ffc40d-feca-42ea-a0ae-e40506318f67`ReqID=`f0a881c8-a394-4693-8934-58830dfedea8`::Granted request >Thread-18::DEBUG::2014-07-08 17:29:05,353::__init__::225::IOProcess::(_processLogs) (274929) Building response >Thread-7083::DEBUG::2014-07-08 17:29:05,355::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c4b29982-ec8d-4a73-bb6f-0786add819a0`::_resourcesAcquired: Storage.36ffc40d-feca-42ea-a0ae-e40506318f67 (shared) >Thread-18::DEBUG::2014-07-08 17:29:05,355::__init__::225::IOProcess::(_processLogs) (274929) Queuing response >Thread-7083::DEBUG::2014-07-08 17:29:05,360::task::993::Storage.TaskManager.Task::(_decref) Task=`c4b29982-ec8d-4a73-bb6f-0786add819a0`::ref 1 aborting False >Thread-18::DEBUG::2014-07-08 17:29:05,361::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-07-08 17:29:05,362::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-7083::INFO::2014-07-08 17:29:05,384::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847571546112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:29:05,385::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4b29982-ec8d-4a73-bb6f-0786add819a0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 6L, 'domains': '2b5f401c-f143-45db-8578-1a8666cba539:Active', 'master_uuid': u'2b5f401c-f143-45db-8578-1a8666cba539', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'2b5f401c-f143-45db-8578-1a8666cba539': {'status': 'Active', 'diskfree': '1847571546112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 3}}} >Thread-7083::DEBUG::2014-07-08 17:29:05,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4b29982-ec8d-4a73-bb6f-0786add819a0`::moving from state preparing -> state finished >Thread-7083::DEBUG::2014-07-08 17:29:05,386::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67': < ResourceRef 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', isValid: 'True' obj: 'None'>} >Thread-7083::DEBUG::2014-07-08 17:29:05,386::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7083::DEBUG::2014-07-08 17:29:05,386::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' >Thread-7083::DEBUG::2014-07-08 17:29:05,387::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' (0 active users) >Thread-7083::DEBUG::2014-07-08 17:29:05,387::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67' is free, finding out if anyone is waiting for it. >Thread-7083::DEBUG::2014-07-08 17:29:05,387::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.36ffc40d-feca-42ea-a0ae-e40506318f67', Clearing records. >Thread-7083::DEBUG::2014-07-08 17:29:05,388::task::993::Storage.TaskManager.Task::(_decref) Task=`c4b29982-ec8d-4a73-bb6f-0786add819a0`::ref 0 aborting False >Dummy-6860::DEBUG::2014-07-08 17:29:06,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:29:06,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179256 s, 57.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-08 17:29:06,627::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 52. >GuestMonitor-vm1::DEBUG::2014-07-08 17:29:07,801::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:29:07,807::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:29:07,811::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:29:08,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:29:08,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173431 s, 59.0 MB/s\n'; <rc> = 0 >Thread-7087::DEBUG::2014-07-08 17:29:09,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`893e4195-ab56-4b11-ba3a-4f81956d5cb1`::moving from state init -> state preparing >Thread-7087::INFO::2014-07-08 17:29:09,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-7087::INFO::2014-07-08 17:29:09,809::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564303', 'lastCheck': '4.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:29:09,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`893e4195-ab56-4b11-ba3a-4f81956d5cb1`::finished: {'2b5f401c-f143-45db-8578-1a8666cba539': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564303', 'lastCheck': '4.4', 'valid': True}} >Thread-7087::DEBUG::2014-07-08 17:29:09,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`893e4195-ab56-4b11-ba3a-4f81956d5cb1`::moving from state preparing -> state finished >Thread-7087::DEBUG::2014-07-08 17:29:09,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-7087::DEBUG::2014-07-08 17:29:09,810::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-7087::DEBUG::2014-07-08 17:29:09,811::task::993::Storage.TaskManager.Task::(_decref) Task=`893e4195-ab56-4b11-ba3a-4f81956d5cb1`::ref 0 aborting False >Thread-7087::DEBUG::2014-07-08 17:29:09,845::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:29:11,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:29:11,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172682 s, 59.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm1::DEBUG::2014-07-08 17:29:12,821::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:29:12,823::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >GuestMonitor-vm1::DEBUG::2014-07-08 17:29:12,824::vm::423::vm.Vm::(_getUserCpuTuneInfo) vmId=`9b0bd5aa-d706-426a-a077-62a64954b803`::Domain Metadata is not set >Dummy-6860::DEBUG::2014-07-08 17:29:13,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/36ffc40d-feca-42ea-a0ae-e40506318f67/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-6860::DEBUG::2014-07-08 17:29:13,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351187 s, 29.2 MB/s\n'; <rc> = 0
<b>You cannot view the attachment while viewing its details because your browser does not support IFRAMEs. <a href="attachment.cgi?id=916428">View the attachment on a separate page</a>.</b>
View Attachment As Raw
Actions:
View
Attachments on
bug 1117388
: 916428 |
916429
|
916430
|
916445
|
916447
|
916448
|
916727
|
916766